-- Logs begin at Wed 2021-08-25 04:38:33 UTC, end at Wed 2021-08-25 06:26:04 UTC. -- Aug 25 05:22:03.519054 dv-cinder-786627-19-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 25 05:22:03.526437 dv-cinder-786627-19-iscsi devstack@n-api.service[93719]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 25 05:22:03.528460 dv-cinder-786627-19-iscsi devstack@n-api.service[93719]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 25 05:22:03 2021] *** Aug 25 05:22:03.528460 dv-cinder-786627-19-iscsi devstack@n-api.service[93719]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 25 05:22:03.528460 dv-cinder-786627-19-iscsi devstack@n-api.service[93719]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 25 05:22:03.528460 dv-cinder-786627-19-iscsi devstack@n-api.service[93719]: nodename: dv-cinder-786627-19-iscsi Aug 25 05:22:03.528460 dv-cinder-786627-19-iscsi devstack@n-api.service[93719]: machine: x86_64 Aug 25 05:22:03.528460 dv-cinder-786627-19-iscsi devstack@n-api.service[93719]: clock source: unix Aug 25 05:22:03.528460 dv-cinder-786627-19-iscsi devstack@n-api.service[93719]: pcre jit disabled Aug 25 05:22:03.528948 dv-cinder-786627-19-iscsi devstack@n-api.service[93719]: detected number of CPU cores: 4 Aug 25 05:22:03.528948 dv-cinder-786627-19-iscsi devstack@n-api.service[93719]: current working directory: / Aug 25 05:22:03.528948 dv-cinder-786627-19-iscsi devstack@n-api.service[93719]: detected binary path: /usr/bin/uwsgi-core Aug 25 05:22:03.528948 dv-cinder-786627-19-iscsi devstack@n-api.service[93719]: your processes number limit is 47680 Aug 25 05:22:03.528948 dv-cinder-786627-19-iscsi devstack@n-api.service[93719]: your memory page size is 4096 bytes Aug 25 05:22:03.528948 dv-cinder-786627-19-iscsi devstack@n-api.service[93719]: detected max file descriptor number: 2048 Aug 25 05:22:03.528948 dv-cinder-786627-19-iscsi devstack@n-api.service[93719]: lock engine: pthread robust mutexes Aug 25 05:22:03.528948 dv-cinder-786627-19-iscsi devstack@n-api.service[93719]: thunder lock: enabled Aug 25 05:22:03.528948 dv-cinder-786627-19-iscsi devstack@n-api.service[93719]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 25 05:22:03.528948 dv-cinder-786627-19-iscsi devstack@n-api.service[93719]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 25 05:22:03.576163 dv-cinder-786627-19-iscsi devstack@n-api.service[93719]: Python main interpreter initialized at 0x55718c8539c0 Aug 25 05:22:03.576163 dv-cinder-786627-19-iscsi devstack@n-api.service[93719]: python threads support enabled Aug 25 05:22:03.576163 dv-cinder-786627-19-iscsi devstack@n-api.service[93719]: your server socket listen backlog is limited to 100 connections Aug 25 05:22:03.576163 dv-cinder-786627-19-iscsi devstack@n-api.service[93719]: your mercy for graceful operations on workers is 90 seconds Aug 25 05:22:03.576547 dv-cinder-786627-19-iscsi devstack@n-api.service[93719]: mapped 403077 bytes (393 KB) for 2 cores Aug 25 05:22:03.576640 dv-cinder-786627-19-iscsi devstack@n-api.service[93719]: *** Operational MODE: preforking *** Aug 25 05:22:03.577351 dv-cinder-786627-19-iscsi devstack@n-api.service[93719]: *** uWSGI is running in multiple interpreter mode *** Aug 25 05:22:03.577351 dv-cinder-786627-19-iscsi devstack@n-api.service[93719]: spawned uWSGI master process (pid: 93719) Aug 25 05:22:03.577574 dv-cinder-786627-19-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 25 05:22:03.581641 dv-cinder-786627-19-iscsi devstack@n-api.service[93719]: spawned uWSGI worker 1 (pid: 93720, cores: 1) Aug 25 05:22:03.581641 dv-cinder-786627-19-iscsi devstack@n-api.service[93719]: spawned uWSGI worker 2 (pid: 93721, cores: 1) Aug 25 05:22:03.581641 dv-cinder-786627-19-iscsi devstack@n-api.service[93719]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 25 05:22:05.239310 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 05:22:05.239310 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: from cryptography.utils import int_from_bytes Aug 25 05:22:05.239999 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 05:22:05.239999 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: from cryptography.utils import int_from_bytes Aug 25 05:22:05.242293 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 05:22:05.242293 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: from cryptography.utils import int_from_bytes Aug 25 05:22:05.242785 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 05:22:05.242785 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: from cryptography.utils import int_from_bytes Aug 25 05:22:07.899495 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 25 05:22:07.900115 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 25 05:22:07.900115 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 25 05:22:07.900466 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 25 05:22:07.900719 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 25 05:22:07.901103 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.901428 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.901550 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 25 05:22:07.901904 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.902004 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 25 05:22:07.902086 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.902262 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 25 05:22:07.902385 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.902625 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 25 05:22:07.902727 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.902880 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 25 05:22:07.902990 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.903262 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.903346 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.903587 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.903684 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.903857 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.903947 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.904170 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.904259 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.904490 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-786627-19-iscsi {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.904582 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.904843 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.904991 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.905138 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.905297 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.905444 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.905558 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.905784 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.905870 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.906058 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.906200 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.906354 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.906450 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.906675 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-786627-19-iscsi {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.906771 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.906993 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.907170 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.907322 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.908283 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.908668 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.908668 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.908860 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.908996 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.909080 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.909080 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.909228 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.909305 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.909380 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.909380 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.909613 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.909758 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.909857 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.909967 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.910118 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.910284 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.910411 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.910590 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.910739 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.910986 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-786627-19-iscsi {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.911136 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.911301 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.911407 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.911612 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.911722 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.911920 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.912005 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.912235 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.912328 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.912542 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.912636 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.912919 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.913008 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-786627-19-iscsi {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.913230 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.913320 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.913554 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.913682 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.913864 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.913969 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.914187 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.914284 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.914501 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.914585 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.914817 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.914903 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.915138 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.915231 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.915437 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.915521 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.915742 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.915837 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.916048 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.916139 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.916358 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.916442 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.916657 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.916747 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.916957 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.917041 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.917205 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.917306 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.917508 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.917650 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.917846 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.917931 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.918161 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.918265 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.918472 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.918556 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.918736 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.918823 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.918968 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.919066 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.919282 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.919367 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.919598 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.919685 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.919902 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.919987 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.920206 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.920785 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.920986 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.921189 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.921358 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.921510 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.921827 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.921931 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.922132 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.922437 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.922522 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.922743 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.922971 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.923169 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.923257 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.923561 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.923737 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.924129 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.924446 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.924780 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.924864 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.925190 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.925467 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.925757 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.926076 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.926499 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.926848 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.926961 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.927309 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.927401 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.927645 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.927946 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.928045 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.928307 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.928498 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.928828 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.929148 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.929466 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.929629 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.929824 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.929953 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.930159 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.930291 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.930485 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.930706 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.930799 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.930970 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.931055 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.931289 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.931372 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.931611 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.931695 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.931919 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.932012 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.932226 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.932320 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.932533 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.932625 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.932854 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.932985 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.933140 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.933238 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.933448 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.933551 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.933782 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.933866 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.934089 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.934186 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.934395 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.934487 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.934697 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.934781 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.934946 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.935039 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.935251 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.935335 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.935558 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.935649 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.935877 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.935996 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.936740 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.936884 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.937177 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.937285 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.937499 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.937722 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.937841 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.938037 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.938149 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.938434 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.938529 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.938747 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.938833 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.939055 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.939137 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.939374 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.939560 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.939678 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.939948 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.940038 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.940259 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.940351 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.940572 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.940657 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.940871 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.940956 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.941185 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.941291 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.941485 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.941812 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.941898 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.942127 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.942226 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.942432 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.942526 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.942735 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.942820 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.943035 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.943126 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.943336 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.943423 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.943635 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.943729 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.943934 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.944026 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.944233 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.944327 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.944534 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.944627 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.944829 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.944914 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.945135 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.945222 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.945448 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.945557 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.945778 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.945862 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.946078 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.946163 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.946378 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.946470 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.946681 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.946810 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.946980 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.947062 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.947289 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.947375 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.947597 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.947681 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.947904 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.947992 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.948208 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.948294 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.948514 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.948607 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.948819 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.948910 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.949123 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.949207 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.949426 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.949518 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.949755 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.949841 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.950053 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.950137 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.950372 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.950472 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.950689 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.950774 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.950994 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.951084 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.951300 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.951393 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.951652 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.951788 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.951978 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:22:07.952317 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.952640 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.952729 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.952964 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.953049 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.953278 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.953362 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.953615 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.953715 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.953939 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.954031 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.954269 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.954354 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.954578 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.954667 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.954888 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.954981 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.955210 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.955295 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.955522 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.955608 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.955834 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.955918 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.956147 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.956239 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.956464 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.956550 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.956782 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.956865 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.957094 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.957186 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.957406 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.957491 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.957744 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.957840 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.958061 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.958146 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.958369 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.958460 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.958677 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.958765 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.959001 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.959094 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.959313 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.959398 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.959621 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.959704 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.959920 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.960013 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.960225 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.960312 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.960528 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.960651 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.960838 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.960932 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.961140 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.961227 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.961459 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.961564 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.961811 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.961912 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.962119 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.962242 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.962445 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.962530 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.962748 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.962839 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.963059 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.963150 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.963365 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.963450 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.963670 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.963755 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.963981 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.964066 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.964292 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.964377 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.964595 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.964679 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.964899 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.964984 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.965204 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.965289 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.965510 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.965627 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.965836 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.965920 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.966150 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.966234 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.966457 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.966542 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.966763 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.966847 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.967067 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.967159 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.967420 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.967578 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.967728 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.967877 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.968022 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.968118 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.968326 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.968419 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.968633 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.968717 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.968938 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.969040 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.969243 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.969336 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.969588 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.969678 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.969902 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.970072 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.970208 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.970306 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.970520 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.970648 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.970822 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.970913 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.971125 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.971221 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.971425 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.971516 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.971727 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.971820 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.972027 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.972112 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.972334 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.972419 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.972631 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.972713 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.972935 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.973021 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.973241 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.973327 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.973560 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.973648 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.973866 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.973951 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.974185 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.974286 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.974492 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.974578 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.974793 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.974885 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.975094 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.975191 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.975393 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.975479 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.975698 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.975782 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.976001 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.976096 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.976305 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.976392 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.976607 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.976699 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.976913 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.977007 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.977216 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.977305 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.977517 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.977665 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.977844 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.977941 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.978145 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.978239 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.978445 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.978530 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.978763 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.978860 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.979070 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.979156 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.979370 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.979454 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.979670 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.979756 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.979970 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.980056 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.980279 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.980364 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.980598 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.980688 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.980901 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.980985 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.981218 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.981303 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.981549 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.981650 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.981856 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.981941 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.982192 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.982284 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.982502 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.982587 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.983345 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.983471 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.983669 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.983818 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.983985 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.984124 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.984274 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.984360 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.984591 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.984686 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.984899 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.984985 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.985213 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.985297 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.985541 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.985643 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.985860 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.985946 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.986166 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.986250 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.986479 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.986571 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.986778 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.986862 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.987089 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.987174 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.987393 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.987493 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.987707 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.987793 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.988007 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.988094 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.988317 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.988412 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.988635 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.988726 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.988945 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.989030 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.989252 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.989337 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.989583 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.989674 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.989890 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.989975 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.990194 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.990279 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.990500 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.990585 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.990802 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.990885 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.991102 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.991186 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.991403 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.991488 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.991712 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.991797 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.992015 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.992132 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.992330 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.992447 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.992632 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.992757 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.992942 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.993059 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.993267 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.993358 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.993623 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.993731 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.993935 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.994020 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.994244 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.994329 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.994552 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.994643 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.994857 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.994948 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.995163 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.995247 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.995470 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.995567 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.995772 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.995857 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.996075 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.996168 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.996371 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.996463 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.996679 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.996763 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.996987 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.997073 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.997285 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.997414 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.997610 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.997700 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.997908 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.998003 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.998215 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.998300 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.999106 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.999259 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.999412 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.999560 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.999799 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:07.999891 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.000004 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.000098 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.000319 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.000448 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.000639 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.000735 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.000964 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.001049 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.001266 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.001359 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.001592 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.001694 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.001907 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.001992 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.002210 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.002303 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.002514 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.002598 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.002817 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.002901 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.003116 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.003209 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.003420 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.003505 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.003743 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.003827 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.004042 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.004136 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.004348 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.004432 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.004655 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.004739 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.004955 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.005051 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.005261 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.005346 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.005589 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.005679 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.005901 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.006170 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.006263 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.006503 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.006589 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.006809 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.006911 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.007119 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.007205 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.007429 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.007522 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.007738 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.007836 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.008047 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.008132 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.008367 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.008453 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.008672 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.008764 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.008977 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.009062 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.009282 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.009366 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.009603 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.009690 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.009910 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.010005 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.010219 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.010315 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.010522 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.010789 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.010875 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.011107 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.011190 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.011412 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.011506 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.011713 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.011799 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.012011 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.012097 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.012319 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.012413 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.012618 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.012713 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.012926 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.013019 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.013226 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.013311 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.013564 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.013670 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.013852 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.013956 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.014204 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.014350 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.014512 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.014662 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.014858 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.014951 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.015105 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.015199 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.015406 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.015501 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.015745 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.015837 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.016054 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.016147 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.016353 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.016438 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.016657 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.016742 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.016969 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.017063 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.017270 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.017364 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.017605 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.017695 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.017910 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.017995 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.018215 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.018307 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.018512 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.018597 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.018808 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.018927 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.019113 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.019200 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.019409 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.019493 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.019706 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.019797 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.020002 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.020088 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.020304 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.020388 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.020609 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.020695 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.020916 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.021003 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.021214 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.021307 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.021519 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.021631 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.021837 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.021930 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.022149 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.022242 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.022454 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.022548 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.022753 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.022880 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.023054 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.023140 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.023347 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.023505 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.023651 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.023780 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.023950 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.024035 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.024251 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.024345 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.024546 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.024631 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.024847 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.024931 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.025145 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.025237 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.025444 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.025552 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.025764 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.025848 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.026071 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.026157 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.026371 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.026456 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.026666 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.026751 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.026975 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.027060 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.027276 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.027360 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.027572 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.027656 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.027875 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.027961 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.028172 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.028255 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.028467 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.028551 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.028768 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.028860 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.029062 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.029145 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.029373 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.029506 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.030292 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.030412 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.030539 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.030703 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.030848 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.030978 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.031096 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.031300 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.031386 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.031612 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.031698 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.031916 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.032002 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.032235 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.032320 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.032544 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.032635 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.032840 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.032925 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.033140 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.033224 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.033725 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.033870 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.034032 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.034120 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.034341 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.034425 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.034644 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.034737 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.034947 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.035032 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.035246 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.035337 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.035554 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.035649 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.035857 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.035943 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.036159 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.036244 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.036459 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.036553 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.036767 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.036853 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.037067 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.037153 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.037369 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.037462 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.037695 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.037782 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.037996 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.038080 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.038295 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.038390 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.038612 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.038697 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.038916 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.039000 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.039215 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.039306 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.039512 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.039641 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.039812 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.039897 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.040120 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.040206 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.040431 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.040516 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.040750 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.040835 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.041071 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.041157 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.041378 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.041462 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.041708 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.041794 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.042017 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.042108 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.042322 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.042406 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.042626 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.042710 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.042924 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.043010 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.043227 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.043319 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.043530 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.043623 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.043835 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.043957 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.044133 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.044218 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.044434 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.044565 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.044739 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.044823 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.045042 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.045127 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.046137 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.046254 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.046361 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.046491 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.046690 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.046777 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.047016 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.047111 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.047323 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.047417 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.047634 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.047719 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.047945 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.048031 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.048250 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.048335 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.048557 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.048641 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.048860 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.048953 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.049166 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.049288 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.049476 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.049626 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.049823 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.049939 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.050137 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.050229 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.050447 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.050533 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.050752 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.050839 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.051059 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.051145 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.051367 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.051452 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.051669 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.051755 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.051990 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.052125 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.052298 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.052439 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.052601 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.052749 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.052909 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.053061 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.053211 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.053368 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.053518 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.053680 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.053841 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.053991 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.054280 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.054375 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.054591 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.054677 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.054891 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.054976 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.055192 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.055284 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.055503 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.055588 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.055805 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.055889 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.056118 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.056204 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.056431 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.056517 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.056735 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.056821 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.057120 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.057205 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.057456 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.057566 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.057797 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.057895 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.058111 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.058222 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.058417 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.058504 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.058720 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.058812 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.059030 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.059117 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.059351 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.059434 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.059653 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.059736 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.059958 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.060044 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.060272 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.060359 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.060590 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.060682 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.060909 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.061003 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.061236 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.061390 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.061580 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.061747 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.061891 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.062029 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.062171 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.062359 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.062654 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.062756 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.062969 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.063055 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.063280 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.063367 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.063602 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.063697 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.063925 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.064020 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.064248 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.064334 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.064553 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.064640 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.064868 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.064953 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.065179 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.065265 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.065501 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.065637 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.065848 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.065943 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.066161 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.066249 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.066476 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.066583 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.066782 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.066870 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.067103 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.067190 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.067425 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.067511 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.067741 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.067834 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.068042 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.068134 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.068348 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.068462 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.068671 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.068784 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.068977 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.069094 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.069301 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.069415 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.069643 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.069771 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.069967 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.070078 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.070288 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.070383 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.070592 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.070715 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.070913 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.070999 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.071222 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.071317 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.071526 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.071612 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.071829 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.071922 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.072132 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.072227 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.072444 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.072530 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.072754 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.072839 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.073058 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.073155 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.073363 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.073450 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.073713 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.073803 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.074019 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.074107 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.074339 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.074425 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.074653 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.074747 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.074971 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.075057 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.075287 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.075378 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.075590 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.075676 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.075898 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.075983 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.076204 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.076289 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.076501 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.076606 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.076947 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.077105 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.077312 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.077416 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.077642 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.077772 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.077956 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.078074 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.078261 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.078394 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.078566 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.078726 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.078873 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.079055 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.079195 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.079366 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.079500 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.079699 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.079821 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.080025 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.080133 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.080348 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.080440 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.080666 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.080760 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.080989 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.081076 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.081292 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.081378 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.081623 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.081722 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.081937 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.082030 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.082241 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.082339 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.082545 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.082632 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.082846 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.082939 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.083153 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.083256 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.083454 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.083541 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.083757 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.083843 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.084060 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.084155 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.084421 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.084556 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.084666 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.084790 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.084970 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.085066 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.085276 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.085363 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.085606 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.085697 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.085912 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.086016 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.086215 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.086309 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.086540 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.086627 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.086846 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.086931 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.087176 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.087381 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.087490 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.087712 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.087810 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.088027 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.088114 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.088342 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.088428 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.088655 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.088752 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.088969 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.089055 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.089284 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.089380 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.089620 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.089721 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.089935 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.090030 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.090246 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.090333 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.090556 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.090643 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.090867 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.090953 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.091178 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.091270 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.091490 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.091577 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.091803 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.091897 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.092119 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.092881 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.093120 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.093229 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.093495 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.093677 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.093835 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.093978 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.094150 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.094237 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.094463 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.094550 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.094780 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.094874 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.095092 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.095177 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.095400 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.095485 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.095713 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.095806 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.096019 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.096104 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.096328 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.096413 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.096648 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.096741 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.096960 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.097046 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.097276 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.097363 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.097613 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.097705 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.097929 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.098015 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.098239 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.098323 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.098552 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.098640 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.098867 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.098954 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.099185 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.099278 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.099496 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.099581 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.099809 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.099895 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.100118 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.100262 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.100450 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.100636 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.100750 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.100951 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.101110 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.101284 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.101372 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.101634 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.101724 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.101963 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.102059 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.102269 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.102354 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.102579 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.102665 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.102891 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.102989 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.103193 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.103281 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.103499 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.103593 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.103831 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.103926 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.104149 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.104235 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.104461 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.104589 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.104768 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.104854 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.105081 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.105173 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.105415 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.105625 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.105762 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.105946 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.106071 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.106280 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.106608 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.106701 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.106934 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.107021 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.107249 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.107334 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.107568 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.107660 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.108502 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.108653 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.108829 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.108982 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.109124 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.109291 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.109432 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.109616 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.109772 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.109926 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.110078 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.110233 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.110400 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.110549 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.110709 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.110860 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.111018 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.111164 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.111338 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.111468 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.111648 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.111779 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.112089 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.112183 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.112393 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.112511 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.112724 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.112812 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.113026 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.113138 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.113353 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.113446 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.113683 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.113778 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.113990 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.114078 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.114294 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.114379 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.114605 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.114739 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.114968 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.115283 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.115594 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.115700 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.115898 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.116024 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.116202 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.116341 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.116512 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.116655 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.116822 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.116974 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.117123 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.117290 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.117430 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.117633 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.117763 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.117941 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.118088 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.118256 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.118392 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.118561 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.118695 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.118874 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.118999 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.119178 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.119309 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.119501 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.119809 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.120115 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.120400 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.120487 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.120719 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.120806 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.121039 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.121133 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.121349 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.121435 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.121684 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.121772 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.121995 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.122092 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.122310 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.122396 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.122618 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.122861 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.122956 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.123199 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.123324 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.123553 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.123678 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.123866 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.124100 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.124236 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.124396 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.124567 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.124706 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.124877 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.125014 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.125195 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.125319 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.125508 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.125668 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.125851 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.125981 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.126166 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.126292 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.126480 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.126602 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.126827 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.126914 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.127145 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.127230 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.127506 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.127682 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.127816 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.128022 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.128190 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.128363 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.128502 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.128708 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.128803 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.129049 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.129136 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.129359 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.129445 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.129694 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.129798 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.130004 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.130090 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.130328 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.130421 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.130641 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.130733 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.130952 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.131038 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.131260 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.131347 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.131564 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.131650 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.131871 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.131955 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.132180 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.132265 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.132485 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.132571 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.132795 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.132888 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.133096 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.133186 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.133402 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.133516 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.133738 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.133852 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.134078 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.134173 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.134399 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.134486 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.134716 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.134803 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.135031 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.135125 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.135348 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.135434 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.135659 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.135745 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.135967 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.136066 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.136276 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.136362 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.136583 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.136668 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.136898 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.136992 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.137225 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.137312 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.137549 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.137639 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.137862 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.137950 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.138162 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.138280 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.138464 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.138592 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.138774 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.138911 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.139189 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.139299 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.139469 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.139589 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.139790 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.139880 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.140102 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.140201 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.140424 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.140519 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.140735 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.140822 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.141057 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.141144 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.141376 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.141472 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.141716 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.141804 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.142025 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.142111 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.142353 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.142454 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.142663 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.142758 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.142973 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.143066 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.143273 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.143360 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.143577 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.143661 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.143884 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.143970 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.144190 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.144287 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.144511 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.144610 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.144826 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.144932 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.145123 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.145213 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.145440 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.145560 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.145779 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.145877 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.146096 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.146184 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.146406 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.146493 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.146711 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.146804 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.147038 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.147123 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.147345 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.147431 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.147651 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.147744 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.147956 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.148042 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.148262 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.148359 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.148570 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.148664 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.148877 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.148963 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.149194 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.149278 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.149572 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.149667 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.149839 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.149932 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.150163 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.150250 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.150480 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.150568 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.150800 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.150885 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.151114 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.151206 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.151426 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.151520 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.151679 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 25 05:22:08.151765 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.152048 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.152364 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.152672 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.152981 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.153296 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.153639 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.153964 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.154286 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.154609 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.155541 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.156017 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.156335 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.156683 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.157014 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:22:08.157260 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 25 05:22:08.175510 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG oslo_db.sqlalchemy.engines [None req-8c5b9e91-0da8-4f8f-8e25-d3fc5004823a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 05:22:08.180334 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG oslo_db.sqlalchemy.engines [None req-05ddca87-b45f-443f-ad49-d3faddd9b6a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93721) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 05:22:08.251542 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.context [None req-8c5b9e91-0da8-4f8f-8e25-d3fc5004823a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c3755851-79f1-4766-b402-273e8a6972d0(cell1) {{(pid=93720) load_cells /opt/stack/nova/nova/context.py:464}} Aug 25 05:22:08.255457 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.context [None req-05ddca87-b45f-443f-ad49-d3faddd9b6a7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c3755851-79f1-4766-b402-273e8a6972d0(cell1) {{(pid=93721) load_cells /opt/stack/nova/nova/context.py:464}} Aug 25 05:22:08.255719 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG oslo_concurrency.lockutils [None req-8c5b9e91-0da8-4f8f-8e25-d3fc5004823a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:22:08.257292 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG oslo_concurrency.lockutils [None req-8c5b9e91-0da8-4f8f-8e25-d3fc5004823a None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:22:08.258122 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG oslo_concurrency.lockutils [None req-8c5b9e91-0da8-4f8f-8e25-d3fc5004823a None None] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:22:08.259614 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG oslo_concurrency.lockutils [None req-05ddca87-b45f-443f-ad49-d3faddd9b6a7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:22:08.260052 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG oslo_concurrency.lockutils [None req-8c5b9e91-0da8-4f8f-8e25-d3fc5004823a None None] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:22:08.261189 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG oslo_concurrency.lockutils [None req-05ddca87-b45f-443f-ad49-d3faddd9b6a7 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:22:08.262015 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG oslo_concurrency.lockutils [None req-05ddca87-b45f-443f-ad49-d3faddd9b6a7 None None] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:22:08.263954 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG oslo_concurrency.lockutils [None req-05ddca87-b45f-443f-ad49-d3faddd9b6a7 None None] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:22:08.272416 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG oslo_db.sqlalchemy.engines [None req-8c5b9e91-0da8-4f8f-8e25-d3fc5004823a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 05:22:08.273226 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG oslo_db.sqlalchemy.engines [None req-8c5b9e91-0da8-4f8f-8e25-d3fc5004823a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 05:22:08.280232 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG oslo_db.sqlalchemy.engines [None req-05ddca87-b45f-443f-ad49-d3faddd9b6a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93721) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 05:22:08.284595 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG oslo_db.sqlalchemy.engines [None req-05ddca87-b45f-443f-ad49-d3faddd9b6a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93721) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 05:22:08.631453 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG oslo_db.sqlalchemy.engines [None req-8c5b9e91-0da8-4f8f-8e25-d3fc5004823a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 05:22:08.635106 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG oslo_db.sqlalchemy.engines [None req-05ddca87-b45f-443f-ad49-d3faddd9b6a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93721) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 05:22:09.055835 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: WARNING keystonemiddleware.auth_token [None req-8c5b9e91-0da8-4f8f-8e25-d3fc5004823a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 05:22:09.062283 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: WARNING keystonemiddleware.auth_token [None req-8c5b9e91-0da8-4f8f-8e25-d3fc5004823a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 05:22:09.087334 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: WARNING keystonemiddleware.auth_token [None req-05ddca87-b45f-443f-ad49-d3faddd9b6a7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 05:22:09.093789 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: WARNING keystonemiddleware.auth_token [None req-05ddca87-b45f-443f-ad49-d3faddd9b6a7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 05:22:09.411369 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: WARNING keystonemiddleware.auth_token [None req-8c5b9e91-0da8-4f8f-8e25-d3fc5004823a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 05:22:09.416450 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: WARNING keystonemiddleware.auth_token [None req-8c5b9e91-0da8-4f8f-8e25-d3fc5004823a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 05:22:09.422368 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55718c8539c0 pid: 93720 (default app) Aug 25 05:22:09.424424 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi [None req-8c5b9e91-0da8-4f8f-8e25-d3fc5004823a None None] Calling method '>' {{(pid=93720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:09.425600 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: INFO nova.api.openstack.requestlog [None req-8c5b9e91-0da8-4f8f-8e25-d3fc5004823a None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001723 Aug 25 05:22:09.426018 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: [pid: 93720|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 789 bytes} [Wed Aug 25 05:22:09 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:22:09.444477 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: WARNING keystonemiddleware.auth_token [None req-05ddca87-b45f-443f-ad49-d3faddd9b6a7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 05:22:09.449627 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: WARNING keystonemiddleware.auth_token [None req-05ddca87-b45f-443f-ad49-d3faddd9b6a7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 05:22:09.455059 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55718c8539c0 pid: 93721 (default app) Aug 25 05:23:32.788313 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi [None req-8c5b9e91-0da8-4f8f-8e25-d3fc5004823a None None] Calling method '>' {{(pid=93720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:32.789117 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: INFO nova.api.openstack.requestlog [None req-8c5b9e91-0da8-4f8f-8e25-d3fc5004823a None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Aug 25 05:23:32.790001 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: [pid: 93720|app: 0|req: 2/2] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 25 05:23:32 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:23:33.215335 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi [None req-9f5e83c6-aeb9-4abb-94cb-e697f49ad635 admin admin] Calling method '>' {{(pid=93721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:33.244664 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: INFO nova.api.openstack.requestlog [None req-9f5e83c6-aeb9-4abb-94cb-e697f49ad635 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.447325 Aug 25 05:23:33.245307 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: [pid: 93721|app: 0|req: 1/3] 10.222.0.42 () {60 vars in 1292 bytes} [Wed Aug 25 05:23:32 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:23:35.471174 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi [None req-8c5b9e91-0da8-4f8f-8e25-d3fc5004823a None None] Calling method '>' {{(pid=93720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:35.473643 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: INFO nova.api.openstack.requestlog [None req-8c5b9e91-0da8-4f8f-8e25-d3fc5004823a None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002767 Aug 25 05:23:35.474094 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: [pid: 93720|app: 0|req: 3/4] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 25 05:23:35 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:23:35.542779 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi [None req-12017371-bcc0-47f4-a491-bc39affb4ee1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "name": "cirros256", "disk": 1, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "ram": 256, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=93721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:23:35.561453 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:23:35.561453 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: warnings.warn(msg) Aug 25 05:23:35.654662 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: INFO nova.api.openstack.requestlog [None req-12017371-bcc0-47f4-a491-bc39affb4ee1 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.173024 Aug 25 05:23:35.663872 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: [pid: 93721|app: 0|req: 2/5] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Aug 25 05:23:35 2021] POST /compute/v2.1/flavors => generated 407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:23:35.882642 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi [None req-857fcc73-5317-4329-96d9-9d2a4321d9c8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:23:35.884971 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:23:35.884971 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: warnings.warn(msg) Aug 25 05:23:36.024619 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: INFO nova.api.openstack.requestlog [None req-857fcc73-5317-4329-96d9-9d2a4321d9c8 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.359233 Aug 25 05:23:36.025474 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: [pid: 93720|app: 0|req: 4/6] 10.222.0.42 () {64 vars in 1336 bytes} [Wed Aug 25 05:23:35 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:23:38.239018 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi [None req-12017371-bcc0-47f4-a491-bc39affb4ee1 admin admin] Calling method '>' {{(pid=93721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:38.240037 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: INFO nova.api.openstack.requestlog [None req-12017371-bcc0-47f4-a491-bc39affb4ee1 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 25 05:23:38.240439 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: [pid: 93721|app: 0|req: 3/7] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 25 05:23:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:23:38.369193 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi [None req-3d24146e-ec78-4e62-b816-2b4c5a0ac3d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "ram": 512, "swap": 0, "vcpus": 1, "name": "ds512M", "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=93720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:23:38.388397 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:23:38.388397 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: warnings.warn(msg) Aug 25 05:23:38.512714 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: INFO nova.api.openstack.requestlog [None req-3d24146e-ec78-4e62-b816-2b4c5a0ac3d0 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.265457 Aug 25 05:23:38.513367 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: [pid: 93720|app: 0|req: 5/8] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Aug 25 05:23:38 2021] POST /compute/v2.1/flavors => generated 404 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:23:38.526845 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi [None req-e524177c-fcdb-42b1-8a3f-6f5750b47b34 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:23:38.528387 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:23:38.528387 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: warnings.warn(msg) Aug 25 05:23:38.653195 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: INFO nova.api.openstack.requestlog [None req-e524177c-fcdb-42b1-8a3f-6f5750b47b34 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.130265 Aug 25 05:23:38.654105 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: [pid: 93721|app: 0|req: 4/9] 10.222.0.42 () {64 vars in 1336 bytes} [Wed Aug 25 05:23:38 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:23:40.865739 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi [None req-3d24146e-ec78-4e62-b816-2b4c5a0ac3d0 admin admin] Calling method '>' {{(pid=93720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:40.867317 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: INFO nova.api.openstack.requestlog [None req-3d24146e-ec78-4e62-b816-2b4c5a0ac3d0 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002096 Aug 25 05:23:40.867720 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: [pid: 93720|app: 0|req: 6/10] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 25 05:23:40 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:23:40.927116 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi [None req-998e213a-6a05-40f4-8080-2ece3df9cfa7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "name": "ds1G", "vcpus": 1, "swap": 0, "id": "d2"}} {{(pid=93721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:23:40.998248 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: INFO nova.api.openstack.requestlog [None req-998e213a-6a05-40f4-8080-2ece3df9cfa7 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.123532 Aug 25 05:23:40.998826 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: [pid: 93721|app: 0|req: 5/11] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Aug 25 05:23:40 2021] POST /compute/v2.1/flavors => generated 404 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:23:41.012058 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi [None req-5695ed29-7b01-4609-b3f1-bd0e31d82764 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:23:41.121651 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: INFO nova.api.openstack.requestlog [None req-5695ed29-7b01-4609-b3f1-bd0e31d82764 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113263 Aug 25 05:23:41.122191 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: [pid: 93720|app: 0|req: 7/12] 10.222.0.42 () {64 vars in 1336 bytes} [Wed Aug 25 05:23:41 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:23:43.367835 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi [None req-998e213a-6a05-40f4-8080-2ece3df9cfa7 admin admin] Calling method '>' {{(pid=93721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:43.368776 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: INFO nova.api.openstack.requestlog [None req-998e213a-6a05-40f4-8080-2ece3df9cfa7 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 25 05:23:43.369175 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: [pid: 93721|app: 0|req: 6/13] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 25 05:23:43 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:23:43.426750 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi [None req-7f658f72-9d69-4790-9c0c-b88c0ea1b84d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "rxtx_factor": 1.0, "vcpus": 2, "id": "d3", "ram": 2048, "os-flavor-access:is_public": true}} {{(pid=93720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:23:43.509179 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: INFO nova.api.openstack.requestlog [None req-7f658f72-9d69-4790-9c0c-b88c0ea1b84d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.133607 Aug 25 05:23:43.509763 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: [pid: 93720|app: 0|req: 8/14] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Aug 25 05:23:43 2021] POST /compute/v2.1/flavors => generated 404 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:23:43.528209 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi [None req-98cc9093-08fa-442c-bbed-f9eae83d0863 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:23:43.618634 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: INFO nova.api.openstack.requestlog [None req-98cc9093-08fa-442c-bbed-f9eae83d0863 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098037 Aug 25 05:23:43.619143 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: [pid: 93721|app: 0|req: 7/15] 10.222.0.42 () {64 vars in 1336 bytes} [Wed Aug 25 05:23:43 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:23:45.874095 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi [None req-7f658f72-9d69-4790-9c0c-b88c0ea1b84d admin admin] Calling method '>' {{(pid=93720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:45.875096 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: INFO nova.api.openstack.requestlog [None req-7f658f72-9d69-4790-9c0c-b88c0ea1b84d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Aug 25 05:23:45.875658 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: [pid: 93720|app: 0|req: 9/16] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 25 05:23:45 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:23:45.937982 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi [None req-e65cdabb-7e3b-4c3a-99d0-ba0bc972f120 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds4G", "os-flavor-access:is_public": true, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "rxtx_factor": 1.0, "disk": 20, "vcpus": 4}} {{(pid=93721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:23:46.015615 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: INFO nova.api.openstack.requestlog [None req-e65cdabb-7e3b-4c3a-99d0-ba0bc972f120 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.132671 Aug 25 05:23:46.017057 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: [pid: 93721|app: 0|req: 8/17] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Aug 25 05:23:45 2021] POST /compute/v2.1/flavors => generated 404 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:23:46.029478 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi [None req-8c6adbe7-35ea-4744-a520-2bbac8b446f6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:23:46.110901 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: INFO nova.api.openstack.requestlog [None req-8c6adbe7-35ea-4744-a520-2bbac8b446f6 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085153 Aug 25 05:23:46.111688 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: [pid: 93720|app: 0|req: 10/18] 10.222.0.42 () {64 vars in 1336 bytes} [Wed Aug 25 05:23:46 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:23:48.315074 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi [None req-e65cdabb-7e3b-4c3a-99d0-ba0bc972f120 admin admin] Calling method '>' {{(pid=93721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:48.316429 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: INFO nova.api.openstack.requestlog [None req-e65cdabb-7e3b-4c3a-99d0-ba0bc972f120 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001854 Aug 25 05:23:48.316429 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: [pid: 93721|app: 0|req: 9/19] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 25 05:23:48 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:23:48.386296 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi [None req-62a5e262-39ca-4114-b818-77efa76ea7bd admin admin] Calling method '>' {{(pid=93720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:48.411336 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: INFO nova.api.openstack.requestlog [None req-62a5e262-39ca-4114-b818-77efa76ea7bd admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.088689 Aug 25 05:23:48.411865 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: [pid: 93720|app: 0|req: 11/20] 10.222.0.42 () {60 vars in 1292 bytes} [Wed Aug 25 05:23:48 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:23:50.676101 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi [None req-e65cdabb-7e3b-4c3a-99d0-ba0bc972f120 admin admin] Calling method '>' {{(pid=93721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:50.677540 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: INFO nova.api.openstack.requestlog [None req-e65cdabb-7e3b-4c3a-99d0-ba0bc972f120 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001903 Aug 25 05:23:50.678101 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: [pid: 93721|app: 0|req: 10/21] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 25 05:23:50 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:23:50.751159 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi [None req-6ca5721a-f019-485c-8f72-85e61933b92b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "1", "vcpus": 1, "ram": 512, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "rxtx_factor": 1.0, "name": "m1.tiny"}} {{(pid=93720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:23:50.868908 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: INFO nova.api.openstack.requestlog [None req-6ca5721a-f019-485c-8f72-85e61933b92b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.184200 Aug 25 05:23:50.869372 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: [pid: 93720|app: 0|req: 12/22] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Aug 25 05:23:50 2021] POST /compute/v2.1/flavors => generated 402 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:23:50.884293 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi [None req-3973605b-02dd-47eb-9ec6-8c81b23e81dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:23:50.950505 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: INFO nova.api.openstack.requestlog [None req-3973605b-02dd-47eb-9ec6-8c81b23e81dc admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.071521 Aug 25 05:23:50.951108 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: [pid: 93721|app: 0|req: 11/23] 10.222.0.42 () {64 vars in 1333 bytes} [Wed Aug 25 05:23:50 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:23:53.161844 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi [None req-6ca5721a-f019-485c-8f72-85e61933b92b admin admin] Calling method '>' {{(pid=93720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:53.163166 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: INFO nova.api.openstack.requestlog [None req-6ca5721a-f019-485c-8f72-85e61933b92b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001992 Aug 25 05:23:53.163721 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: [pid: 93720|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 25 05:23:53 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:23:53.224337 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi [None req-e03ff7cc-ff9a-4bfd-9713-905773fb653d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "id": "2", "os-flavor-access:is_public": true, "swap": 0, "ram": 2048, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=93721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:23:53.292767 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: INFO nova.api.openstack.requestlog [None req-e03ff7cc-ff9a-4bfd-9713-905773fb653d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.122403 Aug 25 05:23:53.293330 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: [pid: 93721|app: 0|req: 12/25] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Aug 25 05:23:53 2021] POST /compute/v2.1/flavors => generated 405 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:23:53.307375 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi [None req-b978d70b-e624-4f96-90dd-75977ddd7c08 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:23:53.397185 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: INFO nova.api.openstack.requestlog [None req-b978d70b-e624-4f96-90dd-75977ddd7c08 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094335 Aug 25 05:23:53.397710 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: [pid: 93720|app: 0|req: 14/26] 10.222.0.42 () {64 vars in 1333 bytes} [Wed Aug 25 05:23:53 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:23:55.612946 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi [None req-e03ff7cc-ff9a-4bfd-9713-905773fb653d admin admin] Calling method '>' {{(pid=93721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:55.614012 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: INFO nova.api.openstack.requestlog [None req-e03ff7cc-ff9a-4bfd-9713-905773fb653d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Aug 25 05:23:55.614413 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: [pid: 93721|app: 0|req: 13/27] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 25 05:23:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:23:55.673160 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi [None req-f591c9e0-72c7-43f5-83c4-31e83b61b719 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "rxtx_factor": 1.0, "name": "m1.medium", "ram": 4096, "swap": 0, "id": "3", "os-flavor-access:is_public": true, "vcpus": 2}} {{(pid=93720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:23:55.767698 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: INFO nova.api.openstack.requestlog [None req-f591c9e0-72c7-43f5-83c4-31e83b61b719 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.146684 Aug 25 05:23:55.768288 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: [pid: 93720|app: 0|req: 15/28] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Aug 25 05:23:55 2021] POST /compute/v2.1/flavors => generated 406 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:23:55.780958 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi [None req-05623b8e-2d16-47b4-a9d8-8fc513e1c565 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:23:55.856372 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: INFO nova.api.openstack.requestlog [None req-05623b8e-2d16-47b4-a9d8-8fc513e1c565 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079027 Aug 25 05:23:55.856900 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: [pid: 93721|app: 0|req: 14/29] 10.222.0.42 () {64 vars in 1333 bytes} [Wed Aug 25 05:23:55 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:23:58.082392 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi [None req-f591c9e0-72c7-43f5-83c4-31e83b61b719 admin admin] Calling method '>' {{(pid=93720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:58.083397 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: INFO nova.api.openstack.requestlog [None req-f591c9e0-72c7-43f5-83c4-31e83b61b719 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 25 05:23:58.083802 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: [pid: 93720|app: 0|req: 16/30] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 25 05:23:58 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:23:58.144245 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi [None req-20f665de-cbe2-452c-9a74-bc770fc76939 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "swap": 0, "ram": 8192, "disk": 80, "vcpus": 4, "os-flavor-access:is_public": true, "id": "4", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=93721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:23:58.254921 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: INFO nova.api.openstack.requestlog [None req-20f665de-cbe2-452c-9a74-bc770fc76939 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.164690 Aug 25 05:23:58.255732 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: [pid: 93721|app: 0|req: 15/31] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Aug 25 05:23:58 2021] POST /compute/v2.1/flavors => generated 405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:23:58.268198 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi [None req-ccd16526-42a3-432e-91ec-4f9340eda257 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:23:58.362468 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: INFO nova.api.openstack.requestlog [None req-ccd16526-42a3-432e-91ec-4f9340eda257 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097870 Aug 25 05:23:58.363650 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: [pid: 93720|app: 0|req: 17/32] 10.222.0.42 () {64 vars in 1333 bytes} [Wed Aug 25 05:23:58 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:24:00.638136 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi [None req-20f665de-cbe2-452c-9a74-bc770fc76939 admin admin] Calling method '>' {{(pid=93721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:24:00.639171 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: INFO nova.api.openstack.requestlog [None req-20f665de-cbe2-452c-9a74-bc770fc76939 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001593 Aug 25 05:24:00.639573 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: [pid: 93721|app: 0|req: 16/33] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 25 05:24:00 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:24:00.707667 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi [None req-1af1a394-ee1f-463a-bb99-e24216ce3a1d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.xlarge", "vcpus": 8, "id": "5", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "disk": 160, "swap": 0}} {{(pid=93720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:24:00.790748 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: INFO nova.api.openstack.requestlog [None req-1af1a394-ee1f-463a-bb99-e24216ce3a1d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.143427 Aug 25 05:24:00.791361 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: [pid: 93720|app: 0|req: 18/34] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Aug 25 05:24:00 2021] POST /compute/v2.1/flavors => generated 408 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:24:00.804377 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi [None req-70b04286-15f0-4bb8-bd11-e560a8eea7a8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:24:00.979282 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: INFO nova.api.openstack.requestlog [None req-70b04286-15f0-4bb8-bd11-e560a8eea7a8 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.178539 Aug 25 05:24:00.979862 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: [pid: 93721|app: 0|req: 17/35] 10.222.0.42 () {64 vars in 1333 bytes} [Wed Aug 25 05:24:00 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:24:41.117215 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi [None req-1af1a394-ee1f-463a-bb99-e24216ce3a1d admin admin] Calling method '>' {{(pid=93720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:24:41.118268 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: INFO nova.api.openstack.requestlog [None req-1af1a394-ee1f-463a-bb99-e24216ce3a1d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 25 05:24:41.118659 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: [pid: 93720|app: 0|req: 19/36] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 25 05:24:41 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:24:41.176233 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi [None req-b1b3bced-28f2-482d-81a6-43a2483da875 admin admin] Calling method '>' {{(pid=93721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:24:41.194140 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: INFO nova.api.openstack.requestlog [None req-b1b3bced-28f2-482d-81a6-43a2483da875 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068623 Aug 25 05:24:41.194624 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: [pid: 93721|app: 0|req: 18/37] 10.222.0.42 () {60 vars in 1292 bytes} [Wed Aug 25 05:24:41 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:24:42.603056 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi [None req-1af1a394-ee1f-463a-bb99-e24216ce3a1d admin admin] Calling method '>' {{(pid=93720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:24:42.604059 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: INFO nova.api.openstack.requestlog [None req-1af1a394-ee1f-463a-bb99-e24216ce3a1d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Aug 25 05:24:42.604456 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: [pid: 93720|app: 0|req: 20/38] 10.222.0.42 () {56 vars in 1075 bytes} [Wed Aug 25 05:24:42 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:24:42.796039 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi [None req-93262d9f-7559-404f-810a-fc4839f13521 admin admin] Calling method '>' {{(pid=93721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:24:42.801622 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: INFO nova.api.openstack.wsgi [None req-93262d9f-7559-404f-810a-fc4839f13521 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 25 05:24:42.802218 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi [None req-93262d9f-7559-404f-810a-fc4839f13521 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=93721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 05:24:42.803838 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: INFO nova.api.openstack.requestlog [None req-93262d9f-7559-404f-810a-fc4839f13521 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.058985 Aug 25 05:24:42.804344 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: [pid: 93721|app: 0|req: 19/39] 10.222.0.42 () {60 vars in 1191 bytes} [Wed Aug 25 05:24:42 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 25 05:24:42.814159 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi [None req-3ea3f41a-16bd-4341-b4cf-0b7125ee0e39 admin admin] Calling method '>' {{(pid=93720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:24:42.835025 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: INFO nova.api.openstack.requestlog [None req-3ea3f41a-16bd-4341-b4cf-0b7125ee0e39 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024321 Aug 25 05:24:42.836191 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: [pid: 93720|app: 0|req: 21/40] 10.222.0.42 () {60 vars in 1211 bytes} [Wed Aug 25 05:24:42 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:24:42.848115 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi [None req-45c2b615-0ff9-4876-8046-767b11160fc3 admin admin] Calling method '>' {{(pid=93721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:24:42.871588 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: INFO nova.api.openstack.requestlog [None req-45c2b615-0ff9-4876-8046-767b11160fc3 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.026935 Aug 25 05:24:42.872147 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: [pid: 93721|app: 0|req: 20/41] 10.222.0.42 () {60 vars in 1211 bytes} [Wed Aug 25 05:24:42 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:24:42.882758 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi [None req-351509ab-3560-42f8-9242-11ffde0e23b9 admin admin] Calling method '>' {{(pid=93720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:24:42.888079 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: INFO nova.api.openstack.wsgi [None req-351509ab-3560-42f8-9242-11ffde0e23b9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 25 05:24:42.888635 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi [None req-351509ab-3560-42f8-9242-11ffde0e23b9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=93720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 05:24:42.889409 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: INFO nova.api.openstack.requestlog [None req-351509ab-3560-42f8-9242-11ffde0e23b9 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.010859 Aug 25 05:24:42.889920 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: [pid: 93720|app: 0|req: 22/42] 10.222.0.42 () {60 vars in 1191 bytes} [Wed Aug 25 05:24:42 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 25 05:24:44.262033 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi [None req-45c2b615-0ff9-4876-8046-767b11160fc3 admin admin] Calling method '>' {{(pid=93721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:24:44.263036 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: INFO nova.api.openstack.requestlog [None req-45c2b615-0ff9-4876-8046-767b11160fc3 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 25 05:24:44.263433 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: [pid: 93721|app: 0|req: 21/43] 10.222.0.42 () {56 vars in 1075 bytes} [Wed Aug 25 05:24:44 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:24:44.465817 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi [None req-502cd52c-182e-4ffe-8568-6c727fd9c7a9 admin admin] Calling method '>' {{(pid=93720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:24:44.470754 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: INFO nova.api.openstack.wsgi [None req-502cd52c-182e-4ffe-8568-6c727fd9c7a9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 25 05:24:44.471262 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi [None req-502cd52c-182e-4ffe-8568-6c727fd9c7a9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=93720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 05:24:44.472044 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: INFO nova.api.openstack.requestlog [None req-502cd52c-182e-4ffe-8568-6c727fd9c7a9 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.060983 Aug 25 05:24:44.472552 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: [pid: 93720|app: 0|req: 23/44] 10.222.0.42 () {60 vars in 1191 bytes} [Wed Aug 25 05:24:44 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 25 05:24:44.483153 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi [None req-61fc1e4c-5263-4ef4-abf4-11200f93ae7f admin admin] Calling method '>' {{(pid=93721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:24:44.496620 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: INFO nova.api.openstack.requestlog [None req-61fc1e4c-5263-4ef4-abf4-11200f93ae7f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017107 Aug 25 05:24:44.497158 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: [pid: 93721|app: 0|req: 22/45] 10.222.0.42 () {60 vars in 1211 bytes} [Wed Aug 25 05:24:44 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:24:44.507401 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi [None req-44878f7f-9c3a-49c7-9ad4-7a0dd2f20944 admin admin] Calling method '>' {{(pid=93720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:24:44.520829 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: INFO nova.api.openstack.requestlog [None req-44878f7f-9c3a-49c7-9ad4-7a0dd2f20944 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017151 Aug 25 05:24:44.521364 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: [pid: 93720|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1211 bytes} [Wed Aug 25 05:24:44 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:24:44.531679 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi [None req-ea565c4d-356b-4807-8a08-7df8189b4a5e admin admin] Calling method '>' {{(pid=93721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:24:44.537907 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: INFO nova.api.openstack.wsgi [None req-ea565c4d-356b-4807-8a08-7df8189b4a5e admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 25 05:24:44.538521 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi [None req-ea565c4d-356b-4807-8a08-7df8189b4a5e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=93721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 05:24:44.539313 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: INFO nova.api.openstack.requestlog [None req-ea565c4d-356b-4807-8a08-7df8189b4a5e admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.011221 Aug 25 05:24:44.539824 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: [pid: 93721|app: 0|req: 23/47] 10.222.0.42 () {60 vars in 1191 bytes} [Wed Aug 25 05:24:44 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 25 05:24:45.944022 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi [None req-44878f7f-9c3a-49c7-9ad4-7a0dd2f20944 admin admin] Calling method '>' {{(pid=93720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:24:45.945020 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: INFO nova.api.openstack.requestlog [None req-44878f7f-9c3a-49c7-9ad4-7a0dd2f20944 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002079 Aug 25 05:24:45.945410 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: [pid: 93720|app: 0|req: 25/48] 10.222.0.42 () {56 vars in 1075 bytes} [Wed Aug 25 05:24:45 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:24:46.149736 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi [None req-c0995af9-84a6-4fd7-9093-2ab0d8f677f7 admin admin] Calling method '>' {{(pid=93721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:24:46.155239 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: INFO nova.api.openstack.wsgi [None req-c0995af9-84a6-4fd7-9093-2ab0d8f677f7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 25 05:24:46.155739 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi [None req-c0995af9-84a6-4fd7-9093-2ab0d8f677f7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=93721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 05:24:46.156515 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: INFO nova.api.openstack.requestlog [None req-c0995af9-84a6-4fd7-9093-2ab0d8f677f7 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.058089 Aug 25 05:24:46.157003 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: [pid: 93721|app: 0|req: 24/49] 10.222.0.42 () {60 vars in 1194 bytes} [Wed Aug 25 05:24:46 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 25 05:24:46.167698 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi [None req-5ef27e42-9c93-4f94-8563-8ec3d5f567ed admin admin] Calling method '>' {{(pid=93720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:24:46.181838 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: INFO nova.api.openstack.requestlog [None req-5ef27e42-9c93-4f94-8563-8ec3d5f567ed admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017545 Aug 25 05:24:46.182354 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: [pid: 93720|app: 0|req: 26/50] 10.222.0.42 () {60 vars in 1211 bytes} [Wed Aug 25 05:24:46 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:24:46.191992 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi [None req-a18f6211-a10a-4c2a-a073-0f16316ce112 admin admin] Calling method '>' {{(pid=93721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:24:46.205071 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: INFO nova.api.openstack.requestlog [None req-a18f6211-a10a-4c2a-a073-0f16316ce112 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.016533 Aug 25 05:24:46.205622 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: [pid: 93721|app: 0|req: 25/51] 10.222.0.42 () {60 vars in 1211 bytes} [Wed Aug 25 05:24:46 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:24:46.215134 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi [None req-8b1b6709-e72e-4c8b-976c-d542ade174b2 admin admin] Calling method '>' {{(pid=93720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:24:46.220077 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: INFO nova.api.openstack.wsgi [None req-8b1b6709-e72e-4c8b-976c-d542ade174b2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 25 05:24:46.220670 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi [None req-8b1b6709-e72e-4c8b-976c-d542ade174b2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=93720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 05:24:46.221388 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: INFO nova.api.openstack.requestlog [None req-8b1b6709-e72e-4c8b-976c-d542ade174b2 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.009713 Aug 25 05:24:46.221906 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: [pid: 93720|app: 0|req: 27/52] 10.222.0.42 () {60 vars in 1194 bytes} [Wed Aug 25 05:24:46 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 25 05:24:47.589703 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi [None req-a18f6211-a10a-4c2a-a073-0f16316ce112 admin admin] Calling method '>' {{(pid=93721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:24:47.590716 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: INFO nova.api.openstack.requestlog [None req-a18f6211-a10a-4c2a-a073-0f16316ce112 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 25 05:24:47.591116 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: [pid: 93721|app: 0|req: 26/53] 10.222.0.42 () {56 vars in 1075 bytes} [Wed Aug 25 05:24:47 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:24:47.786195 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi [None req-5b764b82-1642-4932-8c83-5ac313cdbaa4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:24:47.877709 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: INFO nova.api.openstack.requestlog [None req-5b764b82-1642-4932-8c83-5ac313cdbaa4 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.142725 Aug 25 05:24:47.878245 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: [pid: 93720|app: 0|req: 28/54] 10.222.0.42 () {64 vars in 1236 bytes} [Wed Aug 25 05:24:47 2021] POST /compute/v2.1/flavors => generated 404 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:24:49.250076 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi [None req-a18f6211-a10a-4c2a-a073-0f16316ce112 admin admin] Calling method '>' {{(pid=93721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:24:49.251088 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: INFO nova.api.openstack.requestlog [None req-a18f6211-a10a-4c2a-a073-0f16316ce112 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 25 05:24:49.251486 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: [pid: 93721|app: 0|req: 27/55] 10.222.0.42 () {56 vars in 1075 bytes} [Wed Aug 25 05:24:49 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:24:49.441240 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi [None req-6a089083-4330-4741-bd80-0f4593f81a26 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:24:49.527175 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: INFO nova.api.openstack.requestlog [None req-6a089083-4330-4741-bd80-0f4593f81a26 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.136941 Aug 25 05:24:49.527652 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: [pid: 93720|app: 0|req: 29/56] 10.222.0.42 () {64 vars in 1236 bytes} [Wed Aug 25 05:24:49 2021] POST /compute/v2.1/flavors => generated 405 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:24:50.876304 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi [None req-a18f6211-a10a-4c2a-a073-0f16316ce112 admin admin] Calling method '>' {{(pid=93721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:24:50.877308 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: INFO nova.api.openstack.requestlog [None req-a18f6211-a10a-4c2a-a073-0f16316ce112 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Aug 25 05:24:50.877727 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: [pid: 93721|app: 0|req: 28/57] 10.222.0.42 () {56 vars in 1075 bytes} [Wed Aug 25 05:24:50 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:24:51.089826 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi [None req-a92abd52-f65b-4e1d-ba80-7abeea86e332 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:24:51.197730 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: INFO nova.api.openstack.requestlog [None req-a92abd52-f65b-4e1d-ba80-7abeea86e332 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.174686 Aug 25 05:24:51.198267 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: [pid: 93720|app: 0|req: 30/58] 10.222.0.42 () {64 vars in 1236 bytes} [Wed Aug 25 05:24:51 2021] POST /compute/v2.1/flavors => generated 407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:24:52.552068 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi [None req-a18f6211-a10a-4c2a-a073-0f16316ce112 admin admin] Calling method '>' {{(pid=93721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:24:52.553092 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: INFO nova.api.openstack.requestlog [None req-a18f6211-a10a-4c2a-a073-0f16316ce112 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Aug 25 05:24:52.553479 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: [pid: 93721|app: 0|req: 29/59] 10.222.0.42 () {56 vars in 1075 bytes} [Wed Aug 25 05:24:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:24:52.742530 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi [None req-cf6c1846-8b99-493a-9f48-32745bf1cae4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:24:52.808626 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: INFO nova.api.openstack.requestlog [None req-cf6c1846-8b99-493a-9f48-32745bf1cae4 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.117050 Aug 25 05:24:52.809159 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: [pid: 93720|app: 0|req: 31/60] 10.222.0.42 () {64 vars in 1236 bytes} [Wed Aug 25 05:24:52 2021] POST /compute/v2.1/flavors => generated 409 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:24:54.143026 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi [None req-a18f6211-a10a-4c2a-a073-0f16316ce112 admin admin] Calling method '>' {{(pid=93721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:24:54.144020 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: INFO nova.api.openstack.requestlog [None req-a18f6211-a10a-4c2a-a073-0f16316ce112 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Aug 25 05:24:54.144440 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: [pid: 93721|app: 0|req: 30/61] 10.222.0.42 () {56 vars in 1075 bytes} [Wed Aug 25 05:24:54 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:24:54.337805 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi [None req-17efa2e3-c4df-455f-87f5-4ef64adfa663 admin admin] Calling method '>' {{(pid=93720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:24:54.356839 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: INFO nova.api.openstack.requestlog [None req-17efa2e3-c4df-455f-87f5-4ef64adfa663 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.070062 Aug 25 05:24:54.357306 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: [pid: 93720|app: 0|req: 32/62] 10.222.0.42 () {60 vars in 1203 bytes} [Wed Aug 25 05:24:54 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:25:39.814571 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi [None req-a18f6211-a10a-4c2a-a073-0f16316ce112 admin admin] Calling method '>' {{(pid=93721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:25:39.815903 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: INFO nova.api.openstack.requestlog [None req-a18f6211-a10a-4c2a-a073-0f16316ce112 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 25 05:25:39.816166 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: [pid: 93721|app: 0|req: 31/63] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 25 05:25:39 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:25:39.873885 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi [None req-5bf0efd4-29ae-4655-b51e-9c23a481b6a2 admin admin] Calling method '>' {{(pid=93720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:25:39.892772 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: INFO nova.api.openstack.requestlog [None req-5bf0efd4-29ae-4655-b51e-9c23a481b6a2 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069645 Aug 25 05:25:39.893302 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: [pid: 93720|app: 0|req: 33/64] 10.222.0.42 () {60 vars in 1292 bytes} [Wed Aug 25 05:25:39 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:25:39.916918 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi [None req-dc0e4d84-335a-44ed-9465-12690691f282 admin admin] Calling method '>' {{(pid=93721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:25:39.924530 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: INFO nova.api.openstack.requestlog [None req-dc0e4d84-335a-44ed-9465-12690691f282 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011550 Aug 25 05:25:39.925078 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: [pid: 93721|app: 0|req: 32/65] 10.222.0.42 () {60 vars in 1283 bytes} [Wed Aug 25 05:25:39 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:25:39.936403 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi [None req-bcc1f5ad-1563-437b-ad96-6a75f58a8869 admin admin] Calling method '>' {{(pid=93720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:25:39.943720 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: INFO nova.api.openstack.requestlog [None req-bcc1f5ad-1563-437b-ad96-6a75f58a8869 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010738 Aug 25 05:25:39.944220 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: [pid: 93720|app: 0|req: 34/66] 10.222.0.42 () {60 vars in 1286 bytes} [Wed Aug 25 05:25:39 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:25:39.956205 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi [None req-f44b9eef-2047-44a0-970a-48917358e2f4 admin admin] Calling method '>' {{(pid=93721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:25:39.964057 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: INFO nova.api.openstack.requestlog [None req-f44b9eef-2047-44a0-970a-48917358e2f4 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011248 Aug 25 05:25:39.964557 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: [pid: 93721|app: 0|req: 33/67] 10.222.0.42 () {60 vars in 1286 bytes} [Wed Aug 25 05:25:39 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:25:39.975628 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi [None req-1853b5c7-2dd4-47d9-84b6-9c5d28394490 admin admin] Calling method '>' {{(pid=93720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:25:39.983044 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: INFO nova.api.openstack.requestlog [None req-1853b5c7-2dd4-47d9-84b6-9c5d28394490 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010763 Aug 25 05:25:39.983546 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: [pid: 93720|app: 0|req: 35/68] 10.222.0.42 () {60 vars in 1283 bytes} [Wed Aug 25 05:25:39 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:27:10.237662 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi [None req-613769b8-dcc2-4821-8390-8f1996b71dda tempest-verify_tempest_config-482399518 tempest-verify_tempest_config-482399518-project] Calling method '>' {{(pid=93721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:27:10.239596 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: INFO nova.api.openstack.requestlog [None req-613769b8-dcc2-4821-8390-8f1996b71dda tempest-verify_tempest_config-482399518 tempest-verify_tempest_config-482399518-project] 10.222.0.42 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.106507 Aug 25 05:27:10.240121 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: [pid: 93721|app: 0|req: 34/69] 10.222.0.42 () {58 vars in 1134 bytes} [Wed Aug 25 05:27:10 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:28:42.983099 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi [None req-1853b5c7-2dd4-47d9-84b6-9c5d28394490 admin admin] Calling method '>' {{(pid=93720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:28:42.984099 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: INFO nova.api.openstack.requestlog [None req-1853b5c7-2dd4-47d9-84b6-9c5d28394490 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Aug 25 05:28:42.984494 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: [pid: 93720|app: 0|req: 36/70] 10.222.0.42 () {56 vars in 1075 bytes} [Wed Aug 25 05:28:42 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:28:43.245256 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi [None req-aaf32272-ebe8-4318-99fe-6d892b408f30 admin admin] Calling method '>' {{(pid=93721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:28:43.246461 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:28:43.246461 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: warnings.warn(msg) Aug 25 05:28:43.247968 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG oslo_concurrency.lockutils [None req-aaf32272-ebe8-4318-99fe-6d892b408f30 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:28:43.248410 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG oslo_concurrency.lockutils [None req-aaf32272-ebe8-4318-99fe-6d892b408f30 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:28:43.249199 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG oslo_concurrency.lockutils [None req-aaf32272-ebe8-4318-99fe-6d892b408f30 admin admin] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:28:43.249658 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG oslo_concurrency.lockutils [None req-aaf32272-ebe8-4318-99fe-6d892b408f30 admin admin] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:28:43.282908 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: INFO nova.api.openstack.requestlog [None req-aaf32272-ebe8-4318-99fe-6d892b408f30 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.88 time: 0.152115 Aug 25 05:28:43.284013 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: [pid: 93721|app: 0|req: 35/71] 10.222.0.42 () {60 vars in 1194 bytes} [Wed Aug 25 05:28:43 2021] GET /compute/v2.1/os-services => generated 794 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:28:44.644084 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi [None req-1853b5c7-2dd4-47d9-84b6-9c5d28394490 admin admin] Calling method '>' {{(pid=93720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:28:44.645145 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: INFO nova.api.openstack.requestlog [None req-1853b5c7-2dd4-47d9-84b6-9c5d28394490 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002147 Aug 25 05:28:44.645569 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: [pid: 93720|app: 0|req: 37/72] 10.222.0.42 () {56 vars in 1075 bytes} [Wed Aug 25 05:28:44 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:28:44.836599 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi [None req-dc4e7a86-942e-48ba-98b0-449012a830eb admin admin] Calling method '>' {{(pid=93721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:28:44.837799 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:28:44.837799 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: warnings.warn(msg) Aug 25 05:28:44.839280 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG oslo_concurrency.lockutils [None req-dc4e7a86-942e-48ba-98b0-449012a830eb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:28:44.839711 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG oslo_concurrency.lockutils [None req-dc4e7a86-942e-48ba-98b0-449012a830eb admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:28:44.840480 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG oslo_concurrency.lockutils [None req-dc4e7a86-942e-48ba-98b0-449012a830eb admin admin] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:28:44.840898 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG oslo_concurrency.lockutils [None req-dc4e7a86-942e-48ba-98b0-449012a830eb admin admin] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:28:44.859176 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: INFO nova.api.openstack.requestlog [None req-dc4e7a86-942e-48ba-98b0-449012a830eb admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.88 time: 0.073713 Aug 25 05:28:44.859706 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: [pid: 93721|app: 0|req: 36/73] 10.222.0.42 () {60 vars in 1194 bytes} [Wed Aug 25 05:28:44 2021] GET /compute/v2.1/os-services => generated 794 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:28:56.664937 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi [None req-1853b5c7-2dd4-47d9-84b6-9c5d28394490 admin admin] Calling method '>' {{(pid=93720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:28:56.665954 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: INFO nova.api.openstack.requestlog [None req-1853b5c7-2dd4-47d9-84b6-9c5d28394490 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Aug 25 05:28:56.666345 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: [pid: 93720|app: 0|req: 38/74] 10.222.0.42 () {56 vars in 1075 bytes} [Wed Aug 25 05:28:56 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:28:56.858525 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi [None req-3e9d9405-0077-4eb0-92c1-d9af62901536 admin admin] Calling method '>' {{(pid=93721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:28:56.859667 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:28:56.859667 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: warnings.warn(msg) Aug 25 05:28:56.861139 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG oslo_concurrency.lockutils [None req-3e9d9405-0077-4eb0-92c1-d9af62901536 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:28:56.861594 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG oslo_concurrency.lockutils [None req-3e9d9405-0077-4eb0-92c1-d9af62901536 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:28:56.862359 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG oslo_concurrency.lockutils [None req-3e9d9405-0077-4eb0-92c1-d9af62901536 admin admin] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:28:56.862779 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG oslo_concurrency.lockutils [None req-3e9d9405-0077-4eb0-92c1-d9af62901536 admin admin] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:28:56.887287 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: INFO nova.api.openstack.requestlog [None req-3e9d9405-0077-4eb0-92c1-d9af62901536 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.88 time: 0.080055 Aug 25 05:28:56.887827 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: [pid: 93721|app: 0|req: 37/75] 10.222.0.42 () {60 vars in 1194 bytes} [Wed Aug 25 05:28:56 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:28:58.272856 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: DEBUG nova.api.openstack.wsgi [None req-1853b5c7-2dd4-47d9-84b6-9c5d28394490 admin admin] Calling method '>' {{(pid=93720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:28:58.273891 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: INFO nova.api.openstack.requestlog [None req-1853b5c7-2dd4-47d9-84b6-9c5d28394490 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Aug 25 05:28:58.274317 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: [pid: 93720|app: 0|req: 39/76] 10.222.0.42 () {56 vars in 1075 bytes} [Wed Aug 25 05:28:58 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:28:58.470624 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG nova.api.openstack.wsgi [None req-fb816431-035c-43f3-9234-103ad823779a admin admin] Calling method '>' {{(pid=93721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:28:58.471765 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:28:58.471765 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: warnings.warn(msg) Aug 25 05:28:58.473277 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG oslo_concurrency.lockutils [None req-fb816431-035c-43f3-9234-103ad823779a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:28:58.473750 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG oslo_concurrency.lockutils [None req-fb816431-035c-43f3-9234-103ad823779a admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:28:58.475040 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG oslo_concurrency.lockutils [None req-fb816431-035c-43f3-9234-103ad823779a admin admin] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:28:58.475463 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: DEBUG oslo_concurrency.lockutils [None req-fb816431-035c-43f3-9234-103ad823779a admin admin] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:28:58.496617 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: INFO nova.api.openstack.requestlog [None req-fb816431-035c-43f3-9234-103ad823779a admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.88 time: 0.078580 Aug 25 05:28:58.497094 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: [pid: 93721|app: 0|req: 38/77] 10.222.0.42 () {60 vars in 1194 bytes} [Wed Aug 25 05:28:58 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:29:55.879793 dv-cinder-786627-19-iscsi devstack@n-api.service[93719]: Wed Aug 25 05:29:55 2021 - graceful shutdown triggered... Aug 25 05:29:55.880315 dv-cinder-786627-19-iscsi devstack@n-api.service[93720]: Gracefully killing worker 1 (pid: 93720)... Aug 25 05:29:55.879925 dv-cinder-786627-19-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 25 05:29:55.881149 dv-cinder-786627-19-iscsi devstack@n-api.service[93721]: Gracefully killing worker 2 (pid: 93721)... Aug 25 05:29:56.881022 dv-cinder-786627-19-iscsi devstack@n-api.service[93719]: worker 1 buried after 1 seconds Aug 25 05:29:56.881022 dv-cinder-786627-19-iscsi devstack@n-api.service[93719]: worker 2 buried after 1 seconds Aug 25 05:29:56.881022 dv-cinder-786627-19-iscsi devstack@n-api.service[93719]: goodbye to uWSGI. Aug 25 05:29:56.883137 dv-cinder-786627-19-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 25 05:29:56.883673 dv-cinder-786627-19-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 25 05:29:56.886724 dv-cinder-786627-19-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 25 05:29:56.899471 dv-cinder-786627-19-iscsi devstack@n-api.service[108869]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 25 05:29:56.901918 dv-cinder-786627-19-iscsi devstack@n-api.service[108869]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 25 05:29:56 2021] *** Aug 25 05:29:56.901918 dv-cinder-786627-19-iscsi devstack@n-api.service[108869]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 25 05:29:56.901918 dv-cinder-786627-19-iscsi devstack@n-api.service[108869]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 25 05:29:56.901918 dv-cinder-786627-19-iscsi devstack@n-api.service[108869]: nodename: dv-cinder-786627-19-iscsi Aug 25 05:29:56.901918 dv-cinder-786627-19-iscsi devstack@n-api.service[108869]: machine: x86_64 Aug 25 05:29:56.901918 dv-cinder-786627-19-iscsi devstack@n-api.service[108869]: clock source: unix Aug 25 05:29:56.901918 dv-cinder-786627-19-iscsi devstack@n-api.service[108869]: pcre jit disabled Aug 25 05:29:56.901918 dv-cinder-786627-19-iscsi devstack@n-api.service[108869]: detected number of CPU cores: 4 Aug 25 05:29:56.901918 dv-cinder-786627-19-iscsi devstack@n-api.service[108869]: current working directory: / Aug 25 05:29:56.901918 dv-cinder-786627-19-iscsi devstack@n-api.service[108869]: detected binary path: /usr/bin/uwsgi-core Aug 25 05:29:56.901918 dv-cinder-786627-19-iscsi devstack@n-api.service[108869]: your processes number limit is 47680 Aug 25 05:29:56.901918 dv-cinder-786627-19-iscsi devstack@n-api.service[108869]: your memory page size is 4096 bytes Aug 25 05:29:56.901918 dv-cinder-786627-19-iscsi devstack@n-api.service[108869]: detected max file descriptor number: 2048 Aug 25 05:29:56.901918 dv-cinder-786627-19-iscsi devstack@n-api.service[108869]: lock engine: pthread robust mutexes Aug 25 05:29:56.901918 dv-cinder-786627-19-iscsi devstack@n-api.service[108869]: thunder lock: enabled Aug 25 05:29:56.902887 dv-cinder-786627-19-iscsi devstack@n-api.service[108869]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 25 05:29:56.902887 dv-cinder-786627-19-iscsi devstack@n-api.service[108869]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 25 05:29:56.951568 dv-cinder-786627-19-iscsi devstack@n-api.service[108869]: Python main interpreter initialized at 0x55e94348d9c0 Aug 25 05:29:56.951568 dv-cinder-786627-19-iscsi devstack@n-api.service[108869]: python threads support enabled Aug 25 05:29:56.951568 dv-cinder-786627-19-iscsi devstack@n-api.service[108869]: your server socket listen backlog is limited to 100 connections Aug 25 05:29:56.951568 dv-cinder-786627-19-iscsi devstack@n-api.service[108869]: your mercy for graceful operations on workers is 90 seconds Aug 25 05:29:56.952025 dv-cinder-786627-19-iscsi devstack@n-api.service[108869]: mapped 403077 bytes (393 KB) for 2 cores Aug 25 05:29:56.952025 dv-cinder-786627-19-iscsi devstack@n-api.service[108869]: *** Operational MODE: preforking *** Aug 25 05:29:56.952305 dv-cinder-786627-19-iscsi devstack@n-api.service[108869]: *** uWSGI is running in multiple interpreter mode *** Aug 25 05:29:56.952305 dv-cinder-786627-19-iscsi devstack@n-api.service[108869]: spawned uWSGI master process (pid: 108869) Aug 25 05:29:56.952525 dv-cinder-786627-19-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 25 05:29:56.953103 dv-cinder-786627-19-iscsi devstack@n-api.service[108869]: spawned uWSGI worker 1 (pid: 108884, cores: 1) Aug 25 05:29:56.953455 dv-cinder-786627-19-iscsi devstack@n-api.service[108869]: spawned uWSGI worker 2 (pid: 108885, cores: 1) Aug 25 05:29:56.954758 dv-cinder-786627-19-iscsi devstack@n-api.service[108869]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 25 05:29:58.830257 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 05:29:58.830257 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: from cryptography.utils import int_from_bytes Aug 25 05:29:58.830961 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 05:29:58.830961 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: from cryptography.utils import int_from_bytes Aug 25 05:29:58.854057 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 05:29:58.854057 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: from cryptography.utils import int_from_bytes Aug 25 05:29:58.855273 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 05:29:58.855273 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: from cryptography.utils import int_from_bytes Aug 25 05:30:01.444374 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 25 05:30:01.445784 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 25 05:30:01.445784 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 25 05:30:01.445784 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 25 05:30:01.446040 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 25 05:30:01.446290 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.446625 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.446953 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.447277 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.447613 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.447932 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.448259 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.448585 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.448919 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.449186 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.449508 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.449880 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-786627-19-iscsi {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.450195 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.450512 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.450835 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.451158 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.451468 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.451795 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.452107 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.454972 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.454972 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.455217 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.455724 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.456222 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.456554 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.456888 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.457224 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.457571 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.457904 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.458223 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.458645 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-786627-19-iscsi {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.458966 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.459286 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.459608 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.460183 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.460997 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.461252 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.461776 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.462117 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.462441 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.462782 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.463114 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.463443 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.463773 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.464084 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.464399 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.464718 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.465044 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.465357 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.465715 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.465970 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.466287 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.466617 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.466945 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.467274 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.467533 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.467788 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.468112 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.468436 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.468749 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.469062 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.469375 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.469724 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.470036 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.470345 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.470655 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.470974 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.471297 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.471624 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.471951 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.472258 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.472580 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.472987 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.473244 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.473575 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.473927 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.474252 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.474565 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.474889 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.475214 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.475528 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.476841 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.477022 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.477257 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.477621 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.477937 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.478199 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.478508 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.478818 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.479141 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.479455 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.479769 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.480077 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.480382 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.480694 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.481010 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.481323 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.481668 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.481982 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.482283 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.482595 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.482904 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.483214 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.483538 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.483862 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.484173 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.484483 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.484791 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.485101 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.485425 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.485758 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.486068 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.486393 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.486708 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.487020 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.487341 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.487704 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.487958 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.488283 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.488588 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.488897 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.489217 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.489557 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.489943 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.490161 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.490470 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.490780 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.491095 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.491951 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.492666 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.492666 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.492963 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.493387 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.493591 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.493907 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.494222 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.494547 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.494896 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.495237 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.495586 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.495958 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 25 05:30:01.496459 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.496616 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 25 05:30:01.496762 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.496762 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.497082 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 25 05:30:01.497239 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.497385 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 25 05:30:01.497570 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.497760 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 25 05:30:01.497937 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.498085 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.498246 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.498402 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.498862 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.499027 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.499187 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.499345 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.499491 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.499734 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.499891 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.500067 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.500327 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.500490 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.500635 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.500786 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.500936 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.501093 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.501244 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.501400 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.501580 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.501739 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.501891 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.502047 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-786627-19-iscsi {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.502203 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.502366 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.502511 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.502661 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.502816 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.502973 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.503268 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.503656 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.503810 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.503954 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.504112 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.504257 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.504402 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.504566 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.504712 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.504857 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.505034 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.505182 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.505336 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.505489 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.505700 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.505858 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.506014 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.506168 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.506313 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.506479 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.506622 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.506787 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.507006 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.507286 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.507913 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.508093 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.508393 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.508570 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.509183 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.509337 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.509491 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.509690 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-786627-19-iscsi {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.510004 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.510167 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.510341 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.510341 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.510765 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.510919 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.511074 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.511226 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.511372 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.511516 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.511660 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.511812 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.511976 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.512128 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.512274 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.512424 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.512624 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.512782 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.512927 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.513687 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.513687 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.513887 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.513971 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.514093 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.514177 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.514260 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.514338 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.514417 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.514489 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.514573 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.514653 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.514726 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.514726 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.514864 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.514947 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.515027 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.515027 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.515170 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.515243 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.515375 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.515464 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.515538 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.515609 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.515684 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.515761 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.515840 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.515920 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.515999 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.516092 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.516187 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.516265 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.516368 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.516368 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.516517 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.516586 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.516664 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.517276 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.517392 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.517469 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.517581 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.517661 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.517746 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.517829 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.517903 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.518042 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.518140 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.518365 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.518479 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.518676 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.518775 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.518993 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.519096 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.522574 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.522711 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.522809 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.522885 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.522885 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.523022 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.523094 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.523164 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.523247 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.523327 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.523406 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.523483 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.523574 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.523653 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.523734 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.523807 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.523877 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.523959 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.524038 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.524194 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.524276 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.524349 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.524426 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.524575 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.524658 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.524742 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.524824 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.524908 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.524991 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.525064 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.525142 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.525214 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.525292 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.525365 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.525436 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.525513 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.525619 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.525693 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.525781 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.525854 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.525932 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.526010 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.526010 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.526152 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.526245 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.526325 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.528667 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.528793 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.528876 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.528950 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.529039 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.529121 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.529200 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.529273 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.529343 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.529421 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.529501 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.529613 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.529705 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.529779 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.529856 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.529950 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.530038 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.530111 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.530187 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.530264 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.530342 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.530426 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.530499 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.530570 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.530658 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.530737 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.530818 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.530898 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.530976 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.531048 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.531126 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.531263 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.531370 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.531587 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.531696 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.531914 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.532017 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.532227 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.532338 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.535647 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.535787 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.535787 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.535976 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.536071 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.536163 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.536249 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.536346 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.536432 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.536523 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.536627 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.536734 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.536815 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.536901 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.536982 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.537059 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.537131 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.537201 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.537276 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.537357 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.537756 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.537852 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.537934 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.538014 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.538087 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.538767 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.538867 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.538948 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.539020 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.539090 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.539173 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.539375 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.539478 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.539565 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.539646 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.539732 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.539818 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.539906 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.540043 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.540136 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.540209 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.540286 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.540367 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.540448 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.540519 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.540597 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.540679 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.540757 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.540846 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.540925 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.541003 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.542813 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.543474 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.543571 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.543658 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:30:01.543658 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.543796 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.543876 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.543962 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.544042 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.544120 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.544191 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.544261 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.544330 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.544413 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.544486 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.544563 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.544635 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.544711 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.544789 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.544874 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.544952 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.545030 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.545108 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.545190 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.545366 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.545443 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.545514 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.545609 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.545751 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.545850 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.546078 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.546195 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.546402 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.546516 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.546731 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.546836 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.547053 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.547156 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.547379 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.547475 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.547689 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.547783 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.548007 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.548106 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.548331 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.548432 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.548645 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.548749 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.548966 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.549067 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.549281 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.549363 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.549618 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.549725 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.549951 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.550058 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.550270 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.550355 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.550590 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.550686 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.550906 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.550988 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.551227 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.551308 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.551543 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.551637 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.551863 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.552003 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.552173 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.552337 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.552498 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.552658 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.552850 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.552977 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.553375 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.553562 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.553766 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.554438 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.554820 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.554983 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.555135 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.555299 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.555475 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.555631 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.555786 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.555936 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.556104 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.556343 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.556598 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.556760 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.556910 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.557069 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.557217 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.557386 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.557569 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.557735 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.557895 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.558045 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.558193 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.558349 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.558505 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.558660 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.558816 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.558963 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.559112 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.559269 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.559418 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.559572 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.559731 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.559879 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.560034 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.560196 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.560345 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.560492 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.560649 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.560803 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.560965 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.561113 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.561262 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.561417 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.561593 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.561747 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.561930 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.562159 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.562336 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.562517 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.562678 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.562834 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.562996 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.563152 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.563302 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.563457 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.563636 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.563811 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.563968 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.564123 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.564278 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.564442 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.564592 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.564740 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.564894 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.565057 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.565214 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.565375 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.565612 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.565769 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.565928 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.566077 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.566077 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.566387 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.566723 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.566884 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.567043 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.567191 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.567339 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.567496 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.567645 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.567799 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.567948 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.568112 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.568404 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.568562 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.568712 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.568860 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.569008 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.569163 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.569325 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.569560 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.569729 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.569878 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.570041 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.570215 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.570379 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.570534 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.570690 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.570852 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.570852 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.571155 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.571317 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.571479 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.571641 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.571797 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.571952 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.572115 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.572388 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.572558 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.572723 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.572890 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.573045 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.573208 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.573370 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.573563 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.573736 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.573900 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.574055 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.574217 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.574379 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.574544 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.574699 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.574862 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.575018 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.575254 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.575412 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.575566 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.575719 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.575887 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.576055 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.576217 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.576379 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.576533 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.576882 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.577046 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.577212 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.578003 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.578174 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.578174 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.578492 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.578647 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.578809 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.578963 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.579142 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.579320 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.579476 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.579630 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.579784 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.579938 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.580107 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.580270 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.580433 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.580589 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.580743 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.580897 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.580897 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.581202 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.581367 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.581581 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.581754 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.581910 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.582078 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.582235 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.582411 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.582657 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.582825 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.582993 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.583147 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.583310 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.583472 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.583645 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.583800 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.583966 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.584121 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.584277 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.584430 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.584590 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.584744 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.584907 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.585641 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.585833 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.586057 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.586338 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.586575 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.586754 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.587119 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.587289 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.587446 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.587602 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.587772 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.587934 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.588098 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.588098 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.588392 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.588556 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.588737 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.588900 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.589056 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.589210 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.589363 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.589518 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.589756 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.589912 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.590074 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.590228 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.590389 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.590545 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.590709 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.590875 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.591030 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.591184 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.591345 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.591513 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.591675 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.591830 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.592001 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.592156 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.592310 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.592489 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.592667 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.592915 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.593089 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.593252 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.593406 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.593780 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.593950 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.594105 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.594268 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.594442 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.594605 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.594774 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.594929 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.595090 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.595245 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.595409 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.595572 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.595736 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.595893 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.596047 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.596201 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.596354 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.596517 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.596671 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.596826 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.596980 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.597273 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.597446 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.597636 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.597808 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.597974 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.598130 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.598293 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.598447 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.598612 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.598767 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.598920 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.599083 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.599245 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.599399 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.599399 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.599721 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.599876 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.600031 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.600186 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.600396 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.600557 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.601366 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.601568 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.601732 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.601899 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.602064 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.602220 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.602392 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.602550 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.602713 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.602713 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.603153 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.603311 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.603468 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.603630 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.603792 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.603956 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.604124 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.604288 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.604464 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.604629 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.604786 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.604950 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.605106 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.605270 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.605426 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.605636 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.605808 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.605981 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.605981 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.606284 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.606446 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.606648 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.606822 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.607058 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.607220 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.607414 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.607577 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.607740 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.607894 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.608132 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.608297 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.608492 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.608659 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.608814 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.608814 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.609137 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.609300 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.609455 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.609697 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.609882 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.610072 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.610244 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.610403 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.610601 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.610764 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.610928 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.610928 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.611243 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.611398 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.611579 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.611759 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.611919 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.612083 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.612259 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.612450 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.612618 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.612789 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.612961 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.613135 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.613336 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.613494 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.613686 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.613844 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.614009 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.614173 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.614328 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.614481 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.614644 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.614800 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.614980 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.615416 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.615607 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.615792 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.615948 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.616102 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.616255 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.616450 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.616606 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.616775 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.616775 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.617094 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.617282 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.617449 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.617721 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.617892 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.618059 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.618236 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.618395 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.618587 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.618763 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.618947 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.619106 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.619259 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.619413 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.619567 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.619731 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.619893 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.620060 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.620214 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.620367 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.620527 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.620691 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.620846 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.621069 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.621244 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.621440 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.621648 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.621849 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.622019 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.622175 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.622351 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.622515 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.622697 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.622897 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.623060 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.623060 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.623382 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.623537 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.623699 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.623889 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.624056 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.624212 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.624378 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.624552 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.624721 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.624883 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.625045 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.625215 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.625370 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.625543 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.625716 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.625878 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.626040 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.626202 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.626357 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.626511 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.626688 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.626843 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.627004 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.627157 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.627319 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.627485 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.627647 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.627647 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.627961 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.628116 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.628269 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.628436 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.628591 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.628763 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.628917 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.629080 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.629233 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.629402 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.629613 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.629782 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.629946 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.630101 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.630254 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.630254 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.630558 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.630722 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.630722 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.631021 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.631184 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.631345 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.631508 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.631663 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.631815 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.632011 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.632177 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.632342 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.632505 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.632505 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.632821 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.632984 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.633152 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.633314 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.633476 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.633673 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.633830 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.633994 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.634149 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.634309 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.634471 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.634634 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.634788 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.634970 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.635125 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.635286 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.635446 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.635601 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.635763 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.635927 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.636082 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.636237 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.636391 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.636545 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.636706 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.636873 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.637038 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.637038 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.637336 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.637502 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.637780 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.637939 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.638093 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.638247 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.638401 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.638555 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.638717 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.638881 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.639046 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.639207 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.639361 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.639522 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.639685 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.639849 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.640003 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.640207 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.640365 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.640518 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.640686 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.640686 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.640993 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.641158 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.641378 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.641559 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.641733 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.641896 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.642052 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.642222 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.642381 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.642544 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.642699 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.642852 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.643007 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.643160 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.643333 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.643333 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.643663 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.643825 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.643980 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.644135 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.644302 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.644457 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.644618 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.644772 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.644925 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.645094 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.645249 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.645421 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.645641 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.645804 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.645958 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.646145 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.646316 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.646472 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.646635 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.646790 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.646951 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.647116 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.647271 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.647435 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.648098 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.648300 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.648300 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.648608 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.648762 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.648923 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.649077 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.649231 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.649400 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.649574 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.649746 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.649919 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.650074 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.650235 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.650399 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.650561 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.650719 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.650911 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.651075 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.651239 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.651395 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.651557 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.651719 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.651892 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.652054 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.652227 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.652383 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.652544 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.652544 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.652866 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.653021 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.653225 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.653389 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.653570 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.653743 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.654022 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.654204 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.654360 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.654515 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.654670 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.654831 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.654986 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.655149 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.655303 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.655456 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.655612 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.655765 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.655927 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.656091 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.656256 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.656410 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.656572 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.656734 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.656888 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.656888 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.657191 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.657352 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.657513 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.657722 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.657886 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.658041 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.658213 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.658375 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.658529 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.658689 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.658853 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.659007 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.659167 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.659322 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.659483 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.659645 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.659812 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.659972 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.660133 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.660309 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.660472 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.660708 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.660866 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.661028 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.661182 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.661337 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.661490 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.661684 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.661848 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.662011 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.662177 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.662331 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.662764 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.662764 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.663071 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.663071 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.664122 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.664231 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.664326 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.664409 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.664482 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.664550 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.664631 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.664712 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.664802 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.664892 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.664977 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.665065 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.665149 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.665229 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.665323 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.665414 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.665503 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.665659 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.665743 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.665838 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.665950 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.666039 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.666123 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.666212 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.666313 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.666411 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.666516 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.666596 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.666685 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.666783 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.666860 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.666943 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.667031 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.667120 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.667203 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.667291 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.667373 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.667468 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.667552 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.667634 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.667713 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.667801 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.667884 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.667974 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.668057 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.668145 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.668246 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.668326 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.668326 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.668326 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.668535 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.668623 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.668706 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.668792 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.668882 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.668965 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.669044 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.669132 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.669214 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.669301 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.669408 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.669487 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.669584 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.669748 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.669841 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.669931 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.670022 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.670105 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.670105 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.670258 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.670340 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.670428 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.670517 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.670741 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.670842 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.671063 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.671167 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.671377 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.671468 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.671693 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.671786 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.672021 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.672122 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.672344 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.672438 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.672677 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.672773 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.673003 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.673093 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.673318 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.673438 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.673696 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.673789 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.674029 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.674140 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.674367 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.674587 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.674680 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.674929 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.675020 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.675274 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.675373 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.675613 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.675703 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.675935 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.676025 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.676249 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.676340 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.676559 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.676648 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.676868 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.676961 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.677187 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.677277 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.677497 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.677607 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.677833 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.677941 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.678146 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.678244 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.678462 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.678559 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.678804 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.678940 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.679123 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.679307 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.679446 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.679641 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.679952 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.680139 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.680263 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.680355 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.680581 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.680680 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.680894 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.681011 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.681239 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.681329 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.681580 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.681687 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.681904 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.682005 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.682226 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.682326 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.682548 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.682647 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.682872 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.682971 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.683186 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.683284 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.683499 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.683598 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.683815 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.683908 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.684137 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.684247 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.684461 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.684553 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.684777 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.684875 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.685089 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.685188 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.685412 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.685513 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.685759 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.685850 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.686085 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.686173 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.686409 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.686509 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.686735 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.686827 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.687084 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.687305 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.687400 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.687647 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.687739 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.687972 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.688064 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.688297 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.688401 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.688623 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.688711 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.688948 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.689046 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.689273 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.689436 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.689623 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.689718 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.689950 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.690099 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.690275 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.690385 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.690597 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.690695 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.690937 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.691030 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.691269 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.691369 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.691605 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.691702 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.691939 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.692039 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.692257 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.692357 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.692578 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.692668 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.692899 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.692989 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.693219 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.693311 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.693556 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.693650 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.693886 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.693986 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.694208 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.694320 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.694649 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.694753 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.694931 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.695056 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.695245 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.695389 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.695560 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.695715 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.695876 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.696039 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.696195 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.696363 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.696513 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.696672 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.696837 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.696995 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.697160 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.697316 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.697471 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.697694 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.697825 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.698021 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.698149 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.698355 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.698473 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.698698 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.698798 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.699030 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.699121 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.699355 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.699447 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.699679 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.699771 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.700004 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.700123 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.700437 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.700539 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.700759 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.700852 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.701080 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.701179 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.701402 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.701501 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.710774 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.711059 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.711142 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.711213 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.711282 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.711359 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.711443 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.711521 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.711592 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.711677 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.711759 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.711856 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.711946 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.712037 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.712128 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.712213 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.712304 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 25 05:30:01.712402 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.712402 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.712402 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.712402 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.712402 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.712402 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.712402 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.712402 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.712934 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.712934 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.712934 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.712934 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.712934 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.712934 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.712934 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.712934 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.713745 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.713745 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.713745 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.713745 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.713745 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.713745 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.713745 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.713745 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.714327 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.714327 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.714327 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.714327 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.714327 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.714717 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.715805 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.716135 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.716463 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.716788 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.717120 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.717440 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.717800 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.718122 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.718450 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.718768 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.719093 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.719413 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.719757 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.720074 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.720392 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.720725 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.721052 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.721389 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.721743 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.722072 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.722439 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.722772 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.723381 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.723732 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.724081 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.724446 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.724794 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.725122 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.725435 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.726430 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.726785 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.727143 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.727491 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.727813 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.728134 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.728456 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.728778 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.729098 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.729415 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.729762 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.730082 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.730401 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.730764 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.731209 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.731513 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.731789 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.732068 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.732385 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.732703 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.733021 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.733339 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.733693 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.734039 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.734361 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.734677 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.735132 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.735456 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.735787 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.736116 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.736437 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.736771 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.737101 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.737426 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.737843 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.738110 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.738450 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.738801 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.739142 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.739475 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.739791 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.740105 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.740420 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.740739 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.741082 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.741516 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.741934 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.742256 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.742647 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.742967 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.743298 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.743629 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.743963 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.744283 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.744629 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.744950 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.745279 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.745628 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.745952 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.753623 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.753623 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.753623 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.753623 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.753623 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.753623 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.753623 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.753623 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.754277 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.754277 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.754277 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.754277 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.754277 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.754277 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.754277 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.754277 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.754836 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.754836 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.754836 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.754836 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.754836 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.754836 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.754836 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.754836 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.755519 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:30:01.755519 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 25 05:30:01.821115 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_db.sqlalchemy.engines [None req-7bd6b677-46c4-40eb-9785-b1a1caef7aca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 05:30:01.868874 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_db.sqlalchemy.engines [None req-add473f0-9072-4ae3-9a2d-cbb1e5dd44f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108885) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 05:30:01.903494 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.context [None req-7bd6b677-46c4-40eb-9785-b1a1caef7aca None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c3755851-79f1-4766-b402-273e8a6972d0(cell1) {{(pid=108884) load_cells /opt/stack/nova/nova/context.py:464}} Aug 25 05:30:01.907787 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7bd6b677-46c4-40eb-9785-b1a1caef7aca None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:30:01.909397 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7bd6b677-46c4-40eb-9785-b1a1caef7aca None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:30:01.910287 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7bd6b677-46c4-40eb-9785-b1a1caef7aca None None] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:30:01.915172 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7bd6b677-46c4-40eb-9785-b1a1caef7aca None None] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:30:01.927862 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_db.sqlalchemy.engines [None req-7bd6b677-46c4-40eb-9785-b1a1caef7aca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 05:30:01.930035 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_db.sqlalchemy.engines [None req-7bd6b677-46c4-40eb-9785-b1a1caef7aca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 05:30:01.952577 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.context [None req-add473f0-9072-4ae3-9a2d-cbb1e5dd44f4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c3755851-79f1-4766-b402-273e8a6972d0(cell1) {{(pid=108885) load_cells /opt/stack/nova/nova/context.py:464}} Aug 25 05:30:01.956974 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-add473f0-9072-4ae3-9a2d-cbb1e5dd44f4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:30:01.958689 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-add473f0-9072-4ae3-9a2d-cbb1e5dd44f4 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:30:01.959652 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-add473f0-9072-4ae3-9a2d-cbb1e5dd44f4 None None] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:30:01.964170 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-add473f0-9072-4ae3-9a2d-cbb1e5dd44f4 None None] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:30:01.978562 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_db.sqlalchemy.engines [None req-add473f0-9072-4ae3-9a2d-cbb1e5dd44f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108885) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 05:30:01.978562 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_db.sqlalchemy.engines [None req-add473f0-9072-4ae3-9a2d-cbb1e5dd44f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108885) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 05:30:02.200185 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_db.sqlalchemy.engines [None req-7bd6b677-46c4-40eb-9785-b1a1caef7aca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 05:30:02.264856 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_db.sqlalchemy.engines [None req-add473f0-9072-4ae3-9a2d-cbb1e5dd44f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108885) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 05:30:02.532821 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: WARNING keystonemiddleware.auth_token [None req-7bd6b677-46c4-40eb-9785-b1a1caef7aca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 05:30:02.540564 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: WARNING keystonemiddleware.auth_token [None req-7bd6b677-46c4-40eb-9785-b1a1caef7aca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 05:30:02.617829 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: WARNING keystonemiddleware.auth_token [None req-add473f0-9072-4ae3-9a2d-cbb1e5dd44f4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 05:30:02.624685 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: WARNING keystonemiddleware.auth_token [None req-add473f0-9072-4ae3-9a2d-cbb1e5dd44f4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 05:30:02.896535 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: WARNING keystonemiddleware.auth_token [None req-7bd6b677-46c4-40eb-9785-b1a1caef7aca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 05:30:02.901912 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: WARNING keystonemiddleware.auth_token [None req-7bd6b677-46c4-40eb-9785-b1a1caef7aca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 05:30:02.907316 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e94348d9c0 pid: 108884 (default app) Aug 25 05:30:02.984316 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: WARNING keystonemiddleware.auth_token [None req-add473f0-9072-4ae3-9a2d-cbb1e5dd44f4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 05:30:02.989565 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: WARNING keystonemiddleware.auth_token [None req-add473f0-9072-4ae3-9a2d-cbb1e5dd44f4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 05:30:02.995170 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e94348d9c0 pid: 108885 (default app) Aug 25 05:30:40.508678 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7e1c5715-e67b-44c4-b85f-404748c372ce tempest-VolumesNegativeTest-1693391308 tempest-VolumesNegativeTest-1693391308-project] Action: 'create', calling method: .version_select at 0x7f910cc12ca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1009428258", "metadata": {"Type": "work"}}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:30:40.511561 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7e1c5715-e67b-44c4-b85f-404748c372ce tempest-VolumesNegativeTest-1693391308 tempest-VolumesNegativeTest-1693391308-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=108884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 05:30:40.513348 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7e1c5715-e67b-44c4-b85f-404748c372ce tempest-VolumesNegativeTest-1693391308 tempest-VolumesNegativeTest-1693391308-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.663342 Aug 25 05:30:40.514704 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1/1] 10.222.0.42 () {60 vars in 1156 bytes} [Wed Aug 25 05:30:38 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1666 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 05:30:40.584353 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c35eeaeb-8a69-4a84-b291-dce194622b83 tempest-VolumesGetTestJSON-762507075 tempest-VolumesGetTestJSON-762507075-project] Action: 'create', calling method: .version_select at 0x7f910cc11ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-170884515", "metadata": {"Type": "work"}}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:30:41.020558 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-baf94a20-b9e4-4e04-8a57-23188f8c121f tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1409198962", "imageRef": "05da2439-78f2-405c-b60a-89671b21a373", "flavorRef": "452", "networks": [{"uuid": "89ec82b2-0645-41a4-a035-ac0252b66e1f"}]}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:30:41.615301 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.network.neutron [None req-baf94a20-b9e4-4e04-8a57-23188f8c121f tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] validate_networks() for [('89ec82b2-0645-41a4-a035-ac0252b66e1f', None, None, None, None, None)] {{(pid=108884) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 25 05:30:42.294411 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c35eeaeb-8a69-4a84-b291-dce194622b83 tempest-VolumesGetTestJSON-762507075 tempest-VolumesGetTestJSON-762507075-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.360728 Aug 25 05:30:42.304016 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1/2] 10.222.0.42 () {60 vars in 1156 bytes} [Wed Aug 25 05:30:38 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 3372 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 25 05:30:42.310955 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c5ae153e-a1b5-4e94-86a9-e3f63cfbf12d tempest-VolumesNegativeTest-1693391308 tempest-VolumesNegativeTest-1693391308-project] Action: 'create', calling method: .version_select at 0x7f910cc2d820>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1937935810", "metadata": {"Type": "work"}}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:30:42.313762 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c5ae153e-a1b5-4e94-86a9-e3f63cfbf12d tempest-VolumesNegativeTest-1693391308 tempest-VolumesNegativeTest-1693391308-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=108885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 05:30:42.314607 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c5ae153e-a1b5-4e94-86a9-e3f63cfbf12d tempest-VolumesNegativeTest-1693391308 tempest-VolumesNegativeTest-1693391308-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008699 Aug 25 05:30:42.315153 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 2/3] 10.222.0.42 () {60 vars in 1156 bytes} [Wed Aug 25 05:30:42 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 05:30:42.323468 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6d525899-15d0-4c96-bd11-745839f8d7a0 tempest-VolumesTestJSON-1484470376 tempest-VolumesTestJSON-1484470376-project] Calling method '.version_select at 0x7f910d4670d0>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:42.449429 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6d525899-15d0-4c96-bd11-745839f8d7a0 tempest-VolumesTestJSON-1484470376 tempest-VolumesTestJSON-1484470376-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/dd827a87-3f00-480e-98c7-ab7ac087175e" status: 200 len: 351 microversion: 2.1 time: 0.120321 Aug 25 05:30:42.449429 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 3/4] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 25 05:30:42 2021] GET /compute/v2.1/os-volumes/dd827a87-3f00-480e-98c7-ab7ac087175e => generated 351 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:30:42.449429 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-208a34cc-38fd-4fe4-998e-db8c573b269b tempest-VolumesGetTestJSON-762507075 tempest-VolumesGetTestJSON-762507075-project] Calling method '.version_select at 0x7f910caf10d0>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:42.645451 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-208a34cc-38fd-4fe4-998e-db8c573b269b tempest-VolumesGetTestJSON-762507075 tempest-VolumesGetTestJSON-762507075-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/76bd7ce7-9999-4e73-81f2-11b5f999353f" status: 200 len: 352 microversion: 2.1 time: 0.203049 Aug 25 05:30:42.646100 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 4/5] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 25 05:30:42 2021] GET /compute/v2.1/os-volumes/76bd7ce7-9999-4e73-81f2-11b5f999353f => generated 352 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:30:42.651231 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d11e17f9-bf01-4840-8e77-1ad7ba121e51 tempest-VolumesNegativeTest-1693391308 tempest-VolumesNegativeTest-1693391308-project] Action: 'create', calling method: .version_select at 0x7f910caf19d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1012548671", "metadata": {"Type": "work"}}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:30:42.652691 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d11e17f9-bf01-4840-8e77-1ad7ba121e51 tempest-VolumesNegativeTest-1693391308 tempest-VolumesNegativeTest-1693391308-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=108885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 05:30:42.656010 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d11e17f9-bf01-4840-8e77-1ad7ba121e51 tempest-VolumesNegativeTest-1693391308 tempest-VolumesNegativeTest-1693391308-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008636 Aug 25 05:30:42.664198 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 5/6] 10.222.0.42 () {60 vars in 1156 bytes} [Wed Aug 25 05:30:42 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 05:30:42.674378 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-209140e0-98aa-4bbf-a8e0-698275f31269 tempest-VolumesNegativeTest-1693391308 tempest-VolumesNegativeTest-1693391308-project] Calling method '.version_select at 0x7f910cafa550>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:42.724566 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.wsgi [None req-209140e0-98aa-4bbf-a8e0-698275f31269 tempest-VolumesNegativeTest-1693391308 tempest-VolumesNegativeTest-1693391308-project] HTTP exception thrown: Volume tempest-invalid-1317417753 could not be found. Aug 25 05:30:42.725537 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-209140e0-98aa-4bbf-a8e0-698275f31269 tempest-VolumesNegativeTest-1693391308 tempest-VolumesNegativeTest-1693391308-project] Returning 404 to user: Volume tempest-invalid-1317417753 could not be found. {{(pid=108885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 05:30:42.727272 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-209140e0-98aa-4bbf-a8e0-698275f31269 tempest-VolumesNegativeTest-1693391308 tempest-VolumesNegativeTest-1693391308-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1317417753" status: 404 len: 99 microversion: 2.1 time: 0.058586 Aug 25 05:30:42.733372 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 6/7] 10.222.0.42 () {58 vars in 1218 bytes} [Wed Aug 25 05:30:42 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1317417753 => generated 99 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 25 05:30:42.740433 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e2907e92-8c0b-4e66-8341-a282e65282c0 tempest-VolumesNegativeTest-1693391308 tempest-VolumesNegativeTest-1693391308-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005020 Aug 25 05:30:42.753606 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 7/8] 10.222.0.42 () {58 vars in 1140 bytes} [Wed Aug 25 05:30:42 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 25 05:30:42.773399 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-99a33201-a72d-465f-9cc3-e834d41b181e tempest-VolumesNegativeTest-1693391308 tempest-VolumesNegativeTest-1693391308-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.018507 Aug 25 05:30:42.777356 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 8/9] 10.222.0.42 () {58 vars in 1137 bytes} [Wed Aug 25 05:30:42 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 25 05:30:42.792809 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-50f490f0-25fe-433e-98ae-1276bfb40035 tempest-VolumesNegativeTest-1693391308 tempest-VolumesNegativeTest-1693391308-project] Calling method '.version_select at 0x7f910caf14c0>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:42.889986 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.wsgi [None req-50f490f0-25fe-433e-98ae-1276bfb40035 tempest-VolumesNegativeTest-1693391308 tempest-VolumesNegativeTest-1693391308-project] HTTP exception thrown: Volume e5ba6fb8-249e-439f-ba52-d33351df119f could not be found. Aug 25 05:30:42.890731 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-50f490f0-25fe-433e-98ae-1276bfb40035 tempest-VolumesNegativeTest-1693391308 tempest-VolumesNegativeTest-1693391308-project] Returning 404 to user: Volume e5ba6fb8-249e-439f-ba52-d33351df119f could not be found. {{(pid=108885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 05:30:42.891591 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-50f490f0-25fe-433e-98ae-1276bfb40035 tempest-VolumesNegativeTest-1693391308 tempest-VolumesNegativeTest-1693391308-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/e5ba6fb8-249e-439f-ba52-d33351df119f" status: 404 len: 109 microversion: 2.1 time: 0.105928 Aug 25 05:30:42.892145 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 9/10] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Aug 25 05:30:42 2021] DELETE /compute/v2.1/os-volumes/e5ba6fb8-249e-439f-ba52-d33351df119f => generated 109 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:30:42.903879 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e9c9ace6-34a4-4768-9762-c5b302666af0 tempest-VolumesNegativeTest-1693391308 tempest-VolumesNegativeTest-1693391308-project] Calling method '.version_select at 0x7f910caf1dc0>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:42.980718 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.wsgi [None req-e9c9ace6-34a4-4768-9762-c5b302666af0 tempest-VolumesNegativeTest-1693391308 tempest-VolumesNegativeTest-1693391308-project] HTTP exception thrown: Volume 678167f2-dd00-4f82-a0dc-a64d6615e695 could not be found. Aug 25 05:30:42.981719 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e9c9ace6-34a4-4768-9762-c5b302666af0 tempest-VolumesNegativeTest-1693391308 tempest-VolumesNegativeTest-1693391308-project] Returning 404 to user: Volume 678167f2-dd00-4f82-a0dc-a64d6615e695 could not be found. {{(pid=108885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 05:30:42.982845 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e9c9ace6-34a4-4768-9762-c5b302666af0 tempest-VolumesNegativeTest-1693391308 tempest-VolumesNegativeTest-1693391308-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/678167f2-dd00-4f82-a0dc-a64d6615e695" status: 404 len: 109 microversion: 2.1 time: 0.083667 Aug 25 05:30:42.993143 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 10/11] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 25 05:30:42 2021] GET /compute/v2.1/os-volumes/678167f2-dd00-4f82-a0dc-a64d6615e695 => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 05:30:43.671956 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e260748c-6b78-4508-a317-e0ce54630e70 tempest-VolumesGetTestJSON-762507075 tempest-VolumesGetTestJSON-762507075-project] Calling method '.version_select at 0x7f910caddaf0>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:43.792267 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e260748c-6b78-4508-a317-e0ce54630e70 tempest-VolumesGetTestJSON-762507075 tempest-VolumesGetTestJSON-762507075-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/76bd7ce7-9999-4e73-81f2-11b5f999353f" status: 200 len: 353 microversion: 2.1 time: 0.133790 Aug 25 05:30:43.792954 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 11/12] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 25 05:30:43 2021] GET /compute/v2.1/os-volumes/76bd7ce7-9999-4e73-81f2-11b5f999353f => generated 353 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:30:43.808305 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c2ba32b7-4061-4369-81d8-d38b15b856af tempest-VolumesGetTestJSON-762507075 tempest-VolumesGetTestJSON-762507075-project] Calling method '.version_select at 0x7f910caf1dc0>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:43.966005 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c2ba32b7-4061-4369-81d8-d38b15b856af tempest-VolumesGetTestJSON-762507075 tempest-VolumesGetTestJSON-762507075-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/76bd7ce7-9999-4e73-81f2-11b5f999353f" status: 200 len: 353 microversion: 2.1 time: 0.165165 Aug 25 05:30:43.966857 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 12/13] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 25 05:30:43 2021] GET /compute/v2.1/os-volumes/76bd7ce7-9999-4e73-81f2-11b5f999353f => generated 353 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:30:43.989490 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5b13b3f8-c141-43ca-bb87-10ea98fcf8a7 tempest-VolumesGetTestJSON-762507075 tempest-VolumesGetTestJSON-762507075-project] Calling method '.version_select at 0x7f910caf1790>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:44.045954 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-baf94a20-b9e4-4e04-8a57-23188f8c121f tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Flavor limits 0:0:0 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 05:30:44.048046 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-baf94a20-b9e4-4e04-8a57-23188f8c121f tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Image limits 0:0:0 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 05:30:44.063338 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-baf94a20-b9e4-4e04-8a57-23188f8c121f tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Flavor pref 0:0:0 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 05:30:44.065955 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-baf94a20-b9e4-4e04-8a57-23188f8c121f tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Image pref 0:0:0 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 05:30:44.070071 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-baf94a20-b9e4-4e04-8a57-23188f8c121f tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 05:30:44.138390 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-baf94a20-b9e4-4e04-8a57-23188f8c121f tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:30:44.138390 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-baf94a20-b9e4-4e04-8a57-23188f8c121f tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:30:44.138390 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-baf94a20-b9e4-4e04-8a57-23188f8c121f tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:30:44.138390 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-baf94a20-b9e4-4e04-8a57-23188f8c121f tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:30:44.325119 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.quota [None req-baf94a20-b9e4-4e04-8a57-23188f8c121f tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Getting quotas for project a213191904a64205b483c88adabf87a4. Resources: {'ram', 'cores', 'instances'} {{(pid=108884) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 05:30:44.353103 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.quota [None req-baf94a20-b9e4-4e04-8a57-23188f8c121f tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Getting quotas for user 35da6a5109cb482bbf144927215467f9 and project a213191904a64205b483c88adabf87a4. Resources: {'ram', 'cores', 'instances'} {{(pid=108884) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 05:30:44.393427 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-baf94a20-b9e4-4e04-8a57-23188f8c121f tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Going to run 1 instances... {{(pid=108884) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 25 05:30:44.399142 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5b13b3f8-c141-43ca-bb87-10ea98fcf8a7 tempest-VolumesGetTestJSON-762507075 tempest-VolumesGetTestJSON-762507075-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/76bd7ce7-9999-4e73-81f2-11b5f999353f" status: 202 len: 0 microversion: 2.1 time: 0.411940 Aug 25 05:30:44.404199 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 13/14] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Aug 25 05:30:43 2021] DELETE /compute/v2.1/os-volumes/76bd7ce7-9999-4e73-81f2-11b5f999353f => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 05:30:44.404433 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-baf94a20-b9e4-4e04-8a57-23188f8c121f tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05da2439-78f2-405c-b60a-89671b21a373',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 25 05:30:44.417190 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e24a664d-b012-4d42-aa5d-46f2353b000a tempest-VolumesGetTestJSON-762507075 tempest-VolumesGetTestJSON-762507075-project] Calling method '.version_select at 0x7f910cafa1f0>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:44.628752 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e24a664d-b012-4d42-aa5d-46f2353b000a tempest-VolumesGetTestJSON-762507075 tempest-VolumesGetTestJSON-762507075-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/76bd7ce7-9999-4e73-81f2-11b5f999353f" status: 200 len: 352 microversion: 2.1 time: 0.219196 Aug 25 05:30:44.630087 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 14/15] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 25 05:30:44 2021] GET /compute/v2.1/os-volumes/76bd7ce7-9999-4e73-81f2-11b5f999353f => generated 352 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:30:44.891375 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-baf94a20-b9e4-4e04-8a57-23188f8c121f tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.359557 Aug 25 05:30:44.892061 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 2/16] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 25 05:30:40 2021] POST /compute/v2.1/servers => generated 380 bytes in 4377 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 05:30:44.912659 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2a2372d8-2f36-4642-b731-586344e394b9 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:44.923164 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2a2372d8-2f36-4642-b731-586344e394b9 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:30:45.363240 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-2c11464c-651f-41de-9175-ce0062109195 tempest-VolumesTestJSON-1484470376 tempest-VolumesTestJSON-1484470376-project] Calling method '.version_select at 0x7f910c210af0>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:45.480672 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-2a2372d8-2f36-4642-b731-586344e394b9 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35da6a5109cb482bbf144927215467f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a213191904a64205b483c88adabf87a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:30:45.595610 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2a2372d8-2f36-4642-b731-586344e394b9 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d" status: 200 len: 1215 microversion: 2.1 time: 0.688200 Aug 25 05:30:45.616602 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 15/17] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:30:44 2021] GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d => generated 1215 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:30:45.649323 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f982892b-a3bd-4599-a5b8-a8a4fa3d3485 tempest-VolumesGetTestJSON-762507075 tempest-VolumesGetTestJSON-762507075-project] Calling method '.version_select at 0x7f910caddaf0>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:45.682162 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-2c11464c-651f-41de-9175-ce0062109195 tempest-VolumesTestJSON-1484470376 tempest-VolumesTestJSON-1484470376-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/79b34dc8-985b-44de-8b22-3ba491156298" status: 200 len: 350 microversion: 2.1 time: 0.325382 Aug 25 05:30:45.694176 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 3/18] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 25 05:30:45 2021] GET /compute/v2.1/os-volumes/79b34dc8-985b-44de-8b22-3ba491156298 => generated 350 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:30:45.791698 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.wsgi [None req-f982892b-a3bd-4599-a5b8-a8a4fa3d3485 tempest-VolumesGetTestJSON-762507075 tempest-VolumesGetTestJSON-762507075-project] HTTP exception thrown: Volume 76bd7ce7-9999-4e73-81f2-11b5f999353f could not be found. Aug 25 05:30:45.793756 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f982892b-a3bd-4599-a5b8-a8a4fa3d3485 tempest-VolumesGetTestJSON-762507075 tempest-VolumesGetTestJSON-762507075-project] Returning 404 to user: Volume 76bd7ce7-9999-4e73-81f2-11b5f999353f could not be found. {{(pid=108885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 05:30:45.795339 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f982892b-a3bd-4599-a5b8-a8a4fa3d3485 tempest-VolumesGetTestJSON-762507075 tempest-VolumesGetTestJSON-762507075-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/76bd7ce7-9999-4e73-81f2-11b5f999353f" status: 404 len: 109 microversion: 2.1 time: 0.154315 Aug 25 05:30:45.797161 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 16/19] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 25 05:30:45 2021] GET /compute/v2.1/os-volumes/76bd7ce7-9999-4e73-81f2-11b5f999353f => generated 109 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:30:46.631905 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-9d43ccad-85f5-4d48-b047-774799ec9b9c tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:46.635078 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-9d43ccad-85f5-4d48-b047-774799ec9b9c tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:30:46.856255 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-9d43ccad-85f5-4d48-b047-774799ec9b9c tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35da6a5109cb482bbf144927215467f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a213191904a64205b483c88adabf87a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:30:46.926592 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-9d43ccad-85f5-4d48-b047-774799ec9b9c tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d" status: 200 len: 1215 microversion: 2.1 time: 0.304862 Aug 25 05:30:46.949809 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 4/20] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:30:46 2021] GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d => generated 1215 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:30:47.972197 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-8a7d0e5f-b53a-419a-9d61-7a8b9230d42e tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:47.973200 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-8a7d0e5f-b53a-419a-9d61-7a8b9230d42e tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:30:48.382503 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-8a7d0e5f-b53a-419a-9d61-7a8b9230d42e tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35da6a5109cb482bbf144927215467f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a213191904a64205b483c88adabf87a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:30:48.432870 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-8a7d0e5f-b53a-419a-9d61-7a8b9230d42e tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d" status: 200 len: 1215 microversion: 2.1 time: 0.479825 Aug 25 05:30:48.450616 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 17/21] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:30:47 2021] GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d => generated 1215 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:30:48.468044 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b83a72a8-28e9-4302-961c-f93e0b4a276a tempest-VolumesTestJSON-1484470376 tempest-VolumesTestJSON-1484470376-project] Calling method '.version_select at 0x7f910c1888b0>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:48.796929 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b83a72a8-28e9-4302-961c-f93e0b4a276a tempest-VolumesTestJSON-1484470376 tempest-VolumesTestJSON-1484470376-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/94f78ae5-c7e7-4135-981a-ec4dee374c67" status: 200 len: 350 microversion: 2.1 time: 0.337261 Aug 25 05:30:48.798504 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 5/22] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 25 05:30:48 2021] GET /compute/v2.1/os-volumes/94f78ae5-c7e7-4135-981a-ec4dee374c67 => generated 350 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:30:48.809093 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7ff70ea5-58d5-4156-93b0-fe30c254c0a1 tempest-VolumesTestJSON-1484470376 tempest-VolumesTestJSON-1484470376-project] Calling method '.version_select at 0x7f910d467160>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:49.262583 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-7ff70ea5-58d5-4156-93b0-fe30c254c0a1 tempest-VolumesTestJSON-1484470376 tempest-VolumesTestJSON-1484470376-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.456625 Aug 25 05:30:49.264886 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 18/23] 10.222.0.42 () {58 vars in 1134 bytes} [Wed Aug 25 05:30:48 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:30:49.283742 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-f112001b-6eea-465a-b1c7-6eaa0e50b13c tempest-VolumesTestJSON-1484470376 tempest-VolumesTestJSON-1484470376-project] Calling method '.version_select at 0x7f910c1a0b80>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:49.469493 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2ce9fabd-9bba-47a7-bb58-5d6bd4a7a318 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:49.470987 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2ce9fabd-9bba-47a7-bb58-5d6bd4a7a318 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:30:49.487561 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2ce9fabd-9bba-47a7-bb58-5d6bd4a7a318 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:30:49.488737 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2ce9fabd-9bba-47a7-bb58-5d6bd4a7a318 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:30:49.490410 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2ce9fabd-9bba-47a7-bb58-5d6bd4a7a318 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:30:49.496059 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2ce9fabd-9bba-47a7-bb58-5d6bd4a7a318 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:30:49.665749 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-f112001b-6eea-465a-b1c7-6eaa0e50b13c tempest-VolumesTestJSON-1484470376 tempest-VolumesTestJSON-1484470376-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.390043 Aug 25 05:30:49.667228 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 6/24] 10.222.0.42 () {58 vars in 1149 bytes} [Wed Aug 25 05:30:49 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:30:49.682043 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-82ac4205-f680-40f8-b1db-f83bb448c051 tempest-VolumesTestJSON-1484470376 tempest-VolumesTestJSON-1484470376-project] Calling method '.version_select at 0x7f910c1af790>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:50.058168 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-82ac4205-f680-40f8-b1db-f83bb448c051 tempest-VolumesTestJSON-1484470376 tempest-VolumesTestJSON-1484470376-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.382574 Aug 25 05:30:50.059855 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 7/25] 10.222.0.42 () {58 vars in 1134 bytes} [Wed Aug 25 05:30:49 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:30:50.070256 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3be82398-7d30-46a5-bf39-a275159865dc tempest-VolumesTestJSON-1484470376 tempest-VolumesTestJSON-1484470376-project] Calling method '.version_select at 0x7f910c1a0790>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:50.215928 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-2ce9fabd-9bba-47a7-bb58-5d6bd4a7a318 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35da6a5109cb482bbf144927215467f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a213191904a64205b483c88adabf87a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:30:50.238998 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2ce9fabd-9bba-47a7-bb58-5d6bd4a7a318 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d" status: 200 len: 1219 microversion: 2.1 time: 0.776155 Aug 25 05:30:50.241925 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 19/26] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:30:49 2021] GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d => generated 1219 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:30:50.344496 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3be82398-7d30-46a5-bf39-a275159865dc tempest-VolumesTestJSON-1484470376 tempest-VolumesTestJSON-1484470376-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.277760 Aug 25 05:30:50.353117 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 8/27] 10.222.0.42 () {58 vars in 1167 bytes} [Wed Aug 25 05:30:50 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:30:50.360953 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b054fc82-5fce-4db5-8ee4-199ee25aa34c tempest-VolumesTestJSON-1484470376 tempest-VolumesTestJSON-1484470376-project] Calling method '.version_select at 0x7f910c9be820>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:50.670674 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b054fc82-5fce-4db5-8ee4-199ee25aa34c tempest-VolumesTestJSON-1484470376 tempest-VolumesTestJSON-1484470376-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.316624 Aug 25 05:30:50.672180 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 20/28] 10.222.0.42 () {58 vars in 1170 bytes} [Wed Aug 25 05:30:50 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:30:50.688441 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-72f3e6d8-176f-4224-aec6-57534d231e49 tempest-VolumesTestJSON-1484470376 tempest-VolumesTestJSON-1484470376-project] Calling method '.version_select at 0x7f910c1af820>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:50.918926 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-72f3e6d8-176f-4224-aec6-57534d231e49 tempest-VolumesTestJSON-1484470376 tempest-VolumesTestJSON-1484470376-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.234486 Aug 25 05:30:50.920061 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 9/29] 10.222.0.42 () {58 vars in 1155 bytes} [Wed Aug 25 05:30:50 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:30:50.934409 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1af64160-2858-4c3c-a61b-7100e59d039d tempest-VolumesTestJSON-1484470376 tempest-VolumesTestJSON-1484470376-project] Calling method '.version_select at 0x7f910c9c8820>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:51.180068 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1af64160-2858-4c3c-a61b-7100e59d039d tempest-VolumesTestJSON-1484470376 tempest-VolumesTestJSON-1484470376-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.249613 Aug 25 05:30:51.182343 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 21/30] 10.222.0.42 () {58 vars in 1188 bytes} [Wed Aug 25 05:30:50 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:30:51.198010 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-92b340cf-5e89-4607-9935-495e1a9dd252 tempest-VolumesTestJSON-1484470376 tempest-VolumesTestJSON-1484470376-project] Calling method '.version_select at 0x7f910c1b3550>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:51.258317 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5344a4f6-27ee-43bb-b2b4-cb519161bd74 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:51.258948 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5344a4f6-27ee-43bb-b2b4-cb519161bd74 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:30:51.272118 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5344a4f6-27ee-43bb-b2b4-cb519161bd74 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:30:51.273626 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5344a4f6-27ee-43bb-b2b4-cb519161bd74 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:30:51.274507 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5344a4f6-27ee-43bb-b2b4-cb519161bd74 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:30:51.276483 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5344a4f6-27ee-43bb-b2b4-cb519161bd74 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:30:51.417168 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-92b340cf-5e89-4607-9935-495e1a9dd252 tempest-VolumesTestJSON-1484470376 tempest-VolumesTestJSON-1484470376-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.227149 Aug 25 05:30:51.418546 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 10/31] 10.222.0.42 () {58 vars in 1155 bytes} [Wed Aug 25 05:30:51 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:30:51.449210 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-5344a4f6-27ee-43bb-b2b4-cb519161bd74 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35da6a5109cb482bbf144927215467f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a213191904a64205b483c88adabf87a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:30:51.470423 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5344a4f6-27ee-43bb-b2b4-cb519161bd74 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d" status: 200 len: 1267 microversion: 2.1 time: 0.211175 Aug 25 05:30:51.473071 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 22/32] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:30:51 2021] GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d => generated 1267 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:30:52.486786 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-876a1a7f-0237-4623-90c4-5616ee528d04 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:52.488983 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-876a1a7f-0237-4623-90c4-5616ee528d04 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:30:52.513435 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-876a1a7f-0237-4623-90c4-5616ee528d04 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:30:52.519837 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-876a1a7f-0237-4623-90c4-5616ee528d04 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:30:52.520798 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-876a1a7f-0237-4623-90c4-5616ee528d04 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:30:52.521258 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-876a1a7f-0237-4623-90c4-5616ee528d04 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:30:53.095762 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-876a1a7f-0237-4623-90c4-5616ee528d04 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35da6a5109cb482bbf144927215467f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a213191904a64205b483c88adabf87a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:30:53.123666 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-876a1a7f-0237-4623-90c4-5616ee528d04 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d" status: 200 len: 1273 microversion: 2.1 time: 0.643435 Aug 25 05:30:53.125100 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 11/33] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:30:52 2021] GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d => generated 1273 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:30:54.149475 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2eda9284-4176-4d37-9caa-19d6d27da14d tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:54.150873 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2eda9284-4176-4d37-9caa-19d6d27da14d tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:30:54.163005 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2eda9284-4176-4d37-9caa-19d6d27da14d tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:30:54.168914 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2eda9284-4176-4d37-9caa-19d6d27da14d tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:30:54.169807 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2eda9284-4176-4d37-9caa-19d6d27da14d tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:30:54.170260 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2eda9284-4176-4d37-9caa-19d6d27da14d tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:30:54.597647 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-2eda9284-4176-4d37-9caa-19d6d27da14d tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35da6a5109cb482bbf144927215467f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a213191904a64205b483c88adabf87a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:30:54.629470 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2eda9284-4176-4d37-9caa-19d6d27da14d tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d" status: 200 len: 1273 microversion: 2.1 time: 0.471914 Aug 25 05:30:54.636808 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 23/34] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:30:54 2021] GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d => generated 1273 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:30:55.544027 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-4a384da3-cfc7-4b0b-8b16-d86a4e470dee tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'create', calling method: .version_select at 0x7f910c1b39d0>, body: {"keypair": {"name": "tempest-keypair-1771237692"}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:30:56.100680 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-25aab1eb-e166-46cc-8d88-b5679e1cb042 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:56.100680 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-25aab1eb-e166-46cc-8d88-b5679e1cb042 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:30:56.100680 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-25aab1eb-e166-46cc-8d88-b5679e1cb042 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:30:56.114411 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.quota [None req-4a384da3-cfc7-4b0b-8b16-d86a4e470dee tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Getting quotas for project 5e7fcf565ddf46ac965eb3c7e878d4e5. Resources: {'key_pairs'} {{(pid=108884) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 05:30:56.116024 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-25aab1eb-e166-46cc-8d88-b5679e1cb042 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:30:56.116024 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-25aab1eb-e166-46cc-8d88-b5679e1cb042 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:30:56.116024 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-25aab1eb-e166-46cc-8d88-b5679e1cb042 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:30:56.118117 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.quota [None req-4a384da3-cfc7-4b0b-8b16-d86a4e470dee tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Getting quotas for user 0ef41c62efed49cf9dc642b659107e84 and project 5e7fcf565ddf46ac965eb3c7e878d4e5. Resources: {'key_pairs'} {{(pid=108884) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 05:30:56.118940 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-25aab1eb-e166-46cc-8d88-b5679e1cb042 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35da6a5109cb482bbf144927215467f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a213191904a64205b483c88adabf87a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:30:56.118940 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-25aab1eb-e166-46cc-8d88-b5679e1cb042 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d" status: 200 len: 1273 microversion: 2.1 time: 0.366841 Aug 25 05:30:56.118940 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 24/35] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:30:55 2021] GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d => generated 1273 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:30:56.273784 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.quota [None req-4a384da3-cfc7-4b0b-8b16-d86a4e470dee tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Getting quotas for project 5e7fcf565ddf46ac965eb3c7e878d4e5. Resources: {'key_pairs'} {{(pid=108884) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 05:30:56.285768 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.quota [None req-4a384da3-cfc7-4b0b-8b16-d86a4e470dee tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Getting quotas for user 0ef41c62efed49cf9dc642b659107e84 and project 5e7fcf565ddf46ac965eb3c7e878d4e5. Resources: {'key_pairs'} {{(pid=108884) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 05:30:56.358638 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-4a384da3-cfc7-4b0b-8b16-d86a4e470dee tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.439935 Aug 25 05:30:56.362555 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 12/36] 10.222.0.42 () {60 vars in 1158 bytes} [Wed Aug 25 05:30:54 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:30:57.044981 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-be67f66f-b228-4d7d-84ac-c2f15e05e159 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:57.050193 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-be67f66f-b228-4d7d-84ac-c2f15e05e159 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:30:57.075815 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-be67f66f-b228-4d7d-84ac-c2f15e05e159 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:30:57.077410 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-be67f66f-b228-4d7d-84ac-c2f15e05e159 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:30:57.081230 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-be67f66f-b228-4d7d-84ac-c2f15e05e159 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:30:57.081438 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-be67f66f-b228-4d7d-84ac-c2f15e05e159 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:30:57.224337 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-be67f66f-b228-4d7d-84ac-c2f15e05e159 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35da6a5109cb482bbf144927215467f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a213191904a64205b483c88adabf87a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:30:57.247765 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-be67f66f-b228-4d7d-84ac-c2f15e05e159 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d" status: 200 len: 1273 microversion: 2.1 time: 0.208445 Aug 25 05:30:57.251590 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 25/37] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:30:57 2021] GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d => generated 1273 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:30:58.270088 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-32ace068-5e9f-4143-882d-9371e97be680 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:58.275718 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-32ace068-5e9f-4143-882d-9371e97be680 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:30:58.294670 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-32ace068-5e9f-4143-882d-9371e97be680 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:30:58.295584 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-32ace068-5e9f-4143-882d-9371e97be680 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:30:58.309072 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-32ace068-5e9f-4143-882d-9371e97be680 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:30:58.312304 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-32ace068-5e9f-4143-882d-9371e97be680 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:30:59.218059 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-32ace068-5e9f-4143-882d-9371e97be680 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35da6a5109cb482bbf144927215467f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a213191904a64205b483c88adabf87a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:30:59.232744 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-32ace068-5e9f-4143-882d-9371e97be680 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d" status: 200 len: 1315 microversion: 2.1 time: 0.968335 Aug 25 05:30:59.233330 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 13/38] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:30:58 2021] GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d => generated 1315 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:00.250617 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-629defcf-a5b1-4535-85ac-a8fa957bac91 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:00.251420 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-629defcf-a5b1-4535-85ac-a8fa957bac91 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:00.266514 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-629defcf-a5b1-4535-85ac-a8fa957bac91 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:00.281923 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-629defcf-a5b1-4535-85ac-a8fa957bac91 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:00.306235 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-629defcf-a5b1-4535-85ac-a8fa957bac91 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:00.306235 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-629defcf-a5b1-4535-85ac-a8fa957bac91 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:00.895625 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-629defcf-a5b1-4535-85ac-a8fa957bac91 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35da6a5109cb482bbf144927215467f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a213191904a64205b483c88adabf87a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:00.908554 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-629defcf-a5b1-4535-85ac-a8fa957bac91 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d" status: 200 len: 1315 microversion: 2.1 time: 0.661466 Aug 25 05:31:00.909368 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 26/39] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:00 2021] GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d => generated 1315 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:01.928096 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c5db4431-487d-4342-8e61-76c14cbc91cf tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:01.928757 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c5db4431-487d-4342-8e61-76c14cbc91cf tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:01.935813 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c5db4431-487d-4342-8e61-76c14cbc91cf tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:01.936272 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c5db4431-487d-4342-8e61-76c14cbc91cf tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:01.937059 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c5db4431-487d-4342-8e61-76c14cbc91cf tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:01.937509 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c5db4431-487d-4342-8e61-76c14cbc91cf tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:02.388376 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-c5db4431-487d-4342-8e61-76c14cbc91cf tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35da6a5109cb482bbf144927215467f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a213191904a64205b483c88adabf87a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:02.405716 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c5db4431-487d-4342-8e61-76c14cbc91cf tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d" status: 200 len: 1315 microversion: 2.1 time: 0.475003 Aug 25 05:31:02.407510 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 14/40] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:01 2021] GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d => generated 1315 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:02.857416 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7f4e62ad-4fd2-47ee-a1af-1eaaf7b77324 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'create', calling method: .version_select at 0x7f910c9a3790>, body: {"keypair": {"name": "tempest-keypair-468200782"}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:31:03.009173 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.quota [None req-7f4e62ad-4fd2-47ee-a1af-1eaaf7b77324 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Getting quotas for project 8f18a68581ee4e5aa24440a7fd0389e3. Resources: {'key_pairs'} {{(pid=108885) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 05:31:03.024306 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.quota [None req-7f4e62ad-4fd2-47ee-a1af-1eaaf7b77324 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Getting quotas for user 416c753d158d492aba49e3e71db337f0 and project 8f18a68581ee4e5aa24440a7fd0389e3. Resources: {'key_pairs'} {{(pid=108885) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 05:31:03.431484 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-fac78205-2e02-4613-b9fa-a9608a8d3db4 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:03.432824 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-fac78205-2e02-4613-b9fa-a9608a8d3db4 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:03.441050 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fac78205-2e02-4613-b9fa-a9608a8d3db4 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:03.443212 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fac78205-2e02-4613-b9fa-a9608a8d3db4 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:03.444267 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fac78205-2e02-4613-b9fa-a9608a8d3db4 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:03.444893 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fac78205-2e02-4613-b9fa-a9608a8d3db4 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:03.898715 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-fac78205-2e02-4613-b9fa-a9608a8d3db4 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35da6a5109cb482bbf144927215467f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a213191904a64205b483c88adabf87a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:03.910628 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-fac78205-2e02-4613-b9fa-a9608a8d3db4 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d" status: 200 len: 1315 microversion: 2.1 time: 0.488768 Aug 25 05:31:03.920081 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 15/41] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:03 2021] GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d => generated 1315 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:04.819706 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.quota [None req-7f4e62ad-4fd2-47ee-a1af-1eaaf7b77324 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Getting quotas for project 8f18a68581ee4e5aa24440a7fd0389e3. Resources: {'key_pairs'} {{(pid=108885) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 05:31:04.831244 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.quota [None req-7f4e62ad-4fd2-47ee-a1af-1eaaf7b77324 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Getting quotas for user 416c753d158d492aba49e3e71db337f0 and project 8f18a68581ee4e5aa24440a7fd0389e3. Resources: {'key_pairs'} {{(pid=108885) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 05:31:04.872745 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-7f4e62ad-4fd2-47ee-a1af-1eaaf7b77324 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 2.250774 Aug 25 05:31:04.872745 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 27/42] 10.222.0.42 () {62 vars in 1199 bytes} [Wed Aug 25 05:31:02 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 2254 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Aug 25 05:31:04.873439 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-4a523410-7e81-486a-9021-a97d33ad0611 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-994365616", "imageRef": "05da2439-78f2-405c-b60a-89671b21a373", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6d57541d-9849-46de-909e-b153b2ed9e3b"}]}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:31:04.934327 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e7199675-a65c-492b-97e6-5569506d2634 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:04.935581 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e7199675-a65c-492b-97e6-5569506d2634 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:04.969150 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e7199675-a65c-492b-97e6-5569506d2634 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:04.969150 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e7199675-a65c-492b-97e6-5569506d2634 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:04.969150 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e7199675-a65c-492b-97e6-5569506d2634 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:04.969150 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e7199675-a65c-492b-97e6-5569506d2634 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:05.013478 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.network.neutron [None req-4a523410-7e81-486a-9021-a97d33ad0611 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] validate_networks() for [('6d57541d-9849-46de-909e-b153b2ed9e3b', None, None, None, None, None)] {{(pid=108884) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 25 05:31:05.961432 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-e7199675-a65c-492b-97e6-5569506d2634 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35da6a5109cb482bbf144927215467f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a213191904a64205b483c88adabf87a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:05.970467 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e7199675-a65c-492b-97e6-5569506d2634 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d" status: 200 len: 1315 microversion: 2.1 time: 1.042015 Aug 25 05:31:05.982917 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 28/43] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:04 2021] GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d => generated 1315 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:31:06.266150 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-02ae6acb-d1f8-4187-99e8-960448151bc4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-722341476", "imageRef": "05da2439-78f2-405c-b60a-89671b21a373", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b5e51dad-4162-4f64-b535-7085041e4335"}], "security_groups": [{"name": "tempest-securitygroup--1733103127"}], "key_name": "tempest-keypair-1771237692", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:31:06.510661 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.network.neutron [None req-02ae6acb-d1f8-4187-99e8-960448151bc4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] validate_networks() for [('b5e51dad-4162-4f64-b535-7085041e4335', None, None, None, None, None)] {{(pid=108885) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 25 05:31:06.667990 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-4a523410-7e81-486a-9021-a97d33ad0611 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Flavor limits 0:0:0 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 05:31:06.668573 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-4a523410-7e81-486a-9021-a97d33ad0611 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Image limits 0:0:0 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 05:31:06.668884 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-4a523410-7e81-486a-9021-a97d33ad0611 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Flavor pref 0:0:0 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 05:31:06.669622 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-4a523410-7e81-486a-9021-a97d33ad0611 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Image pref 0:0:0 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 05:31:06.670216 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-4a523410-7e81-486a-9021-a97d33ad0611 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 05:31:06.694018 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4a523410-7e81-486a-9021-a97d33ad0611 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:06.700439 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4a523410-7e81-486a-9021-a97d33ad0611 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:06.703652 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4a523410-7e81-486a-9021-a97d33ad0611 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:06.704411 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4a523410-7e81-486a-9021-a97d33ad0611 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:06.794847 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.quota [None req-4a523410-7e81-486a-9021-a97d33ad0611 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Getting quotas for project d16c6c79a221475cab1663aa9d6dd54a. Resources: {'ram', 'cores', 'instances'} {{(pid=108884) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 05:31:06.804555 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.quota [None req-4a523410-7e81-486a-9021-a97d33ad0611 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Getting quotas for user 8a37854279a342c7a02737a506cb3305 and project d16c6c79a221475cab1663aa9d6dd54a. Resources: {'ram', 'cores', 'instances'} {{(pid=108884) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 05:31:06.825664 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-4a523410-7e81-486a-9021-a97d33ad0611 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Going to run 1 instances... {{(pid=108884) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 25 05:31:06.842625 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-4a523410-7e81-486a-9021-a97d33ad0611 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05da2439-78f2-405c-b60a-89671b21a373',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 25 05:31:07.565432 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-02ae6acb-d1f8-4187-99e8-960448151bc4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Flavor limits 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 05:31:07.566567 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-02ae6acb-d1f8-4187-99e8-960448151bc4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Image limits 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 05:31:07.567283 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-02ae6acb-d1f8-4187-99e8-960448151bc4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Flavor pref 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 05:31:07.567861 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-02ae6acb-d1f8-4187-99e8-960448151bc4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Image pref 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 05:31:07.568632 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-02ae6acb-d1f8-4187-99e8-960448151bc4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 05:31:07.591235 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-02ae6acb-d1f8-4187-99e8-960448151bc4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:07.591847 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-02ae6acb-d1f8-4187-99e8-960448151bc4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:07.592844 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-02ae6acb-d1f8-4187-99e8-960448151bc4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:07.593287 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-02ae6acb-d1f8-4187-99e8-960448151bc4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:07.617338 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.quota [None req-02ae6acb-d1f8-4187-99e8-960448151bc4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Getting quotas for project 5e7fcf565ddf46ac965eb3c7e878d4e5. Resources: {'ram', 'cores', 'instances'} {{(pid=108885) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 05:31:07.625727 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.quota [None req-02ae6acb-d1f8-4187-99e8-960448151bc4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Getting quotas for user 0ef41c62efed49cf9dc642b659107e84 and project 5e7fcf565ddf46ac965eb3c7e878d4e5. Resources: {'ram', 'cores', 'instances'} {{(pid=108885) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 05:31:07.639332 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-02ae6acb-d1f8-4187-99e8-960448151bc4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Going to run 1 instances... {{(pid=108885) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 25 05:31:07.642391 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-02ae6acb-d1f8-4187-99e8-960448151bc4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05da2439-78f2-405c-b60a-89671b21a373',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 25 05:31:08.281236 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-4a523410-7e81-486a-9021-a97d33ad0611 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.220434 Aug 25 05:31:08.286144 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 16/44] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 25 05:31:04 2021] POST /compute/v2.1/servers => generated 383 bytes in 4231 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 05:31:08.292341 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3c96e65a-4c55-4906-81b4-2ed18ccf47fd tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:08.298744 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3c96e65a-4c55-4906-81b4-2ed18ccf47fd tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:08.316851 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3c96e65a-4c55-4906-81b4-2ed18ccf47fd tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:08.322140 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-02ae6acb-d1f8-4187-99e8-960448151bc4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.085012 Aug 25 05:31:08.324163 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 29/45] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 25 05:31:06 2021] POST /compute/v2.1/servers => generated 402 bytes in 2088 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 05:31:08.329781 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3c96e65a-4c55-4906-81b4-2ed18ccf47fd tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:08.330639 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3c96e65a-4c55-4906-81b4-2ed18ccf47fd tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:08.331245 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3c96e65a-4c55-4906-81b4-2ed18ccf47fd tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:08.331468 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7f845b36-680a-4dcd-ad91-44fc3e281f4a tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:08.332669 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-7f845b36-680a-4dcd-ad91-44fc3e281f4a tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:08.627292 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-7f845b36-680a-4dcd-ad91-44fc3e281f4a tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:08.634498 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-7f845b36-680a-4dcd-ad91-44fc3e281f4a tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1221 microversion: 2.1 time: 0.308631 Aug 25 05:31:08.643482 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 30/46] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:08 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1221 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:08.661474 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-dc26880c-edbc-4ef7-838e-1a454752ba35 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:08.665951 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-dc26880c-edbc-4ef7-838e-1a454752ba35 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:08.931788 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-dc26880c-edbc-4ef7-838e-1a454752ba35 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:08.958256 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-dc26880c-edbc-4ef7-838e-1a454752ba35 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1237 microversion: 2.1 time: 0.313047 Aug 25 05:31:08.959887 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 31/47] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:08 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1237 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:09.030223 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-3c96e65a-4c55-4906-81b4-2ed18ccf47fd tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35da6a5109cb482bbf144927215467f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a213191904a64205b483c88adabf87a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:09.038358 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3c96e65a-4c55-4906-81b4-2ed18ccf47fd tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d" status: 200 len: 1315 microversion: 2.1 time: 0.750322 Aug 25 05:31:09.044188 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 17/48] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:08 2021] GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d => generated 1315 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:09.177675 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-0848b365-bc72-4222-8fd2-95cc20d69368 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-748710972", "imageRef": "05da2439-78f2-405c-b60a-89671b21a373", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6d57541d-9849-46de-909e-b153b2ed9e3b"}]}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:31:09.266076 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.network.neutron [None req-0848b365-bc72-4222-8fd2-95cc20d69368 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] validate_networks() for [('6d57541d-9849-46de-909e-b153b2ed9e3b', None, None, None, None, None)] {{(pid=108884) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 25 05:31:09.553745 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [req-1473d0f1-8cc5-4adb-b32d-36643ecea2fe req-a6c09142-5731-4cec-b90b-a569cd43b04e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d7a5079-3e2a-4e51-ba95-5feb0d27b87d", "tag": "e5c62734-8dcc-4f75-a5c1-7470ccc335d9"}]} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:31:09.558683 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:31:09.558683 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: warnings.warn(msg) Aug 25 05:31:09.577426 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-1473d0f1-8cc5-4adb-b32d-36643ecea2fe req-a6c09142-5731-4cec-b90b-a569cd43b04e service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:09.578109 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-1473d0f1-8cc5-4adb-b32d-36643ecea2fe req-a6c09142-5731-4cec-b90b-a569cd43b04e service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:09.625458 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.compute.server_external_events [req-1473d0f1-8cc5-4adb-b32d-36643ecea2fe req-a6c09142-5731-4cec-b90b-a569cd43b04e service nova] Creating event network-changed:e5c62734-8dcc-4f75-a5c1-7470ccc335d9 for instance 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d on hv-cinder-78662 Aug 25 05:31:09.627331 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-1473d0f1-8cc5-4adb-b32d-36643ecea2fe req-a6c09142-5731-4cec-b90b-a569cd43b04e service nova] Acquired lock "compute-rpcapi-router" {{(pid=108885) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Aug 25 05:31:09.629956 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-35faebad-c634-4ce0-9436-ba21b6d31128 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:09.634788 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-35faebad-c634-4ce0-9436-ba21b6d31128 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:09.634788 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-35faebad-c634-4ce0-9436-ba21b6d31128 None None] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:09.634788 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-35faebad-c634-4ce0-9436-ba21b6d31128 None None] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:09.668099 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.compute.rpcapi [None req-35faebad-c634-4ce0-9436-ba21b6d31128 None None] Automatically selected compute RPC version 6.0 from minimum service version 57 Aug 25 05:31:09.672401 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-35faebad-c634-4ce0-9436-ba21b6d31128 None None] Releasing lock "compute-rpcapi-router" {{(pid=108885) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Aug 25 05:31:09.747284 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-35faebad-c634-4ce0-9436-ba21b6d31128 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.668026 Aug 25 05:31:09.748112 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 32/49] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:31:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:31:09.981399 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-41106b55-eb9c-45cc-ba26-044cf04ee341 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:09.982513 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-41106b55-eb9c-45cc-ba26-044cf04ee341 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:10.184758 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-41106b55-eb9c-45cc-ba26-044cf04ee341 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:10.195812 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-41106b55-eb9c-45cc-ba26-044cf04ee341 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1237 microversion: 2.1 time: 0.220610 Aug 25 05:31:10.229026 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 33/50] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:09 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1237 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:31:10.256786 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-95c4ffa7-9192-4e4f-9c82-5a9fa6b00262 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:10.275662 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-95c4ffa7-9192-4e4f-9c82-5a9fa6b00262 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:10.299940 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-95c4ffa7-9192-4e4f-9c82-5a9fa6b00262 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:10.300408 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-95c4ffa7-9192-4e4f-9c82-5a9fa6b00262 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:10.301202 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-95c4ffa7-9192-4e4f-9c82-5a9fa6b00262 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:10.301911 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-95c4ffa7-9192-4e4f-9c82-5a9fa6b00262 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:10.667080 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-0848b365-bc72-4222-8fd2-95cc20d69368 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Flavor limits 0:0:0 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 05:31:10.667722 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-0848b365-bc72-4222-8fd2-95cc20d69368 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Image limits 0:0:0 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 05:31:10.668142 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-0848b365-bc72-4222-8fd2-95cc20d69368 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Flavor pref 0:0:0 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 05:31:10.668786 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-0848b365-bc72-4222-8fd2-95cc20d69368 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Image pref 0:0:0 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 05:31:10.669299 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-0848b365-bc72-4222-8fd2-95cc20d69368 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 05:31:10.686044 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0848b365-bc72-4222-8fd2-95cc20d69368 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:10.686855 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0848b365-bc72-4222-8fd2-95cc20d69368 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:10.687966 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0848b365-bc72-4222-8fd2-95cc20d69368 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:10.688617 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0848b365-bc72-4222-8fd2-95cc20d69368 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:10.709331 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.quota [None req-0848b365-bc72-4222-8fd2-95cc20d69368 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Getting quotas for project d16c6c79a221475cab1663aa9d6dd54a. Resources: {'ram', 'cores', 'instances'} {{(pid=108884) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 05:31:10.714449 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.quota [None req-0848b365-bc72-4222-8fd2-95cc20d69368 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Getting quotas for user 8a37854279a342c7a02737a506cb3305 and project d16c6c79a221475cab1663aa9d6dd54a. Resources: {'ram', 'cores', 'instances'} {{(pid=108884) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 05:31:10.727722 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-0848b365-bc72-4222-8fd2-95cc20d69368 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Going to run 1 instances... {{(pid=108884) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 25 05:31:10.730779 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-0848b365-bc72-4222-8fd2-95cc20d69368 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05da2439-78f2-405c-b60a-89671b21a373',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 25 05:31:10.775620 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-95c4ffa7-9192-4e4f-9c82-5a9fa6b00262 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35da6a5109cb482bbf144927215467f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a213191904a64205b483c88adabf87a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:10.785431 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-95c4ffa7-9192-4e4f-9c82-5a9fa6b00262 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d" status: 200 len: 1315 microversion: 2.1 time: 0.560864 Aug 25 05:31:10.787203 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 34/51] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:10 2021] GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d => generated 1315 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:11.175813 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-0848b365-bc72-4222-8fd2-95cc20d69368 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.008356 Aug 25 05:31:11.176780 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 18/52] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 25 05:31:09 2021] POST /compute/v2.1/servers => generated 383 bytes in 2010 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 05:31:11.189037 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-fc329eca-6444-4a50-858b-9866f1a63fcb tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:11.197135 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-fc329eca-6444-4a50-858b-9866f1a63fcb tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:11.234226 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-f4ec45f1-ec17-411b-b81e-637d60318eac tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:11.245276 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-f4ec45f1-ec17-411b-b81e-637d60318eac tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:11.269989 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f4ec45f1-ec17-411b-b81e-637d60318eac tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:11.272216 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f4ec45f1-ec17-411b-b81e-637d60318eac tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:11.318132 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f4ec45f1-ec17-411b-b81e-637d60318eac tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:11.318921 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f4ec45f1-ec17-411b-b81e-637d60318eac tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:11.383884 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-fc329eca-6444-4a50-858b-9866f1a63fcb tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:11.395542 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-fc329eca-6444-4a50-858b-9866f1a63fcb tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1221 microversion: 2.1 time: 0.209713 Aug 25 05:31:11.396811 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 35/53] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:11 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1221 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:11.495828 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-f4ec45f1-ec17-411b-b81e-637d60318eac tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:11.504656 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-f4ec45f1-ec17-411b-b81e-637d60318eac tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1241 microversion: 2.1 time: 0.292238 Aug 25 05:31:11.512297 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 19/54] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:11 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1241 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:11.805746 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f3161ae6-9e18-42fe-91ec-a9b25eaa2383 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:11.806358 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f3161ae6-9e18-42fe-91ec-a9b25eaa2383 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:11.812322 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f3161ae6-9e18-42fe-91ec-a9b25eaa2383 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:11.812846 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f3161ae6-9e18-42fe-91ec-a9b25eaa2383 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:11.813784 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f3161ae6-9e18-42fe-91ec-a9b25eaa2383 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:11.814225 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f3161ae6-9e18-42fe-91ec-a9b25eaa2383 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:11.946380 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-f3161ae6-9e18-42fe-91ec-a9b25eaa2383 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35da6a5109cb482bbf144927215467f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a213191904a64205b483c88adabf87a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:11.953512 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f3161ae6-9e18-42fe-91ec-a9b25eaa2383 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d" status: 200 len: 1315 microversion: 2.1 time: 0.152246 Aug 25 05:31:11.954144 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 36/55] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:11 2021] GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:12.414967 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5bd3b083-7a14-45b6-89d7-6dc8ada87d09 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:12.416433 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5bd3b083-7a14-45b6-89d7-6dc8ada87d09 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:12.468522 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-5bd3b083-7a14-45b6-89d7-6dc8ada87d09 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:12.478544 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5bd3b083-7a14-45b6-89d7-6dc8ada87d09 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1221 microversion: 2.1 time: 0.065160 Aug 25 05:31:12.478544 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 20/56] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:12 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1221 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:12.530482 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6c9f0b82-7002-4a33-8481-a428d6f01489 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:12.538239 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6c9f0b82-7002-4a33-8481-a428d6f01489 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:12.544770 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6c9f0b82-7002-4a33-8481-a428d6f01489 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:12.545214 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6c9f0b82-7002-4a33-8481-a428d6f01489 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:12.546014 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6c9f0b82-7002-4a33-8481-a428d6f01489 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:12.546446 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6c9f0b82-7002-4a33-8481-a428d6f01489 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:12.652334 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-6c9f0b82-7002-4a33-8481-a428d6f01489 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:12.659739 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6c9f0b82-7002-4a33-8481-a428d6f01489 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1241 microversion: 2.1 time: 0.132921 Aug 25 05:31:12.671161 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 37/57] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:12 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1241 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:12.971452 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-65a24084-ad6b-42d3-a59b-069d304a5221 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:12.972062 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-65a24084-ad6b-42d3-a59b-069d304a5221 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:12.978220 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-65a24084-ad6b-42d3-a59b-069d304a5221 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:12.978664 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-65a24084-ad6b-42d3-a59b-069d304a5221 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:12.979428 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-65a24084-ad6b-42d3-a59b-069d304a5221 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:12.979865 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-65a24084-ad6b-42d3-a59b-069d304a5221 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:13.170265 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-65a24084-ad6b-42d3-a59b-069d304a5221 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35da6a5109cb482bbf144927215467f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a213191904a64205b483c88adabf87a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:13.180500 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-65a24084-ad6b-42d3-a59b-069d304a5221 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d" status: 200 len: 1315 microversion: 2.1 time: 0.211985 Aug 25 05:31:13.181661 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 21/58] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:12 2021] GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:13.329229 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-386be8d3-9304-45ba-8368-c18198e647b4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1443531807", "imageRef": "05da2439-78f2-405c-b60a-89671b21a373", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dab4c80c-fdc3-4a74-bd40-de374e58701b"}], "security_groups": [{"name": "tempest-securitygroup--1269597787"}], "key_name": "tempest-keypair-468200782", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:31:13.428913 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.network.neutron [None req-386be8d3-9304-45ba-8368-c18198e647b4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] validate_networks() for [('dab4c80c-fdc3-4a74-bd40-de374e58701b', None, None, None, None, None)] {{(pid=108885) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 25 05:31:13.494656 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-13b66714-44ee-4a70-949e-ba968691b62d tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:13.496018 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-13b66714-44ee-4a70-949e-ba968691b62d tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:13.502235 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-13b66714-44ee-4a70-949e-ba968691b62d tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:13.503039 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-13b66714-44ee-4a70-949e-ba968691b62d tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:13.504008 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-13b66714-44ee-4a70-949e-ba968691b62d tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:13.504811 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-13b66714-44ee-4a70-949e-ba968691b62d tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:13.600031 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-13b66714-44ee-4a70-949e-ba968691b62d tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:13.609707 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-13b66714-44ee-4a70-949e-ba968691b62d tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1225 microversion: 2.1 time: 0.119710 Aug 25 05:31:13.610289 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 22/59] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:13 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1225 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:13.677875 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c10146a6-a624-4ea2-926c-df636cb34079 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:13.678504 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c10146a6-a624-4ea2-926c-df636cb34079 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:13.685448 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c10146a6-a624-4ea2-926c-df636cb34079 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:13.685820 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c10146a6-a624-4ea2-926c-df636cb34079 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:13.686844 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c10146a6-a624-4ea2-926c-df636cb34079 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:13.687287 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c10146a6-a624-4ea2-926c-df636cb34079 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:13.781517 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-c10146a6-a624-4ea2-926c-df636cb34079 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:13.790024 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c10146a6-a624-4ea2-926c-df636cb34079 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1241 microversion: 2.1 time: 0.115355 Aug 25 05:31:13.791186 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 23/60] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:13 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1241 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:31:13.923041 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-386be8d3-9304-45ba-8368-c18198e647b4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Flavor limits 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 05:31:13.923487 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-386be8d3-9304-45ba-8368-c18198e647b4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Image limits 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 05:31:13.923999 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-386be8d3-9304-45ba-8368-c18198e647b4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Flavor pref 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 05:31:13.924412 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-386be8d3-9304-45ba-8368-c18198e647b4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Image pref 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 05:31:13.924839 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-386be8d3-9304-45ba-8368-c18198e647b4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 05:31:13.933792 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-386be8d3-9304-45ba-8368-c18198e647b4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:13.934439 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-386be8d3-9304-45ba-8368-c18198e647b4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:13.935231 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-386be8d3-9304-45ba-8368-c18198e647b4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:13.935923 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-386be8d3-9304-45ba-8368-c18198e647b4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:13.952756 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.quota [None req-386be8d3-9304-45ba-8368-c18198e647b4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Getting quotas for project 8f18a68581ee4e5aa24440a7fd0389e3. Resources: {'ram', 'cores', 'instances'} {{(pid=108885) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 05:31:13.956857 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.quota [None req-386be8d3-9304-45ba-8368-c18198e647b4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Getting quotas for user 416c753d158d492aba49e3e71db337f0 and project 8f18a68581ee4e5aa24440a7fd0389e3. Resources: {'ram', 'cores', 'instances'} {{(pid=108885) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 05:31:13.971180 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-386be8d3-9304-45ba-8368-c18198e647b4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Going to run 1 instances... {{(pid=108885) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 25 05:31:13.974605 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-386be8d3-9304-45ba-8368-c18198e647b4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05da2439-78f2-405c-b60a-89671b21a373',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 25 05:31:14.168175 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-386be8d3-9304-45ba-8368-c18198e647b4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.843026 Aug 25 05:31:14.169244 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 38/61] 10.222.0.42 () {62 vars in 1188 bytes} [Wed Aug 25 05:31:13 2021] POST /compute/v2.1/servers => generated 402 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 25 05:31:14.179901 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-f8a2077e-2c95-416f-adef-3a4a91e9c436 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:14.181118 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-f8a2077e-2c95-416f-adef-3a4a91e9c436 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:14.198543 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6ed91d5e-c92b-4c22-8352-6531db61116f tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:14.199980 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6ed91d5e-c92b-4c22-8352-6531db61116f tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:14.210058 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6ed91d5e-c92b-4c22-8352-6531db61116f tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:14.215636 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6ed91d5e-c92b-4c22-8352-6531db61116f tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:14.215636 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6ed91d5e-c92b-4c22-8352-6531db61116f tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:14.215636 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6ed91d5e-c92b-4c22-8352-6531db61116f tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:14.270291 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-f8a2077e-2c95-416f-adef-3a4a91e9c436 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:14.283779 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-f8a2077e-2c95-416f-adef-3a4a91e9c436 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:14.287924 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-f8a2077e-2c95-416f-adef-3a4a91e9c436 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:14.289285 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-f8a2077e-2c95-416f-adef-3a4a91e9c436 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1281 microversion: 2.20 time: 0.112905 Aug 25 05:31:14.290371 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 24/62] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:31:14 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1281 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:31:14.396466 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-6ed91d5e-c92b-4c22-8352-6531db61116f tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35da6a5109cb482bbf144927215467f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a213191904a64205b483c88adabf87a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:14.405137 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6ed91d5e-c92b-4c22-8352-6531db61116f tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d" status: 200 len: 1315 microversion: 2.1 time: 0.211410 Aug 25 05:31:14.405800 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 39/63] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:14 2021] GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:31:14.627335 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ad2ac81c-d7af-4f86-9db5-e83c95a65a26 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:14.627952 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ad2ac81c-d7af-4f86-9db5-e83c95a65a26 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:14.635061 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ad2ac81c-d7af-4f86-9db5-e83c95a65a26 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:14.635513 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ad2ac81c-d7af-4f86-9db5-e83c95a65a26 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:14.636496 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ad2ac81c-d7af-4f86-9db5-e83c95a65a26 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:14.637018 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ad2ac81c-d7af-4f86-9db5-e83c95a65a26 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:14.704538 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ad2ac81c-d7af-4f86-9db5-e83c95a65a26 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:14.712459 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ad2ac81c-d7af-4f86-9db5-e83c95a65a26 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1225 microversion: 2.1 time: 0.088734 Aug 25 05:31:14.715948 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 25/64] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:14 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:14.809812 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-76b2340c-8347-4c0d-9b21-4b12da0e0b50 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:14.810438 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-76b2340c-8347-4c0d-9b21-4b12da0e0b50 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:14.822621 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-76b2340c-8347-4c0d-9b21-4b12da0e0b50 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:14.823469 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-76b2340c-8347-4c0d-9b21-4b12da0e0b50 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:14.824326 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-76b2340c-8347-4c0d-9b21-4b12da0e0b50 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:14.824917 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-76b2340c-8347-4c0d-9b21-4b12da0e0b50 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:14.890730 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-76b2340c-8347-4c0d-9b21-4b12da0e0b50 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:14.898987 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-76b2340c-8347-4c0d-9b21-4b12da0e0b50 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1241 microversion: 2.1 time: 0.095072 Aug 25 05:31:14.901707 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 40/65] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:14 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1241 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:15.308895 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-26987f30-30b1-4e6c-bc79-26cf373ae2cf tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:15.309611 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-26987f30-30b1-4e6c-bc79-26cf373ae2cf tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:15.395257 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-26987f30-30b1-4e6c-bc79-26cf373ae2cf tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:15.404803 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-26987f30-30b1-4e6c-bc79-26cf373ae2cf tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:15.407046 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-26987f30-30b1-4e6c-bc79-26cf373ae2cf tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:15.408633 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-26987f30-30b1-4e6c-bc79-26cf373ae2cf tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1281 microversion: 2.20 time: 0.104348 Aug 25 05:31:15.409751 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 26/66] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:31:15 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1281 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:31:15.422536 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f5401690-fd14-4d4d-ab6a-daf1fcf025ee tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:15.432300 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f5401690-fd14-4d4d-ab6a-daf1fcf025ee tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:15.432300 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f5401690-fd14-4d4d-ab6a-daf1fcf025ee tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:15.432300 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f5401690-fd14-4d4d-ab6a-daf1fcf025ee tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:15.432300 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f5401690-fd14-4d4d-ab6a-daf1fcf025ee tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:15.433092 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f5401690-fd14-4d4d-ab6a-daf1fcf025ee tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:15.565629 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-f5401690-fd14-4d4d-ab6a-daf1fcf025ee tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35da6a5109cb482bbf144927215467f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a213191904a64205b483c88adabf87a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:15.575524 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f5401690-fd14-4d4d-ab6a-daf1fcf025ee tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d" status: 200 len: 1315 microversion: 2.1 time: 0.156713 Aug 25 05:31:15.587051 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 41/67] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:15 2021] GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:15.731373 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a343d987-c1e6-4c5d-8997-1d0d6822827b tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:15.733420 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a343d987-c1e6-4c5d-8997-1d0d6822827b tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:15.765630 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a343d987-c1e6-4c5d-8997-1d0d6822827b tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:15.770983 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a343d987-c1e6-4c5d-8997-1d0d6822827b tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:15.772056 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a343d987-c1e6-4c5d-8997-1d0d6822827b tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:15.772933 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a343d987-c1e6-4c5d-8997-1d0d6822827b tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:15.866075 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-a343d987-c1e6-4c5d-8997-1d0d6822827b tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:15.875325 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a343d987-c1e6-4c5d-8997-1d0d6822827b tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1217 microversion: 2.1 time: 0.149118 Aug 25 05:31:15.887465 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 27/68] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:15 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1217 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:15.918215 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-424ff708-5bf1-4b35-976d-5ea57b5b3df8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:15.919117 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-424ff708-5bf1-4b35-976d-5ea57b5b3df8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:15.930502 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-424ff708-5bf1-4b35-976d-5ea57b5b3df8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:15.932423 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-424ff708-5bf1-4b35-976d-5ea57b5b3df8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:15.933590 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-424ff708-5bf1-4b35-976d-5ea57b5b3df8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:15.935591 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-424ff708-5bf1-4b35-976d-5ea57b5b3df8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:16.079155 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-424ff708-5bf1-4b35-976d-5ea57b5b3df8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:16.091787 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-424ff708-5bf1-4b35-976d-5ea57b5b3df8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1233 microversion: 2.1 time: 0.175313 Aug 25 05:31:16.093573 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 42/69] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:15 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1233 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:16.428019 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-548375d9-23e1-4084-8b6b-9c19bdf9a854 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:16.432194 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-548375d9-23e1-4084-8b6b-9c19bdf9a854 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:16.435061 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-548375d9-23e1-4084-8b6b-9c19bdf9a854 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:16.435514 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-548375d9-23e1-4084-8b6b-9c19bdf9a854 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:16.436308 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-548375d9-23e1-4084-8b6b-9c19bdf9a854 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:16.436740 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-548375d9-23e1-4084-8b6b-9c19bdf9a854 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:16.501994 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-548375d9-23e1-4084-8b6b-9c19bdf9a854 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:16.521053 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-548375d9-23e1-4084-8b6b-9c19bdf9a854 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:16.527393 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-548375d9-23e1-4084-8b6b-9c19bdf9a854 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:16.528958 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-548375d9-23e1-4084-8b6b-9c19bdf9a854 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1285 microversion: 2.20 time: 0.100278 Aug 25 05:31:16.530365 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 28/70] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:31:16 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:31:16.594473 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-90ff7a39-e9c0-475e-99c3-fa65a345b334 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:16.595080 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-90ff7a39-e9c0-475e-99c3-fa65a345b334 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:16.611878 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-90ff7a39-e9c0-475e-99c3-fa65a345b334 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:16.612725 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-90ff7a39-e9c0-475e-99c3-fa65a345b334 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:16.614263 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-90ff7a39-e9c0-475e-99c3-fa65a345b334 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:16.614851 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-90ff7a39-e9c0-475e-99c3-fa65a345b334 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:16.767223 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-90ff7a39-e9c0-475e-99c3-fa65a345b334 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35da6a5109cb482bbf144927215467f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a213191904a64205b483c88adabf87a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:16.775456 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-90ff7a39-e9c0-475e-99c3-fa65a345b334 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d" status: 200 len: 1315 microversion: 2.1 time: 0.186352 Aug 25 05:31:16.781766 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 43/71] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:16 2021] GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:16.894942 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-07212577-fd0f-4ce9-a421-9b133d1221db tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:16.895590 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-07212577-fd0f-4ce9-a421-9b133d1221db tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:16.910223 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-07212577-fd0f-4ce9-a421-9b133d1221db tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:16.919598 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-07212577-fd0f-4ce9-a421-9b133d1221db tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:16.919598 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-07212577-fd0f-4ce9-a421-9b133d1221db tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:16.919598 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-07212577-fd0f-4ce9-a421-9b133d1221db tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:16.998400 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-07212577-fd0f-4ce9-a421-9b133d1221db tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:17.006204 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-07212577-fd0f-4ce9-a421-9b133d1221db tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1273 microversion: 2.1 time: 0.115750 Aug 25 05:31:17.007033 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 29/72] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:16 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1273 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:17.112148 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-3e1c372b-506c-4e16-adb9-23bc34b71284 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:17.112987 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-3e1c372b-506c-4e16-adb9-23bc34b71284 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:17.119926 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3e1c372b-506c-4e16-adb9-23bc34b71284 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:17.120385 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3e1c372b-506c-4e16-adb9-23bc34b71284 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:17.121344 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3e1c372b-506c-4e16-adb9-23bc34b71284 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:17.121953 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3e1c372b-506c-4e16-adb9-23bc34b71284 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:17.189679 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-3e1c372b-506c-4e16-adb9-23bc34b71284 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:17.195879 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-3e1c372b-506c-4e16-adb9-23bc34b71284 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1233 microversion: 2.1 time: 0.086672 Aug 25 05:31:17.205675 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 44/73] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:17 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1233 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:17.549841 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-80dc9a43-06cb-470d-940c-aac8d30f8cac tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:17.550449 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-80dc9a43-06cb-470d-940c-aac8d30f8cac tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:17.561222 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-80dc9a43-06cb-470d-940c-aac8d30f8cac tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:17.561708 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-80dc9a43-06cb-470d-940c-aac8d30f8cac tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:17.562495 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-80dc9a43-06cb-470d-940c-aac8d30f8cac tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:17.572959 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-80dc9a43-06cb-470d-940c-aac8d30f8cac tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:17.661393 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-80dc9a43-06cb-470d-940c-aac8d30f8cac tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:17.671102 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-80dc9a43-06cb-470d-940c-aac8d30f8cac tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:17.673371 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-80dc9a43-06cb-470d-940c-aac8d30f8cac tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:17.674746 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-80dc9a43-06cb-470d-940c-aac8d30f8cac tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1277 microversion: 2.20 time: 0.128623 Aug 25 05:31:17.675750 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 30/74] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:31:17 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1277 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:31:17.792732 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c5067147-6c0f-4a76-8e32-4549cbc82041 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:17.793336 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c5067147-6c0f-4a76-8e32-4549cbc82041 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:17.807025 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c5067147-6c0f-4a76-8e32-4549cbc82041 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:17.807806 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c5067147-6c0f-4a76-8e32-4549cbc82041 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:17.808277 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c5067147-6c0f-4a76-8e32-4549cbc82041 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:17.808810 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c5067147-6c0f-4a76-8e32-4549cbc82041 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:18.024766 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-188a6d51-a235-4c0e-8946-c04d200a9cfb tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:18.025561 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-188a6d51-a235-4c0e-8946-c04d200a9cfb tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:18.034716 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-188a6d51-a235-4c0e-8946-c04d200a9cfb tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:18.035870 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-188a6d51-a235-4c0e-8946-c04d200a9cfb tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:18.041302 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-188a6d51-a235-4c0e-8946-c04d200a9cfb tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:18.042787 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-188a6d51-a235-4c0e-8946-c04d200a9cfb tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:18.377960 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-188a6d51-a235-4c0e-8946-c04d200a9cfb tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:18.378988 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-c5067147-6c0f-4a76-8e32-4549cbc82041 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35da6a5109cb482bbf144927215467f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a213191904a64205b483c88adabf87a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:18.387398 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c5067147-6c0f-4a76-8e32-4549cbc82041 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d" status: 200 len: 1315 microversion: 2.1 time: 0.598580 Aug 25 05:31:18.391761 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-188a6d51-a235-4c0e-8946-c04d200a9cfb tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1291 microversion: 2.1 time: 0.371251 Aug 25 05:31:18.392002 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 45/75] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:17 2021] GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d => generated 1315 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:18.393002 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 31/76] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:18 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1291 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:18.406807 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-afc1c717-2972-4566-b58b-d78f2d395dfe tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:18.407522 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-afc1c717-2972-4566-b58b-d78f2d395dfe tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:18.413592 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-afc1c717-2972-4566-b58b-d78f2d395dfe tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:18.415776 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-afc1c717-2972-4566-b58b-d78f2d395dfe tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:18.415776 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-afc1c717-2972-4566-b58b-d78f2d395dfe tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:18.416298 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-afc1c717-2972-4566-b58b-d78f2d395dfe tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:18.501220 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-afc1c717-2972-4566-b58b-d78f2d395dfe tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:18.537455 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-afc1c717-2972-4566-b58b-d78f2d395dfe tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1289 microversion: 2.1 time: 0.141427 Aug 25 05:31:18.548166 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 46/77] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:18 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1289 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:18.699213 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-228f5655-d068-40ca-af00-1838965d6af9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:18.700212 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-228f5655-d068-40ca-af00-1838965d6af9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:18.714561 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-228f5655-d068-40ca-af00-1838965d6af9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:18.722578 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-228f5655-d068-40ca-af00-1838965d6af9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:18.722578 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-228f5655-d068-40ca-af00-1838965d6af9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:18.722578 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-228f5655-d068-40ca-af00-1838965d6af9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:18.843021 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-228f5655-d068-40ca-af00-1838965d6af9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:18.853445 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-228f5655-d068-40ca-af00-1838965d6af9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:18.855284 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-228f5655-d068-40ca-af00-1838965d6af9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:18.856472 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-228f5655-d068-40ca-af00-1838965d6af9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1333 microversion: 2.20 time: 0.163808 Aug 25 05:31:18.857510 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 32/78] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:31:18 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1333 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:31:19.412518 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-07372346-3c15-4db4-89e0-84329635461f tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:19.413337 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-21b626e8-4865-444f-b54d-d5c54cc65d58 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:19.413777 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-07372346-3c15-4db4-89e0-84329635461f tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:19.415581 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-21b626e8-4865-444f-b54d-d5c54cc65d58 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:19.427584 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-21b626e8-4865-444f-b54d-d5c54cc65d58 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:19.427936 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-21b626e8-4865-444f-b54d-d5c54cc65d58 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:19.431684 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-21b626e8-4865-444f-b54d-d5c54cc65d58 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:19.432145 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-21b626e8-4865-444f-b54d-d5c54cc65d58 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:19.436541 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-07372346-3c15-4db4-89e0-84329635461f tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:19.437292 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-07372346-3c15-4db4-89e0-84329635461f tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:19.439555 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-07372346-3c15-4db4-89e0-84329635461f tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:19.440747 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-07372346-3c15-4db4-89e0-84329635461f tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:19.667390 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-21b626e8-4865-444f-b54d-d5c54cc65d58 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:19.693677 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-21b626e8-4865-444f-b54d-d5c54cc65d58 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1279 microversion: 2.1 time: 0.285129 Aug 25 05:31:19.705210 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 47/79] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:19 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1279 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:19.711321 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ed4db14a-2e33-4c36-9ea3-584c0445e10b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:19.712257 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ed4db14a-2e33-4c36-9ea3-584c0445e10b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:19.721787 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ed4db14a-2e33-4c36-9ea3-584c0445e10b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:19.722754 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ed4db14a-2e33-4c36-9ea3-584c0445e10b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:19.739047 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ed4db14a-2e33-4c36-9ea3-584c0445e10b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:19.739047 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ed4db14a-2e33-4c36-9ea3-584c0445e10b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:19.963419 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ed4db14a-2e33-4c36-9ea3-584c0445e10b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:19.990982 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-07372346-3c15-4db4-89e0-84329635461f tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35da6a5109cb482bbf144927215467f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a213191904a64205b483c88adabf87a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:20.006386 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ed4db14a-2e33-4c36-9ea3-584c0445e10b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1295 microversion: 2.1 time: 0.298415 Aug 25 05:31:20.009505 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 48/80] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:19 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1295 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:20.024225 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-07372346-3c15-4db4-89e0-84329635461f tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d" status: 200 len: 1315 microversion: 2.1 time: 0.615378 Aug 25 05:31:20.025089 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 33/81] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:19 2021] GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d => generated 1315 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:20.031306 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [req-77ef8315-f93a-4624-9f20-5cd8ffa53c12 req-719875d0-6228-4862-aa76-b6de80e1cf15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2163e566-1832-40df-8925-09e54ae2974c", "tag": "23c47dd6-b4d5-452b-8959-9becb9c14cae"}]} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:31:20.033640 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:31:20.033640 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: warnings.warn(msg) Aug 25 05:31:20.036278 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2f5c690b-2269-4fea-b065-e76f6963f0ef tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:20.038324 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2f5c690b-2269-4fea-b065-e76f6963f0ef tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:20.048698 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-77ef8315-f93a-4624-9f20-5cd8ffa53c12 req-719875d0-6228-4862-aa76-b6de80e1cf15 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:20.049214 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-77ef8315-f93a-4624-9f20-5cd8ffa53c12 req-719875d0-6228-4862-aa76-b6de80e1cf15 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:20.053666 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2f5c690b-2269-4fea-b065-e76f6963f0ef tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:20.055619 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2f5c690b-2269-4fea-b065-e76f6963f0ef tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:20.057288 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2f5c690b-2269-4fea-b065-e76f6963f0ef tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:20.058296 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2f5c690b-2269-4fea-b065-e76f6963f0ef tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:20.078624 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.compute.server_external_events [req-77ef8315-f93a-4624-9f20-5cd8ffa53c12 req-719875d0-6228-4862-aa76-b6de80e1cf15 service nova] Creating event network-changed:23c47dd6-b4d5-452b-8959-9becb9c14cae for instance 2163e566-1832-40df-8925-09e54ae2974c on hv-cinder-78662 Aug 25 05:31:20.079260 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-77ef8315-f93a-4624-9f20-5cd8ffa53c12 req-719875d0-6228-4862-aa76-b6de80e1cf15 service nova] Acquired lock "compute-rpcapi-router" {{(pid=108884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Aug 25 05:31:20.080476 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-88a3cc5e-290f-4c0b-9b94-c4975279c948 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:20.081036 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-88a3cc5e-290f-4c0b-9b94-c4975279c948 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:20.084373 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-88a3cc5e-290f-4c0b-9b94-c4975279c948 None None] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:20.085207 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-88a3cc5e-290f-4c0b-9b94-c4975279c948 None None] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:20.105171 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.compute.rpcapi [None req-88a3cc5e-290f-4c0b-9b94-c4975279c948 None None] Automatically selected compute RPC version 6.0 from minimum service version 57 Aug 25 05:31:20.106355 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-88a3cc5e-290f-4c0b-9b94-c4975279c948 None None] Releasing lock "compute-rpcapi-router" {{(pid=108884) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Aug 25 05:31:20.168818 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-88a3cc5e-290f-4c0b-9b94-c4975279c948 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141358 Aug 25 05:31:20.170357 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 34/82] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:31:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:31:20.196195 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-2f5c690b-2269-4fea-b065-e76f6963f0ef tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:20.206983 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-2f5c690b-2269-4fea-b065-e76f6963f0ef tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:20.208491 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-2f5c690b-2269-4fea-b065-e76f6963f0ef tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:20.209636 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2f5c690b-2269-4fea-b065-e76f6963f0ef tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1339 microversion: 2.20 time: 0.196943 Aug 25 05:31:20.210196 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 49/83] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:31:20 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1339 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:31:20.716335 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-2522c327-6467-4b29-802a-9e07eeea2a64 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:20.717704 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-2522c327-6467-4b29-802a-9e07eeea2a64 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:20.731282 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2522c327-6467-4b29-802a-9e07eeea2a64 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:20.732273 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2522c327-6467-4b29-802a-9e07eeea2a64 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:20.734345 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2522c327-6467-4b29-802a-9e07eeea2a64 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:20.734641 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2522c327-6467-4b29-802a-9e07eeea2a64 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:21.030727 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d6f82d4d-a7bc-47d8-b9cc-f318deaeac95 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:21.033409 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d6f82d4d-a7bc-47d8-b9cc-f318deaeac95 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:21.046762 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d6f82d4d-a7bc-47d8-b9cc-f318deaeac95 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:21.047352 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d6f82d4d-a7bc-47d8-b9cc-f318deaeac95 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:21.048239 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d6f82d4d-a7bc-47d8-b9cc-f318deaeac95 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:21.049195 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d6f82d4d-a7bc-47d8-b9cc-f318deaeac95 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:21.087048 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-2522c327-6467-4b29-802a-9e07eeea2a64 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:21.097200 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-2522c327-6467-4b29-802a-9e07eeea2a64 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1321 microversion: 2.1 time: 0.388316 Aug 25 05:31:21.097822 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 35/84] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:20 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1321 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:21.126422 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-72d135fa-781a-45b1-a74f-e1280b2ad533 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:21.127047 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-72d135fa-781a-45b1-a74f-e1280b2ad533 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:21.134484 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-72d135fa-781a-45b1-a74f-e1280b2ad533 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:21.140315 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-72d135fa-781a-45b1-a74f-e1280b2ad533 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:21.141761 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-72d135fa-781a-45b1-a74f-e1280b2ad533 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:21.142458 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-72d135fa-781a-45b1-a74f-e1280b2ad533 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:21.376507 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d6f82d4d-a7bc-47d8-b9cc-f318deaeac95 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:21.390862 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d6f82d4d-a7bc-47d8-b9cc-f318deaeac95 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1363 microversion: 2.1 time: 0.367287 Aug 25 05:31:21.391956 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 50/85] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:21 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1363 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:31:21.401657 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1048ef44-8912-464b-838f-0eb1aafdd0a7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:21.402581 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1048ef44-8912-464b-838f-0eb1aafdd0a7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:21.414301 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1048ef44-8912-464b-838f-0eb1aafdd0a7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:21.415517 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1048ef44-8912-464b-838f-0eb1aafdd0a7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:21.417975 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1048ef44-8912-464b-838f-0eb1aafdd0a7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:21.418812 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1048ef44-8912-464b-838f-0eb1aafdd0a7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:21.447316 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-72d135fa-781a-45b1-a74f-e1280b2ad533 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35da6a5109cb482bbf144927215467f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a213191904a64205b483c88adabf87a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:21.464474 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-72d135fa-781a-45b1-a74f-e1280b2ad533 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d" status: 200 len: 1315 microversion: 2.1 time: 0.350858 Aug 25 05:31:21.465566 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 36/86] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:21 2021] GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d => generated 1315 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:21.516208 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-1048ef44-8912-464b-838f-0eb1aafdd0a7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:21.532571 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-1048ef44-8912-464b-838f-0eb1aafdd0a7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:21.535257 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-1048ef44-8912-464b-838f-0eb1aafdd0a7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:21.537046 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1048ef44-8912-464b-838f-0eb1aafdd0a7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1339 microversion: 2.20 time: 0.143215 Aug 25 05:31:21.539926 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 51/87] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:31:21 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1339 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:31:22.120996 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d2dab1d4-f194-47c0-be5a-f0009f242340 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:22.124239 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-d2dab1d4-f194-47c0-be5a-f0009f242340 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:22.135937 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d2dab1d4-f194-47c0-be5a-f0009f242340 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:22.139819 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d2dab1d4-f194-47c0-be5a-f0009f242340 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:22.139819 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d2dab1d4-f194-47c0-be5a-f0009f242340 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:22.139819 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d2dab1d4-f194-47c0-be5a-f0009f242340 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:22.408595 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-217d230f-2366-4d11-b42c-292b3ca2f7f2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:22.409787 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-217d230f-2366-4d11-b42c-292b3ca2f7f2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:22.423969 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-217d230f-2366-4d11-b42c-292b3ca2f7f2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:22.424678 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-217d230f-2366-4d11-b42c-292b3ca2f7f2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:22.425761 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-217d230f-2366-4d11-b42c-292b3ca2f7f2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:22.426349 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-217d230f-2366-4d11-b42c-292b3ca2f7f2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:22.909416 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-d2dab1d4-f194-47c0-be5a-f0009f242340 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:22.919502 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d2dab1d4-f194-47c0-be5a-f0009f242340 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1321 microversion: 2.1 time: 0.808337 Aug 25 05:31:22.930566 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 37/88] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:22 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1321 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:22.957635 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-217d230f-2366-4d11-b42c-292b3ca2f7f2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:22.969208 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-217d230f-2366-4d11-b42c-292b3ca2f7f2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1363 microversion: 2.1 time: 0.564306 Aug 25 05:31:22.973516 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 52/89] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:22 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1363 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:22.993617 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-706712e2-6c6b-4273-9e70-25b8bc702530 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:22.995944 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-706712e2-6c6b-4273-9e70-25b8bc702530 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:23.014667 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-706712e2-6c6b-4273-9e70-25b8bc702530 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:23.015436 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-706712e2-6c6b-4273-9e70-25b8bc702530 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:23.020238 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-706712e2-6c6b-4273-9e70-25b8bc702530 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:23.020905 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-706712e2-6c6b-4273-9e70-25b8bc702530 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:23.203907 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [req-0551a17b-1359-42b9-a4b9-7ba789355d3d req-6f940aa8-d66f-4a72-8b8b-f90eb8e54389 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3e165c6-aa9b-4300-b7b9-7b820e894508", "tag": "02e3f58d-2ea4-4c56-82da-d9700062ae4a"}]} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:31:23.209814 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:31:23.209814 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: warnings.warn(msg) Aug 25 05:31:23.216620 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-0551a17b-1359-42b9-a4b9-7ba789355d3d req-6f940aa8-d66f-4a72-8b8b-f90eb8e54389 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:23.220342 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-0551a17b-1359-42b9-a4b9-7ba789355d3d req-6f940aa8-d66f-4a72-8b8b-f90eb8e54389 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:23.250022 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.compute.server_external_events [req-0551a17b-1359-42b9-a4b9-7ba789355d3d req-6f940aa8-d66f-4a72-8b8b-f90eb8e54389 service nova] Creating event network-changed:02e3f58d-2ea4-4c56-82da-d9700062ae4a for instance f3e165c6-aa9b-4300-b7b9-7b820e894508 on hv-cinder-78662 Aug 25 05:31:23.264221 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [req-0551a17b-1359-42b9-a4b9-7ba789355d3d req-6f940aa8-d66f-4a72-8b8b-f90eb8e54389 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.327694 Aug 25 05:31:23.267833 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 38/90] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:31:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:31:23.281554 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7901003f-eafa-4c14-8aa3-a01af9811881 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:23.282496 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7901003f-eafa-4c14-8aa3-a01af9811881 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:23.307177 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7901003f-eafa-4c14-8aa3-a01af9811881 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:23.307912 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7901003f-eafa-4c14-8aa3-a01af9811881 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:23.308956 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7901003f-eafa-4c14-8aa3-a01af9811881 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:23.312009 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7901003f-eafa-4c14-8aa3-a01af9811881 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:23.362141 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-706712e2-6c6b-4273-9e70-25b8bc702530 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35da6a5109cb482bbf144927215467f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a213191904a64205b483c88adabf87a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:23.371844 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-706712e2-6c6b-4273-9e70-25b8bc702530 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d" status: 200 len: 1315 microversion: 2.1 time: 0.396692 Aug 25 05:31:23.374472 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 53/91] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:22 2021] GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d => generated 1315 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:23.501326 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [req-4f87458e-443b-4b18-b58a-bc4994f1c625 req-eaa92ad7-1a15-4a03-b626-f500234801b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d7a5079-3e2a-4e51-ba95-5feb0d27b87d", "name": "network-vif-plugged", "status": "completed", "tag": "e5c62734-8dcc-4f75-a5c1-7470ccc335d9"}]} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:31:23.503893 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:31:23.503893 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: warnings.warn(msg) Aug 25 05:31:23.515224 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-4f87458e-443b-4b18-b58a-bc4994f1c625 req-eaa92ad7-1a15-4a03-b626-f500234801b6 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:23.515670 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-4f87458e-443b-4b18-b58a-bc4994f1c625 req-eaa92ad7-1a15-4a03-b626-f500234801b6 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:23.528351 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.compute.server_external_events [req-4f87458e-443b-4b18-b58a-bc4994f1c625 req-eaa92ad7-1a15-4a03-b626-f500234801b6 service nova] Creating event network-vif-plugged:e5c62734-8dcc-4f75-a5c1-7470ccc335d9 for instance 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d on hv-cinder-78662 Aug 25 05:31:23.536137 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [req-4f87458e-443b-4b18-b58a-bc4994f1c625 req-eaa92ad7-1a15-4a03-b626-f500234801b6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159914 Aug 25 05:31:23.536907 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 54/92] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:31:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:31:23.623711 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-7901003f-eafa-4c14-8aa3-a01af9811881 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:23.632361 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-7901003f-eafa-4c14-8aa3-a01af9811881 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:23.634835 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-7901003f-eafa-4c14-8aa3-a01af9811881 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:23.636228 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7901003f-eafa-4c14-8aa3-a01af9811881 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1407 microversion: 2.20 time: 0.369617 Aug 25 05:31:23.637863 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 39/93] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:31:23 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1407 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:31:23.724303 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [req-be42f66b-8235-4c18-871e-6c5320c27677 req-13e03332-7a44-42c6-bd8c-3f92e910563b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c438716-186a-4b29-b29e-e9c6a71a5a27", "tag": "b6d4c9a3-6a56-41ed-b144-3a1d1e9cfbd6"}]} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:31:23.726031 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:31:23.726031 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: warnings.warn(msg) Aug 25 05:31:23.745699 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-be42f66b-8235-4c18-871e-6c5320c27677 req-13e03332-7a44-42c6-bd8c-3f92e910563b service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:23.746148 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-be42f66b-8235-4c18-871e-6c5320c27677 req-13e03332-7a44-42c6-bd8c-3f92e910563b service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:23.771165 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.compute.server_external_events [req-be42f66b-8235-4c18-871e-6c5320c27677 req-13e03332-7a44-42c6-bd8c-3f92e910563b service nova] Creating event network-changed:b6d4c9a3-6a56-41ed-b144-3a1d1e9cfbd6 for instance 4c438716-186a-4b29-b29e-e9c6a71a5a27 on hv-cinder-78662 Aug 25 05:31:23.783187 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [req-be42f66b-8235-4c18-871e-6c5320c27677 req-13e03332-7a44-42c6-bd8c-3f92e910563b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062755 Aug 25 05:31:23.787036 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 55/94] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:31:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:31:23.959643 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1ec9e810-dee3-4175-a547-1db70ac6a510 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:23.960179 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1ec9e810-dee3-4175-a547-1db70ac6a510 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:23.971788 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1ec9e810-dee3-4175-a547-1db70ac6a510 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:23.972231 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1ec9e810-dee3-4175-a547-1db70ac6a510 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:23.973058 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1ec9e810-dee3-4175-a547-1db70ac6a510 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:23.973427 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1ec9e810-dee3-4175-a547-1db70ac6a510 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:23.992444 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2d4140ed-d0cd-45a1-a7d5-29bb7a439368 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:23.993228 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2d4140ed-d0cd-45a1-a7d5-29bb7a439368 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:24.015055 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2d4140ed-d0cd-45a1-a7d5-29bb7a439368 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:24.015055 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2d4140ed-d0cd-45a1-a7d5-29bb7a439368 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:24.015055 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2d4140ed-d0cd-45a1-a7d5-29bb7a439368 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:24.015055 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2d4140ed-d0cd-45a1-a7d5-29bb7a439368 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:24.502922 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-2d4140ed-d0cd-45a1-a7d5-29bb7a439368 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:24.517383 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2d4140ed-d0cd-45a1-a7d5-29bb7a439368 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1363 microversion: 2.1 time: 0.529005 Aug 25 05:31:24.518340 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 56/95] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:23 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1363 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:24.535109 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-80a9332b-2b54-46d9-b383-ed096d4b80df tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:24.535109 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-80a9332b-2b54-46d9-b383-ed096d4b80df tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:24.535422 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-1ec9e810-dee3-4175-a547-1db70ac6a510 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:24.537483 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-80a9332b-2b54-46d9-b383-ed096d4b80df tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:24.543808 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1ec9e810-dee3-4175-a547-1db70ac6a510 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1321 microversion: 2.1 time: 0.587972 Aug 25 05:31:24.544391 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 40/96] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:23 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1321 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:24.554509 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-80a9332b-2b54-46d9-b383-ed096d4b80df tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:24.556322 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-80a9332b-2b54-46d9-b383-ed096d4b80df tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:24.557366 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-80a9332b-2b54-46d9-b383-ed096d4b80df tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:24.658817 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-297ec28a-fa91-429c-91bd-cd1ee093ad82 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:24.659583 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-297ec28a-fa91-429c-91bd-cd1ee093ad82 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:24.674075 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-297ec28a-fa91-429c-91bd-cd1ee093ad82 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:24.684273 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-297ec28a-fa91-429c-91bd-cd1ee093ad82 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:24.684273 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-297ec28a-fa91-429c-91bd-cd1ee093ad82 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:24.684273 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-297ec28a-fa91-429c-91bd-cd1ee093ad82 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:24.911579 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-80a9332b-2b54-46d9-b383-ed096d4b80df tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35da6a5109cb482bbf144927215467f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a213191904a64205b483c88adabf87a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:24.948984 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-80a9332b-2b54-46d9-b383-ed096d4b80df tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d" status: 200 len: 1315 microversion: 2.1 time: 0.429020 Aug 25 05:31:24.951593 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 57/97] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:24 2021] GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d => generated 1315 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:25.074741 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-297ec28a-fa91-429c-91bd-cd1ee093ad82 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:25.087209 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-297ec28a-fa91-429c-91bd-cd1ee093ad82 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:25.088763 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-297ec28a-fa91-429c-91bd-cd1ee093ad82 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:25.089952 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-297ec28a-fa91-429c-91bd-cd1ee093ad82 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1407 microversion: 2.20 time: 0.438079 Aug 25 05:31:25.090729 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 41/98] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:31:24 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1407 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:31:25.536114 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-795026f3-eed5-4e6d-b251-e6479e947231 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:25.536808 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-795026f3-eed5-4e6d-b251-e6479e947231 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:25.550354 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-795026f3-eed5-4e6d-b251-e6479e947231 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:25.554089 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-795026f3-eed5-4e6d-b251-e6479e947231 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:25.557420 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-795026f3-eed5-4e6d-b251-e6479e947231 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:25.557865 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-795026f3-eed5-4e6d-b251-e6479e947231 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:25.561841 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8f16b432-61de-47c3-928e-2e067bbc4b82 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:25.562440 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8f16b432-61de-47c3-928e-2e067bbc4b82 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:25.571074 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8f16b432-61de-47c3-928e-2e067bbc4b82 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:25.571816 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8f16b432-61de-47c3-928e-2e067bbc4b82 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:25.572622 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8f16b432-61de-47c3-928e-2e067bbc4b82 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:25.573066 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8f16b432-61de-47c3-928e-2e067bbc4b82 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:25.777154 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-8f16b432-61de-47c3-928e-2e067bbc4b82 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:25.784896 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8f16b432-61de-47c3-928e-2e067bbc4b82 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1321 microversion: 2.1 time: 0.226526 Aug 25 05:31:25.796038 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 42/99] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:25 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:31:25.803024 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-795026f3-eed5-4e6d-b251-e6479e947231 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:25.818018 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-795026f3-eed5-4e6d-b251-e6479e947231 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1363 microversion: 2.1 time: 0.285505 Aug 25 05:31:25.818591 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 58/100] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:25 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1363 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:25.830073 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [req-a1c3fbd2-8947-4fe7-bfaf-84402528a0cf req-bb811449-7dee-41fb-ba7f-4619e08a60fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cb635d4-76ba-4143-8f4d-a64c720966da", "tag": "605f6633-54d1-4fa5-b498-9157fffe1b41"}]} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:31:25.831691 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:31:25.831691 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: warnings.warn(msg) Aug 25 05:31:25.839354 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-a1c3fbd2-8947-4fe7-bfaf-84402528a0cf req-bb811449-7dee-41fb-ba7f-4619e08a60fa service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:25.839811 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-a1c3fbd2-8947-4fe7-bfaf-84402528a0cf req-bb811449-7dee-41fb-ba7f-4619e08a60fa service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:25.851805 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.compute.server_external_events [req-a1c3fbd2-8947-4fe7-bfaf-84402528a0cf req-bb811449-7dee-41fb-ba7f-4619e08a60fa service nova] Creating event network-changed:605f6633-54d1-4fa5-b498-9157fffe1b41 for instance 4cb635d4-76ba-4143-8f4d-a64c720966da on hv-cinder-78662 Aug 25 05:31:25.860810 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [req-a1c3fbd2-8947-4fe7-bfaf-84402528a0cf req-bb811449-7dee-41fb-ba7f-4619e08a60fa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033933 Aug 25 05:31:25.862313 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 43/101] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:31:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:31:25.971624 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f0943ffc-5349-46f4-acc3-6f9e61775572 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:25.972297 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f0943ffc-5349-46f4-acc3-6f9e61775572 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:25.978200 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f0943ffc-5349-46f4-acc3-6f9e61775572 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:25.978827 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f0943ffc-5349-46f4-acc3-6f9e61775572 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:25.979818 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f0943ffc-5349-46f4-acc3-6f9e61775572 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:25.980407 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f0943ffc-5349-46f4-acc3-6f9e61775572 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:26.111359 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3b074908-8852-47b6-85a4-392196e36399 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:26.112419 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3b074908-8852-47b6-85a4-392196e36399 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:26.119675 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3b074908-8852-47b6-85a4-392196e36399 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:26.120208 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3b074908-8852-47b6-85a4-392196e36399 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:26.120983 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3b074908-8852-47b6-85a4-392196e36399 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:26.121592 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3b074908-8852-47b6-85a4-392196e36399 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:26.163713 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-f0943ffc-5349-46f4-acc3-6f9e61775572 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35da6a5109cb482bbf144927215467f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a213191904a64205b483c88adabf87a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:26.172134 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f0943ffc-5349-46f4-acc3-6f9e61775572 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d" status: 200 len: 1315 microversion: 2.1 time: 0.204065 Aug 25 05:31:26.172730 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 59/102] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:25 2021] GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:26.295581 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-3b074908-8852-47b6-85a4-392196e36399 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:26.303312 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-3b074908-8852-47b6-85a4-392196e36399 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:26.305355 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-3b074908-8852-47b6-85a4-392196e36399 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:26.306502 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3b074908-8852-47b6-85a4-392196e36399 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1407 microversion: 2.20 time: 0.199415 Aug 25 05:31:26.307073 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 44/103] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:31:26 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:31:26.806295 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2634075c-fb4a-4e1c-9dfc-bafeb7633f82 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:26.807633 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2634075c-fb4a-4e1c-9dfc-bafeb7633f82 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:26.814369 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2634075c-fb4a-4e1c-9dfc-bafeb7633f82 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:26.815149 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2634075c-fb4a-4e1c-9dfc-bafeb7633f82 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:26.816238 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2634075c-fb4a-4e1c-9dfc-bafeb7633f82 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:26.816887 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2634075c-fb4a-4e1c-9dfc-bafeb7633f82 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:26.835406 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8e1afcc2-f7df-42fd-b444-2dcda0a9584f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:26.837739 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8e1afcc2-f7df-42fd-b444-2dcda0a9584f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:26.847375 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8e1afcc2-f7df-42fd-b444-2dcda0a9584f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:26.848207 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8e1afcc2-f7df-42fd-b444-2dcda0a9584f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:26.849270 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8e1afcc2-f7df-42fd-b444-2dcda0a9584f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:26.849947 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8e1afcc2-f7df-42fd-b444-2dcda0a9584f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:27.074084 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-2634075c-fb4a-4e1c-9dfc-bafeb7633f82 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:27.081354 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-8e1afcc2-f7df-42fd-b444-2dcda0a9584f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:27.081627 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2634075c-fb4a-4e1c-9dfc-bafeb7633f82 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1321 microversion: 2.1 time: 0.281966 Aug 25 05:31:27.084280 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 60/104] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:26 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1321 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:27.093504 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8e1afcc2-f7df-42fd-b444-2dcda0a9584f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1363 microversion: 2.1 time: 0.260387 Aug 25 05:31:27.106017 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 45/105] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:26 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1363 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:31:27.192539 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-536836d0-7132-4908-8954-0b791739d687 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:27.193154 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-536836d0-7132-4908-8954-0b791739d687 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:27.200163 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-536836d0-7132-4908-8954-0b791739d687 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:27.200616 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-536836d0-7132-4908-8954-0b791739d687 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:27.201396 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-536836d0-7132-4908-8954-0b791739d687 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:27.201901 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-536836d0-7132-4908-8954-0b791739d687 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:27.327978 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a33d6788-ba29-4a30-a62b-df7f64f3870e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:27.328775 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a33d6788-ba29-4a30-a62b-df7f64f3870e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:27.340008 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a33d6788-ba29-4a30-a62b-df7f64f3870e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:27.340489 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a33d6788-ba29-4a30-a62b-df7f64f3870e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:27.341371 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a33d6788-ba29-4a30-a62b-df7f64f3870e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:27.342055 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a33d6788-ba29-4a30-a62b-df7f64f3870e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:27.381809 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-536836d0-7132-4908-8954-0b791739d687 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35da6a5109cb482bbf144927215467f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a213191904a64205b483c88adabf87a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:27.396193 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-536836d0-7132-4908-8954-0b791739d687 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d" status: 200 len: 1315 microversion: 2.1 time: 0.202150 Aug 25 05:31:27.412961 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 61/106] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:27 2021] GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:27.536022 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-a33d6788-ba29-4a30-a62b-df7f64f3870e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:27.545152 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-a33d6788-ba29-4a30-a62b-df7f64f3870e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:27.546815 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-a33d6788-ba29-4a30-a62b-df7f64f3870e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:27.547979 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a33d6788-ba29-4a30-a62b-df7f64f3870e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1407 microversion: 2.20 time: 0.225289 Aug 25 05:31:27.552298 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 46/107] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:31:27 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:31:28.100545 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1f76cae3-95fb-4f90-a26b-d9b9c23bbb5c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:28.101153 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1f76cae3-95fb-4f90-a26b-d9b9c23bbb5c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:28.107683 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1f76cae3-95fb-4f90-a26b-d9b9c23bbb5c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:28.108129 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1f76cae3-95fb-4f90-a26b-d9b9c23bbb5c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:28.108910 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1f76cae3-95fb-4f90-a26b-d9b9c23bbb5c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:28.109334 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1f76cae3-95fb-4f90-a26b-d9b9c23bbb5c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:28.113572 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e0c42629-9cb9-4e65-8b9a-04358733d54d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:28.114278 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e0c42629-9cb9-4e65-8b9a-04358733d54d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:28.120672 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e0c42629-9cb9-4e65-8b9a-04358733d54d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:28.121122 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e0c42629-9cb9-4e65-8b9a-04358733d54d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:28.121969 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e0c42629-9cb9-4e65-8b9a-04358733d54d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:28.122402 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e0c42629-9cb9-4e65-8b9a-04358733d54d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:28.483378 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-1f76cae3-95fb-4f90-a26b-d9b9c23bbb5c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:28.491807 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e0c42629-9cb9-4e65-8b9a-04358733d54d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:28.495380 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1f76cae3-95fb-4f90-a26b-d9b9c23bbb5c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1321 microversion: 2.1 time: 0.397356 Aug 25 05:31:28.496598 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 62/108] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:28 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1321 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:28.502507 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e0c42629-9cb9-4e65-8b9a-04358733d54d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1363 microversion: 2.1 time: 0.392707 Aug 25 05:31:28.503881 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 47/109] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:28 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1363 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:31:28.505911 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a794e763-558f-47ce-84c0-4b85e18f6975 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:28.507324 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a794e763-558f-47ce-84c0-4b85e18f6975 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:28.530989 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a794e763-558f-47ce-84c0-4b85e18f6975 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:28.533668 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a794e763-558f-47ce-84c0-4b85e18f6975 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:28.536217 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a794e763-558f-47ce-84c0-4b85e18f6975 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:28.538379 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a794e763-558f-47ce-84c0-4b85e18f6975 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:28.567421 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-9e880fb7-5999-456f-b513-d1930c63f025 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:28.568362 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-9e880fb7-5999-456f-b513-d1930c63f025 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:28.577248 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9e880fb7-5999-456f-b513-d1930c63f025 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:28.578155 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9e880fb7-5999-456f-b513-d1930c63f025 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:28.578614 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9e880fb7-5999-456f-b513-d1930c63f025 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:28.579094 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9e880fb7-5999-456f-b513-d1930c63f025 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:28.769111 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-a794e763-558f-47ce-84c0-4b85e18f6975 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35da6a5109cb482bbf144927215467f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a213191904a64205b483c88adabf87a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:28.777026 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-9e880fb7-5999-456f-b513-d1930c63f025 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:28.777874 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a794e763-558f-47ce-84c0-4b85e18f6975 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d" status: 200 len: 1502 microversion: 2.1 time: 0.279469 Aug 25 05:31:28.778461 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 63/110] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:28 2021] GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d => generated 1502 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:28.785492 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-9e880fb7-5999-456f-b513-d1930c63f025 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:28.786995 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-9e880fb7-5999-456f-b513-d1930c63f025 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:28.788090 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-9e880fb7-5999-456f-b513-d1930c63f025 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1407 microversion: 2.20 time: 0.224996 Aug 25 05:31:28.789509 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 48/111] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:31:28 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:31:29.060706 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [req-9ef9993b-bd72-437b-8942-499270237ec6 req-ff734d19-8c48-439a-ac4a-882bc510c85e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2163e566-1832-40df-8925-09e54ae2974c", "name": "network-vif-plugged", "status": "completed", "tag": "23c47dd6-b4d5-452b-8959-9becb9c14cae"}]} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:31:29.062526 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:31:29.062526 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: warnings.warn(msg) Aug 25 05:31:29.071467 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-9ef9993b-bd72-437b-8942-499270237ec6 req-ff734d19-8c48-439a-ac4a-882bc510c85e service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:29.072739 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-9ef9993b-bd72-437b-8942-499270237ec6 req-ff734d19-8c48-439a-ac4a-882bc510c85e service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:29.087714 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.compute.server_external_events [req-9ef9993b-bd72-437b-8942-499270237ec6 req-ff734d19-8c48-439a-ac4a-882bc510c85e service nova] Creating event network-vif-plugged:23c47dd6-b4d5-452b-8959-9becb9c14cae for instance 2163e566-1832-40df-8925-09e54ae2974c on hv-cinder-78662 Aug 25 05:31:29.094952 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [req-9ef9993b-bd72-437b-8942-499270237ec6 req-ff734d19-8c48-439a-ac4a-882bc510c85e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037816 Aug 25 05:31:29.095551 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 64/112] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:31:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:31:29.521325 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-252cdfc8-b6d4-4243-8eea-ec433cd09d4e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:29.524468 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-252cdfc8-b6d4-4243-8eea-ec433cd09d4e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:29.529366 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a155964d-bbfd-4aa7-8345-7db39b01e340 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:29.530147 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a155964d-bbfd-4aa7-8345-7db39b01e340 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:29.532874 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-252cdfc8-b6d4-4243-8eea-ec433cd09d4e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:29.533437 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-252cdfc8-b6d4-4243-8eea-ec433cd09d4e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:29.534768 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-252cdfc8-b6d4-4243-8eea-ec433cd09d4e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:29.535471 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-252cdfc8-b6d4-4243-8eea-ec433cd09d4e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:29.541054 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a155964d-bbfd-4aa7-8345-7db39b01e340 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:29.541976 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a155964d-bbfd-4aa7-8345-7db39b01e340 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:29.547262 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a155964d-bbfd-4aa7-8345-7db39b01e340 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:29.547262 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a155964d-bbfd-4aa7-8345-7db39b01e340 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:29.734547 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-252cdfc8-b6d4-4243-8eea-ec433cd09d4e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:29.742801 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-252cdfc8-b6d4-4243-8eea-ec433cd09d4e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1321 microversion: 2.1 time: 0.227447 Aug 25 05:31:29.745399 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 49/113] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:29 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:29.765306 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-a155964d-bbfd-4aa7-8345-7db39b01e340 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:29.773301 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a155964d-bbfd-4aa7-8345-7db39b01e340 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1363 microversion: 2.1 time: 0.250260 Aug 25 05:31:29.774168 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 65/114] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:29 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1363 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:31:29.806750 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ade712fe-c9d1-41ed-b9ff-7c3fbff61916 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:29.807368 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ade712fe-c9d1-41ed-b9ff-7c3fbff61916 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:29.813101 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ade712fe-c9d1-41ed-b9ff-7c3fbff61916 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:29.813573 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ade712fe-c9d1-41ed-b9ff-7c3fbff61916 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:29.814341 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ade712fe-c9d1-41ed-b9ff-7c3fbff61916 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:29.814777 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ade712fe-c9d1-41ed-b9ff-7c3fbff61916 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:29.971730 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ade712fe-c9d1-41ed-b9ff-7c3fbff61916 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:29.981661 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ade712fe-c9d1-41ed-b9ff-7c3fbff61916 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:29.983187 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ade712fe-c9d1-41ed-b9ff-7c3fbff61916 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:29.984285 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ade712fe-c9d1-41ed-b9ff-7c3fbff61916 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1407 microversion: 2.20 time: 0.181773 Aug 25 05:31:29.984848 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 50/115] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:31:29 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:31:30.764794 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-8859cfc9-a6ba-4331-b9a6-3f00de4f6960 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:30.778553 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-8859cfc9-a6ba-4331-b9a6-3f00de4f6960 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:30.778553 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8859cfc9-a6ba-4331-b9a6-3f00de4f6960 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:30.778553 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8859cfc9-a6ba-4331-b9a6-3f00de4f6960 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:30.778553 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8859cfc9-a6ba-4331-b9a6-3f00de4f6960 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:30.778944 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8859cfc9-a6ba-4331-b9a6-3f00de4f6960 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:30.791134 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d12d47c7-742d-4b1d-97cc-e9a0e0de4d20 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:30.792346 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-d12d47c7-742d-4b1d-97cc-e9a0e0de4d20 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:30.799862 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d12d47c7-742d-4b1d-97cc-e9a0e0de4d20 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:30.800306 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d12d47c7-742d-4b1d-97cc-e9a0e0de4d20 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:30.801139 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d12d47c7-742d-4b1d-97cc-e9a0e0de4d20 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:30.801579 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d12d47c7-742d-4b1d-97cc-e9a0e0de4d20 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:31.004915 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-8859cfc9-a6ba-4331-b9a6-3f00de4f6960 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:31.015957 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-8859cfc9-a6ba-4331-b9a6-3f00de4f6960 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1321 microversion: 2.1 time: 0.254882 Aug 25 05:31:31.016741 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 66/116] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:30 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1321 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:31.021649 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-65c6e1a1-924c-494d-97ef-c2861d2f68f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:31.022923 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-65c6e1a1-924c-494d-97ef-c2861d2f68f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:31.033112 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-65c6e1a1-924c-494d-97ef-c2861d2f68f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:31.033112 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-65c6e1a1-924c-494d-97ef-c2861d2f68f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:31.033343 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-65c6e1a1-924c-494d-97ef-c2861d2f68f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:31.033888 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-65c6e1a1-924c-494d-97ef-c2861d2f68f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:31.037835 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-d12d47c7-742d-4b1d-97cc-e9a0e0de4d20 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:31.049625 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d12d47c7-742d-4b1d-97cc-e9a0e0de4d20 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1363 microversion: 2.1 time: 0.262835 Aug 25 05:31:31.054419 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 51/117] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:30 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1363 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:31:31.122395 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [req-3f1ed307-bdd1-4840-9565-0d355b4c26fb req-be0c14e4-861f-46b1-a382-1c23da3f7198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3e165c6-aa9b-4300-b7b9-7b820e894508", "name": "network-vif-plugged", "status": "completed", "tag": "02e3f58d-2ea4-4c56-82da-d9700062ae4a"}]} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:31:31.122395 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:31:31.122395 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: warnings.warn(msg) Aug 25 05:31:31.151750 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-3f1ed307-bdd1-4840-9565-0d355b4c26fb req-be0c14e4-861f-46b1-a382-1c23da3f7198 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:31.152722 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-3f1ed307-bdd1-4840-9565-0d355b4c26fb req-be0c14e4-861f-46b1-a382-1c23da3f7198 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:31.176725 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.compute.server_external_events [req-3f1ed307-bdd1-4840-9565-0d355b4c26fb req-be0c14e4-861f-46b1-a382-1c23da3f7198 service nova] Creating event network-vif-plugged:02e3f58d-2ea4-4c56-82da-d9700062ae4a for instance f3e165c6-aa9b-4300-b7b9-7b820e894508 on hv-cinder-78662 Aug 25 05:31:31.180376 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [req-3f1ed307-bdd1-4840-9565-0d355b4c26fb req-be0c14e4-861f-46b1-a382-1c23da3f7198 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064132 Aug 25 05:31:31.183449 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 52/118] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:31:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:31:31.222280 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-65c6e1a1-924c-494d-97ef-c2861d2f68f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:31.231111 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-65c6e1a1-924c-494d-97ef-c2861d2f68f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:31.232843 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-65c6e1a1-924c-494d-97ef-c2861d2f68f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:31.234164 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-65c6e1a1-924c-494d-97ef-c2861d2f68f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1407 microversion: 2.20 time: 0.216349 Aug 25 05:31:31.234893 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 67/119] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:31:31 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:31:31.650943 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-fcbc22b0-c266-4813-9bc6-6e88e66be103 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b63cefde-d110-4e46-8de5-ba019619cf94"}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:31:31.652639 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-fcbc22b0-c266-4813-9bc6-6e88e66be103 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:31.662059 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fcbc22b0-c266-4813-9bc6-6e88e66be103 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:31.662655 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fcbc22b0-c266-4813-9bc6-6e88e66be103 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:31.663692 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fcbc22b0-c266-4813-9bc6-6e88e66be103 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:31.664396 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fcbc22b0-c266-4813-9bc6-6e88e66be103 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:32.034691 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f8e5fb5b-f592-4d3d-bda3-da3b3bacc2f3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:32.036822 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f8e5fb5b-f592-4d3d-bda3-da3b3bacc2f3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:32.044863 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f8e5fb5b-f592-4d3d-bda3-da3b3bacc2f3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:32.045310 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f8e5fb5b-f592-4d3d-bda3-da3b3bacc2f3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:32.046541 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f8e5fb5b-f592-4d3d-bda3-da3b3bacc2f3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:32.047183 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f8e5fb5b-f592-4d3d-bda3-da3b3bacc2f3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:32.194530 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-f8e5fb5b-f592-4d3d-bda3-da3b3bacc2f3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:32.206937 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f8e5fb5b-f592-4d3d-bda3-da3b3bacc2f3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1321 microversion: 2.1 time: 0.175926 Aug 25 05:31:32.207518 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 68/120] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:32 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:31:32.212683 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-21a08ae6-fbee-48bf-8f14-85a843faeb21 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:32.213472 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-21a08ae6-fbee-48bf-8f14-85a843faeb21 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:32.219653 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-21a08ae6-fbee-48bf-8f14-85a843faeb21 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:32.220359 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-21a08ae6-fbee-48bf-8f14-85a843faeb21 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:32.221337 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-21a08ae6-fbee-48bf-8f14-85a843faeb21 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:32.221999 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-21a08ae6-fbee-48bf-8f14-85a843faeb21 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:32.352430 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-21a08ae6-fbee-48bf-8f14-85a843faeb21 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:32.360427 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-21a08ae6-fbee-48bf-8f14-85a843faeb21 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1363 microversion: 2.1 time: 0.151699 Aug 25 05:31:32.360996 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 69/121] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:32 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:32.365796 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d2a600ca-fe62-4740-9d0b-8f159593c47a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:32.366409 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d2a600ca-fe62-4740-9d0b-8f159593c47a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:32.374091 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d2a600ca-fe62-4740-9d0b-8f159593c47a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:32.374589 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d2a600ca-fe62-4740-9d0b-8f159593c47a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:32.375428 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d2a600ca-fe62-4740-9d0b-8f159593c47a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:32.375770 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d2a600ca-fe62-4740-9d0b-8f159593c47a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:32.509620 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d2a600ca-fe62-4740-9d0b-8f159593c47a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:32.517685 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d2a600ca-fe62-4740-9d0b-8f159593c47a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:32.519393 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d2a600ca-fe62-4740-9d0b-8f159593c47a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:32.520489 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d2a600ca-fe62-4740-9d0b-8f159593c47a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1407 microversion: 2.20 time: 0.158365 Aug 25 05:31:32.521033 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 70/122] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:31:32 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:31:33.226366 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-59e7be3f-2fd7-4281-921b-53c75a230aad tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:33.227727 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-59e7be3f-2fd7-4281-921b-53c75a230aad tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:33.230590 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-fcbc22b0-c266-4813-9bc6-6e88e66be103 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "POST /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.585649 Aug 25 05:31:33.231378 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 53/123] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 25 05:31:31 2021] POST /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d/os-volume_attachments => generated 194 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:31:33.234631 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-59e7be3f-2fd7-4281-921b-53c75a230aad tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:33.235076 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-59e7be3f-2fd7-4281-921b-53c75a230aad tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:33.236170 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-59e7be3f-2fd7-4281-921b-53c75a230aad tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:33.236694 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-59e7be3f-2fd7-4281-921b-53c75a230aad tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:33.381158 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-76ef0524-daac-49eb-8977-8fa14f86264e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:33.381886 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-76ef0524-daac-49eb-8977-8fa14f86264e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:33.388778 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-76ef0524-daac-49eb-8977-8fa14f86264e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:33.391278 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-76ef0524-daac-49eb-8977-8fa14f86264e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:33.391278 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-76ef0524-daac-49eb-8977-8fa14f86264e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:33.391582 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-59e7be3f-2fd7-4281-921b-53c75a230aad tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:33.391802 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-76ef0524-daac-49eb-8977-8fa14f86264e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:33.397919 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-59e7be3f-2fd7-4281-921b-53c75a230aad tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1321 microversion: 2.1 time: 0.175222 Aug 25 05:31:33.398994 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 71/124] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:33 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:31:33.543354 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-43792bf1-f0b6-4920-868e-05f28154a4af tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:33.544095 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-43792bf1-f0b6-4920-868e-05f28154a4af tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:33.546587 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-76ef0524-daac-49eb-8977-8fa14f86264e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:33.550908 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-43792bf1-f0b6-4920-868e-05f28154a4af tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:33.551664 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-43792bf1-f0b6-4920-868e-05f28154a4af tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:33.552501 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-43792bf1-f0b6-4920-868e-05f28154a4af tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:33.553070 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-43792bf1-f0b6-4920-868e-05f28154a4af tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:33.554335 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-76ef0524-daac-49eb-8977-8fa14f86264e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1363 microversion: 2.1 time: 0.178535 Aug 25 05:31:33.563811 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 54/125] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:33 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:33.704154 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-43792bf1-f0b6-4920-868e-05f28154a4af tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:33.720338 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-43792bf1-f0b6-4920-868e-05f28154a4af tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:33.721872 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-43792bf1-f0b6-4920-868e-05f28154a4af tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:33.723361 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-43792bf1-f0b6-4920-868e-05f28154a4af tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1407 microversion: 2.20 time: 0.187868 Aug 25 05:31:33.724561 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 72/126] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:31:33 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:31:34.416770 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3b140cc1-179a-4c23-9ca1-50dff99239fe tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:34.424544 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3b140cc1-179a-4c23-9ca1-50dff99239fe tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:34.424544 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3b140cc1-179a-4c23-9ca1-50dff99239fe tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:34.424544 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3b140cc1-179a-4c23-9ca1-50dff99239fe tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:34.426739 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3b140cc1-179a-4c23-9ca1-50dff99239fe tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:34.427247 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3b140cc1-179a-4c23-9ca1-50dff99239fe tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:34.571500 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-48e4bbbe-6397-49b9-9ebe-bec1683dc2f5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:34.572109 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-48e4bbbe-6397-49b9-9ebe-bec1683dc2f5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:34.578147 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-48e4bbbe-6397-49b9-9ebe-bec1683dc2f5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:34.578740 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-48e4bbbe-6397-49b9-9ebe-bec1683dc2f5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:34.579458 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-48e4bbbe-6397-49b9-9ebe-bec1683dc2f5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:34.579885 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-48e4bbbe-6397-49b9-9ebe-bec1683dc2f5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:34.618655 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-3b140cc1-179a-4c23-9ca1-50dff99239fe tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:34.626459 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3b140cc1-179a-4c23-9ca1-50dff99239fe tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1514 microversion: 2.1 time: 0.215457 Aug 25 05:31:34.627117 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 55/127] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:34 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1514 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:34.649711 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-f2968515-42bb-4b1c-a4b8-bf86d99b496d tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:31:34.650971 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-f2968515-42bb-4b1c-a4b8-bf86d99b496d tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:34.656993 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f2968515-42bb-4b1c-a4b8-bf86d99b496d tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:34.657440 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f2968515-42bb-4b1c-a4b8-bf86d99b496d tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:34.658247 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f2968515-42bb-4b1c-a4b8-bf86d99b496d tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:34.658868 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f2968515-42bb-4b1c-a4b8-bf86d99b496d tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:34.683972 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.objects.instance [None req-f2968515-42bb-4b1c-a4b8-bf86d99b496d tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lazy-loading 'flavor' on Instance uuid f3e165c6-aa9b-4300-b7b9-7b820e894508 {{(pid=108884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 05:31:34.726519 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-48e4bbbe-6397-49b9-9ebe-bec1683dc2f5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:34.736054 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-48e4bbbe-6397-49b9-9ebe-bec1683dc2f5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1363 microversion: 2.1 time: 0.168610 Aug 25 05:31:34.736632 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 73/128] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:34 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:31:34.750921 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c33033e2-ebda-4d76-82ad-0f03f824a49e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:34.751715 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c33033e2-ebda-4d76-82ad-0f03f824a49e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:34.774784 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c33033e2-ebda-4d76-82ad-0f03f824a49e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:34.775740 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c33033e2-ebda-4d76-82ad-0f03f824a49e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:34.776495 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c33033e2-ebda-4d76-82ad-0f03f824a49e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:34.776927 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c33033e2-ebda-4d76-82ad-0f03f824a49e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:34.936509 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-c33033e2-ebda-4d76-82ad-0f03f824a49e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:34.945019 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-c33033e2-ebda-4d76-82ad-0f03f824a49e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:34.947232 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-c33033e2-ebda-4d76-82ad-0f03f824a49e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:34.948420 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c33033e2-ebda-4d76-82ad-0f03f824a49e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1407 microversion: 2.20 time: 0.202151 Aug 25 05:31:34.949219 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 74/129] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:31:34 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:31:35.063248 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-f2968515-42bb-4b1c-a4b8-bf86d99b496d tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "POST /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508/action" status: 200 len: 32 microversion: 2.1 time: 0.417623 Aug 25 05:31:35.065170 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 56/130] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:31:34 2021] POST /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508/action => generated 32 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 05:31:35.074166 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ab2a6d8f-c1fd-4d4f-8aa5-7df9ae292a61 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:35.075348 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ab2a6d8f-c1fd-4d4f-8aa5-7df9ae292a61 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:35.081596 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ab2a6d8f-c1fd-4d4f-8aa5-7df9ae292a61 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:35.082037 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ab2a6d8f-c1fd-4d4f-8aa5-7df9ae292a61 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:35.082850 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ab2a6d8f-c1fd-4d4f-8aa5-7df9ae292a61 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:35.083280 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ab2a6d8f-c1fd-4d4f-8aa5-7df9ae292a61 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:35.225445 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ab2a6d8f-c1fd-4d4f-8aa5-7df9ae292a61 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:35.238088 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ab2a6d8f-c1fd-4d4f-8aa5-7df9ae292a61 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1520 microversion: 2.1 time: 0.167641 Aug 25 05:31:35.238841 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 75/131] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:35 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:35.588292 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [req-e9c30baa-abfc-442f-a238-751063e00269 req-694afd56-e17b-49e0-8a00-b9d545752a50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c438716-186a-4b29-b29e-e9c6a71a5a27", "name": "network-vif-plugged", "status": "completed", "tag": "b6d4c9a3-6a56-41ed-b144-3a1d1e9cfbd6"}]} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:31:35.589985 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:31:35.589985 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: warnings.warn(msg) Aug 25 05:31:35.600151 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-e9c30baa-abfc-442f-a238-751063e00269 req-694afd56-e17b-49e0-8a00-b9d545752a50 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:35.600589 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-e9c30baa-abfc-442f-a238-751063e00269 req-694afd56-e17b-49e0-8a00-b9d545752a50 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:35.611265 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.compute.server_external_events [req-e9c30baa-abfc-442f-a238-751063e00269 req-694afd56-e17b-49e0-8a00-b9d545752a50 service nova] Creating event network-vif-plugged:b6d4c9a3-6a56-41ed-b144-3a1d1e9cfbd6 for instance 4c438716-186a-4b29-b29e-e9c6a71a5a27 on hv-cinder-78662 Aug 25 05:31:35.616305 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [req-e9c30baa-abfc-442f-a238-751063e00269 req-694afd56-e17b-49e0-8a00-b9d545752a50 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033504 Aug 25 05:31:35.616936 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 57/132] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:31:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:31:35.752405 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-493bad0f-74a7-4d76-8a78-be11ffbe3520 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:35.752937 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-493bad0f-74a7-4d76-8a78-be11ffbe3520 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:35.760247 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-493bad0f-74a7-4d76-8a78-be11ffbe3520 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:35.760916 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-493bad0f-74a7-4d76-8a78-be11ffbe3520 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:35.762215 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-493bad0f-74a7-4d76-8a78-be11ffbe3520 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:35.762699 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-493bad0f-74a7-4d76-8a78-be11ffbe3520 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:35.893553 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-493bad0f-74a7-4d76-8a78-be11ffbe3520 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:35.902302 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-493bad0f-74a7-4d76-8a78-be11ffbe3520 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1363 microversion: 2.1 time: 0.153714 Aug 25 05:31:35.902883 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 76/133] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:35 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:35.968846 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-4860700e-013a-429a-af5c-85f2f75d5fc0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:35.969633 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-4860700e-013a-429a-af5c-85f2f75d5fc0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:35.975845 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4860700e-013a-429a-af5c-85f2f75d5fc0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:35.976501 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4860700e-013a-429a-af5c-85f2f75d5fc0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:35.977356 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4860700e-013a-429a-af5c-85f2f75d5fc0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:35.977807 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4860700e-013a-429a-af5c-85f2f75d5fc0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:36.177083 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-4860700e-013a-429a-af5c-85f2f75d5fc0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:36.185667 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-4860700e-013a-429a-af5c-85f2f75d5fc0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:36.187246 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-4860700e-013a-429a-af5c-85f2f75d5fc0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:36.188343 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-4860700e-013a-429a-af5c-85f2f75d5fc0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1407 microversion: 2.20 time: 0.223791 Aug 25 05:31:36.189078 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 58/134] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:31:35 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1407 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:31:36.262012 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-20817daf-82ea-4f7e-82b3-e96161d4cc01 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:36.262581 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-20817daf-82ea-4f7e-82b3-e96161d4cc01 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:36.268635 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-20817daf-82ea-4f7e-82b3-e96161d4cc01 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:36.269154 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-20817daf-82ea-4f7e-82b3-e96161d4cc01 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:36.270047 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-20817daf-82ea-4f7e-82b3-e96161d4cc01 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:36.270481 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-20817daf-82ea-4f7e-82b3-e96161d4cc01 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:36.428282 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-20817daf-82ea-4f7e-82b3-e96161d4cc01 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:36.447977 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-20817daf-82ea-4f7e-82b3-e96161d4cc01 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1520 microversion: 2.1 time: 0.179242 Aug 25 05:31:36.447977 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 77/135] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:36 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:36.920673 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1fb398f7-a21b-4489-8ec0-4d04ec5d6e00 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:36.921289 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1fb398f7-a21b-4489-8ec0-4d04ec5d6e00 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:36.927608 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1fb398f7-a21b-4489-8ec0-4d04ec5d6e00 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:36.928049 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1fb398f7-a21b-4489-8ec0-4d04ec5d6e00 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:36.928831 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1fb398f7-a21b-4489-8ec0-4d04ec5d6e00 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:36.929264 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1fb398f7-a21b-4489-8ec0-4d04ec5d6e00 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:37.074719 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-1fb398f7-a21b-4489-8ec0-4d04ec5d6e00 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:37.082082 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1fb398f7-a21b-4489-8ec0-4d04ec5d6e00 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1363 microversion: 2.1 time: 0.164958 Aug 25 05:31:37.082601 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 59/136] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:36 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:37.211517 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7317b0de-bc75-4bfd-9636-a12d08c203f6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:37.211517 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-7317b0de-bc75-4bfd-9636-a12d08c203f6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:37.214486 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7317b0de-bc75-4bfd-9636-a12d08c203f6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:37.214816 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7317b0de-bc75-4bfd-9636-a12d08c203f6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:37.215596 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7317b0de-bc75-4bfd-9636-a12d08c203f6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:37.216027 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7317b0de-bc75-4bfd-9636-a12d08c203f6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:37.362143 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-7317b0de-bc75-4bfd-9636-a12d08c203f6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:37.371247 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-7317b0de-bc75-4bfd-9636-a12d08c203f6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:37.372780 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-7317b0de-bc75-4bfd-9636-a12d08c203f6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:37.373928 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-7317b0de-bc75-4bfd-9636-a12d08c203f6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1407 microversion: 2.20 time: 0.171338 Aug 25 05:31:37.374496 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 78/137] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:31:37 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:31:37.465607 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-605154b4-bb82-4e25-b7d5-e93bc7abeaaf tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:37.466225 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-605154b4-bb82-4e25-b7d5-e93bc7abeaaf tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:37.472031 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-605154b4-bb82-4e25-b7d5-e93bc7abeaaf tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:37.472479 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-605154b4-bb82-4e25-b7d5-e93bc7abeaaf tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:37.473254 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-605154b4-bb82-4e25-b7d5-e93bc7abeaaf tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:37.473737 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-605154b4-bb82-4e25-b7d5-e93bc7abeaaf tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:37.613189 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-605154b4-bb82-4e25-b7d5-e93bc7abeaaf tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:37.629795 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-605154b4-bb82-4e25-b7d5-e93bc7abeaaf tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1520 microversion: 2.1 time: 0.170127 Aug 25 05:31:37.630697 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 60/138] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:37 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:31:37.631410 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [req-77242bc2-7920-49b9-90a6-348892ba3220 req-a339e152-a986-462f-a26a-645d1b33c08b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cb635d4-76ba-4143-8f4d-a64c720966da", "name": "network-vif-plugged", "status": "completed", "tag": "605f6633-54d1-4fa5-b498-9157fffe1b41"}]} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:31:37.633767 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:31:37.633767 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: warnings.warn(msg) Aug 25 05:31:37.642179 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-77242bc2-7920-49b9-90a6-348892ba3220 req-a339e152-a986-462f-a26a-645d1b33c08b service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:37.642796 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-77242bc2-7920-49b9-90a6-348892ba3220 req-a339e152-a986-462f-a26a-645d1b33c08b service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:37.656767 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.compute.server_external_events [req-77242bc2-7920-49b9-90a6-348892ba3220 req-a339e152-a986-462f-a26a-645d1b33c08b service nova] Creating event network-vif-plugged:605f6633-54d1-4fa5-b498-9157fffe1b41 for instance 4cb635d4-76ba-4143-8f4d-a64c720966da on hv-cinder-78662 Aug 25 05:31:37.662477 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [req-77242bc2-7920-49b9-90a6-348892ba3220 req-a339e152-a986-462f-a26a-645d1b33c08b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034838 Aug 25 05:31:37.663750 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 79/139] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:31:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:31:38.106351 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3fb10f07-ade4-47a5-bc2b-5a46bdeb9835 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:38.106882 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3fb10f07-ade4-47a5-bc2b-5a46bdeb9835 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:38.112958 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3fb10f07-ade4-47a5-bc2b-5a46bdeb9835 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:38.113455 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3fb10f07-ade4-47a5-bc2b-5a46bdeb9835 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:38.114411 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3fb10f07-ade4-47a5-bc2b-5a46bdeb9835 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:38.114842 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3fb10f07-ade4-47a5-bc2b-5a46bdeb9835 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:38.243723 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-3fb10f07-ade4-47a5-bc2b-5a46bdeb9835 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:38.251143 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3fb10f07-ade4-47a5-bc2b-5a46bdeb9835 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1363 microversion: 2.1 time: 0.149463 Aug 25 05:31:38.251713 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 61/140] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:38 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:38.423127 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-08093045-28ed-4b5f-bae5-bbba2f0658f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:38.424122 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-08093045-28ed-4b5f-bae5-bbba2f0658f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:38.430629 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-08093045-28ed-4b5f-bae5-bbba2f0658f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:38.431075 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-08093045-28ed-4b5f-bae5-bbba2f0658f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:38.431924 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-08093045-28ed-4b5f-bae5-bbba2f0658f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:38.432343 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-08093045-28ed-4b5f-bae5-bbba2f0658f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:38.567830 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-08093045-28ed-4b5f-bae5-bbba2f0658f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:38.577306 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-08093045-28ed-4b5f-bae5-bbba2f0658f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:38.578874 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-08093045-28ed-4b5f-bae5-bbba2f0658f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:38.579971 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-08093045-28ed-4b5f-bae5-bbba2f0658f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1407 microversion: 2.20 time: 0.161208 Aug 25 05:31:38.580572 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 80/141] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:31:38 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:31:38.647544 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d6535b49-6fc2-4056-ab83-4f03a8a9d06e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:38.648161 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-d6535b49-6fc2-4056-ab83-4f03a8a9d06e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:38.655039 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d6535b49-6fc2-4056-ab83-4f03a8a9d06e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:38.655483 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d6535b49-6fc2-4056-ab83-4f03a8a9d06e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:38.656252 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d6535b49-6fc2-4056-ab83-4f03a8a9d06e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:38.656676 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d6535b49-6fc2-4056-ab83-4f03a8a9d06e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:38.821594 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-d6535b49-6fc2-4056-ab83-4f03a8a9d06e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:38.832124 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d6535b49-6fc2-4056-ab83-4f03a8a9d06e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1520 microversion: 2.1 time: 0.188816 Aug 25 05:31:38.845806 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 62/142] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:38 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:39.269656 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-3085a31f-4674-4094-98d3-aac43fbcff55 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:39.270258 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-3085a31f-4674-4094-98d3-aac43fbcff55 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:39.278250 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3085a31f-4674-4094-98d3-aac43fbcff55 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:39.283907 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3085a31f-4674-4094-98d3-aac43fbcff55 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:39.283907 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3085a31f-4674-4094-98d3-aac43fbcff55 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:39.283907 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3085a31f-4674-4094-98d3-aac43fbcff55 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:39.419635 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-3085a31f-4674-4094-98d3-aac43fbcff55 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:39.432708 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-3085a31f-4674-4094-98d3-aac43fbcff55 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1363 microversion: 2.1 time: 0.166236 Aug 25 05:31:39.441622 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 81/143] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:39 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:39.601506 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7cbbe23e-49d5-4b0b-922a-501a97d0682c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:39.601506 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7cbbe23e-49d5-4b0b-922a-501a97d0682c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:39.606967 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7cbbe23e-49d5-4b0b-922a-501a97d0682c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:39.607416 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7cbbe23e-49d5-4b0b-922a-501a97d0682c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:39.608189 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7cbbe23e-49d5-4b0b-922a-501a97d0682c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:39.608678 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7cbbe23e-49d5-4b0b-922a-501a97d0682c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:39.737951 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-7cbbe23e-49d5-4b0b-922a-501a97d0682c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:39.747361 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-7cbbe23e-49d5-4b0b-922a-501a97d0682c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:39.748985 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-7cbbe23e-49d5-4b0b-922a-501a97d0682c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:39.750432 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7cbbe23e-49d5-4b0b-922a-501a97d0682c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1407 microversion: 2.20 time: 0.154087 Aug 25 05:31:39.750535 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 63/144] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:31:39 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:31:39.850885 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e9e42e6a-6d4f-4d7c-b0e9-01b3ebaa2a9f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:39.851521 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e9e42e6a-6d4f-4d7c-b0e9-01b3ebaa2a9f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:39.861051 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e9e42e6a-6d4f-4d7c-b0e9-01b3ebaa2a9f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:39.861682 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e9e42e6a-6d4f-4d7c-b0e9-01b3ebaa2a9f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:39.862960 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e9e42e6a-6d4f-4d7c-b0e9-01b3ebaa2a9f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:39.863701 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e9e42e6a-6d4f-4d7c-b0e9-01b3ebaa2a9f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:40.007561 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-e9e42e6a-6d4f-4d7c-b0e9-01b3ebaa2a9f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:40.015148 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e9e42e6a-6d4f-4d7c-b0e9-01b3ebaa2a9f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1520 microversion: 2.1 time: 0.169054 Aug 25 05:31:40.015707 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 82/145] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:39 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:40.453875 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-bde01172-7abe-4a92-8d70-4181e925da7a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:40.454775 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-bde01172-7abe-4a92-8d70-4181e925da7a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:40.460958 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bde01172-7abe-4a92-8d70-4181e925da7a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:40.462061 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bde01172-7abe-4a92-8d70-4181e925da7a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:40.462778 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bde01172-7abe-4a92-8d70-4181e925da7a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:40.463245 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bde01172-7abe-4a92-8d70-4181e925da7a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:40.601914 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-bde01172-7abe-4a92-8d70-4181e925da7a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:40.611054 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-bde01172-7abe-4a92-8d70-4181e925da7a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1548 microversion: 2.1 time: 0.162003 Aug 25 05:31:40.612984 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 64/146] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:40 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:40.636078 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-26f0d66a-1d65-41fe-adc1-64758717e533 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:40.637263 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-26f0d66a-1d65-41fe-adc1-64758717e533 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:40.645126 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-26f0d66a-1d65-41fe-adc1-64758717e533 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:40.645697 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-26f0d66a-1d65-41fe-adc1-64758717e533 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:40.646519 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-26f0d66a-1d65-41fe-adc1-64758717e533 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:40.646983 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-26f0d66a-1d65-41fe-adc1-64758717e533 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:40.768765 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1d4bb858-9aa8-44b4-b023-93c021d5b68d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:40.769327 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1d4bb858-9aa8-44b4-b023-93c021d5b68d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:40.775784 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1d4bb858-9aa8-44b4-b023-93c021d5b68d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:40.776222 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1d4bb858-9aa8-44b4-b023-93c021d5b68d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:40.777270 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1d4bb858-9aa8-44b4-b023-93c021d5b68d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:40.777418 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1d4bb858-9aa8-44b4-b023-93c021d5b68d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:40.790373 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-26f0d66a-1d65-41fe-adc1-64758717e533 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.158610 Aug 25 05:31:40.791568 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 83/147] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Aug 25 05:31:40 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-interface => generated 284 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:31:41.032346 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-694b7a18-04f0-4960-b483-a4d3266ffc52 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:41.033240 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-694b7a18-04f0-4960-b483-a4d3266ffc52 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:41.041652 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-694b7a18-04f0-4960-b483-a4d3266ffc52 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:41.042073 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-694b7a18-04f0-4960-b483-a4d3266ffc52 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:41.042927 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-694b7a18-04f0-4960-b483-a4d3266ffc52 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:41.043307 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-694b7a18-04f0-4960-b483-a4d3266ffc52 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:41.193102 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-1d4bb858-9aa8-44b4-b023-93c021d5b68d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:41.204515 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-1d4bb858-9aa8-44b4-b023-93c021d5b68d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:41.206387 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-1d4bb858-9aa8-44b4-b023-93c021d5b68d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:41.207928 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1d4bb858-9aa8-44b4-b023-93c021d5b68d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1407 microversion: 2.20 time: 0.442976 Aug 25 05:31:41.219710 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 65/148] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:31:40 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1407 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:31:41.448067 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-694b7a18-04f0-4960-b483-a4d3266ffc52 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:41.455621 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-694b7a18-04f0-4960-b483-a4d3266ffc52 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1520 microversion: 2.1 time: 0.426865 Aug 25 05:31:41.456189 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 84/149] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:41 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1520 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:31:42.227959 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-04cdd673-fc7b-4f60-ad2c-9ae56a32f8a4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:42.228565 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-04cdd673-fc7b-4f60-ad2c-9ae56a32f8a4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:42.234709 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-04cdd673-fc7b-4f60-ad2c-9ae56a32f8a4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:42.235133 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-04cdd673-fc7b-4f60-ad2c-9ae56a32f8a4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:42.235903 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-04cdd673-fc7b-4f60-ad2c-9ae56a32f8a4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:42.236332 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-04cdd673-fc7b-4f60-ad2c-9ae56a32f8a4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:42.469971 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-04cdd673-fc7b-4f60-ad2c-9ae56a32f8a4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:42.478257 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-04cdd673-fc7b-4f60-ad2c-9ae56a32f8a4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:42.478658 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b02d0adf-7ad7-47a4-a78d-1b1dc9cccd1e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:42.479777 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-04cdd673-fc7b-4f60-ad2c-9ae56a32f8a4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:42.480001 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b02d0adf-7ad7-47a4-a78d-1b1dc9cccd1e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:42.494608 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-04cdd673-fc7b-4f60-ad2c-9ae56a32f8a4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1599 microversion: 2.20 time: 0.257220 Aug 25 05:31:42.494608 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 66/150] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:31:42 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1599 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:31:42.501301 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b02d0adf-7ad7-47a4-a78d-1b1dc9cccd1e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:42.502034 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b02d0adf-7ad7-47a4-a78d-1b1dc9cccd1e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:42.503023 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b02d0adf-7ad7-47a4-a78d-1b1dc9cccd1e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:42.503234 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-27beabb4-6b8f-4880-9f50-9eeeda6c907c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:42.503738 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-27beabb4-6b8f-4880-9f50-9eeeda6c907c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:42.504120 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b02d0adf-7ad7-47a4-a78d-1b1dc9cccd1e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:42.513349 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-27beabb4-6b8f-4880-9f50-9eeeda6c907c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:42.514916 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-27beabb4-6b8f-4880-9f50-9eeeda6c907c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:42.515349 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-27beabb4-6b8f-4880-9f50-9eeeda6c907c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:42.515796 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-27beabb4-6b8f-4880-9f50-9eeeda6c907c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:42.652857 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-27beabb4-6b8f-4880-9f50-9eeeda6c907c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.154029 Aug 25 05:31:42.653777 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 67/151] 10.222.0.42 () {60 vars in 1316 bytes} [Wed Aug 25 05:31:42 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-interface => generated 285 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:31:42.658770 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d1554b10-6341-4c1b-bc7c-c1c00d6e7620 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:31:42.660064 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-d1554b10-6341-4c1b-bc7c-c1c00d6e7620 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:42.667377 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d1554b10-6341-4c1b-bc7c-c1c00d6e7620 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:42.667824 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d1554b10-6341-4c1b-bc7c-c1c00d6e7620 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:42.668600 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d1554b10-6341-4c1b-bc7c-c1c00d6e7620 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:42.669032 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d1554b10-6341-4c1b-bc7c-c1c00d6e7620 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:42.704640 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-b02d0adf-7ad7-47a4-a78d-1b1dc9cccd1e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:42.713641 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b02d0adf-7ad7-47a4-a78d-1b1dc9cccd1e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1520 microversion: 2.1 time: 0.243920 Aug 25 05:31:42.714391 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 85/152] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:42 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:42.719824 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [req-008392f8-5013-40cf-95d1-574d92857ba2 req-e4a612d2-cbb5-4718-b78f-1fe248cb271a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c438716-186a-4b29-b29e-e9c6a71a5a27", "tag": "b6d4c9a3-6a56-41ed-b144-3a1d1e9cfbd6"}]} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:31:42.721542 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:31:42.721542 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: warnings.warn(msg) Aug 25 05:31:42.732987 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-008392f8-5013-40cf-95d1-574d92857ba2 req-e4a612d2-cbb5-4718-b78f-1fe248cb271a service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:42.733690 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-008392f8-5013-40cf-95d1-574d92857ba2 req-e4a612d2-cbb5-4718-b78f-1fe248cb271a service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:42.746088 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.compute.server_external_events [req-008392f8-5013-40cf-95d1-574d92857ba2 req-e4a612d2-cbb5-4718-b78f-1fe248cb271a service nova] Creating event network-changed:b6d4c9a3-6a56-41ed-b144-3a1d1e9cfbd6 for instance 4c438716-186a-4b29-b29e-e9c6a71a5a27 on hv-cinder-78662 Aug 25 05:31:42.752059 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [req-008392f8-5013-40cf-95d1-574d92857ba2 req-e4a612d2-cbb5-4718-b78f-1fe248cb271a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035826 Aug 25 05:31:42.752967 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 86/153] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:31:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:31:43.736474 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-36d75968-f4f8-45f7-9411-25c09f20c2d6 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:43.737875 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-36d75968-f4f8-45f7-9411-25c09f20c2d6 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:43.748264 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-36d75968-f4f8-45f7-9411-25c09f20c2d6 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:43.748901 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-36d75968-f4f8-45f7-9411-25c09f20c2d6 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:43.750052 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-36d75968-f4f8-45f7-9411-25c09f20c2d6 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:43.750733 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-36d75968-f4f8-45f7-9411-25c09f20c2d6 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:43.920929 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-36d75968-f4f8-45f7-9411-25c09f20c2d6 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:43.930207 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-36d75968-f4f8-45f7-9411-25c09f20c2d6 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1520 microversion: 2.1 time: 0.200526 Aug 25 05:31:43.931681 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 87/154] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:43 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:31:44.222388 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-32209e5b-b7da-4b34-ae2d-652ea8f79ab4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:31:44.223331 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-32209e5b-b7da-4b34-ae2d-652ea8f79ab4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:44.229884 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-32209e5b-b7da-4b34-ae2d-652ea8f79ab4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:44.230328 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-32209e5b-b7da-4b34-ae2d-652ea8f79ab4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:44.231128 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-32209e5b-b7da-4b34-ae2d-652ea8f79ab4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:44.231553 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-32209e5b-b7da-4b34-ae2d-652ea8f79ab4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:45.918290 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d1554b10-6341-4c1b-bc7c-c1c00d6e7620 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 14 microversion: 2.1 time: 3.263040 Aug 25 05:31:45.919307 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 68/155] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:31:42 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 14 bytes in 3265 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 05:31:45.926179 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [req-14c08215-90f6-49ea-a0a0-54ab1e32c56c req-4d00c709-c999-4fe7-acd6-3b47a381ac79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cb635d4-76ba-4143-8f4d-a64c720966da", "tag": "605f6633-54d1-4fa5-b498-9157fffe1b41"}]} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:31:45.927998 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:31:45.927998 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: warnings.warn(msg) Aug 25 05:31:45.936235 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-14c08215-90f6-49ea-a0a0-54ab1e32c56c req-4d00c709-c999-4fe7-acd6-3b47a381ac79 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:45.936698 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-14c08215-90f6-49ea-a0a0-54ab1e32c56c req-4d00c709-c999-4fe7-acd6-3b47a381ac79 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:45.949831 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.compute.server_external_events [req-14c08215-90f6-49ea-a0a0-54ab1e32c56c req-4d00c709-c999-4fe7-acd6-3b47a381ac79 service nova] Creating event network-changed:605f6633-54d1-4fa5-b498-9157fffe1b41 for instance 4cb635d4-76ba-4143-8f4d-a64c720966da on hv-cinder-78662 Aug 25 05:31:45.950041 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-32209e5b-b7da-4b34-ae2d-652ea8f79ab4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 14 microversion: 2.20 time: 1.731399 Aug 25 05:31:45.953453 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 88/156] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:31:44 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 14 bytes in 1736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:31:45.955150 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [req-14c08215-90f6-49ea-a0a0-54ab1e32c56c req-4d00c709-c999-4fe7-acd6-3b47a381ac79 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034244 Aug 25 05:31:45.956133 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 69/157] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:31:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:31:45.961390 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-78e1cd47-d8ef-4174-93a6-a3c090f8607e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:45.961390 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-78e1cd47-d8ef-4174-93a6-a3c090f8607e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:45.967957 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-78e1cd47-d8ef-4174-93a6-a3c090f8607e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:45.968667 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-78e1cd47-d8ef-4174-93a6-a3c090f8607e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:45.969452 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-78e1cd47-d8ef-4174-93a6-a3c090f8607e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:45.969921 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-78e1cd47-d8ef-4174-93a6-a3c090f8607e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:46.098035 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-78e1cd47-d8ef-4174-93a6-a3c090f8607e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:46.106294 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-78e1cd47-d8ef-4174-93a6-a3c090f8607e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1520 microversion: 2.1 time: 0.151256 Aug 25 05:31:46.106866 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 89/158] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:45 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:46.931290 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-44c3260a-1ecd-45b1-9e28-7e2cae5dabfe tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:31:46.933504 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-44c3260a-1ecd-45b1-9e28-7e2cae5dabfe tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:46.940209 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-44c3260a-1ecd-45b1-9e28-7e2cae5dabfe tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:46.954981 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-44c3260a-1ecd-45b1-9e28-7e2cae5dabfe tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:46.954981 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-44c3260a-1ecd-45b1-9e28-7e2cae5dabfe tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:46.954981 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-44c3260a-1ecd-45b1-9e28-7e2cae5dabfe tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:46.962975 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ff04c13c-a27f-4e13-bda7-af0e03322c68 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:31:46.965377 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ff04c13c-a27f-4e13-bda7-af0e03322c68 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:46.973558 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ff04c13c-a27f-4e13-bda7-af0e03322c68 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:46.973999 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ff04c13c-a27f-4e13-bda7-af0e03322c68 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:46.975354 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ff04c13c-a27f-4e13-bda7-af0e03322c68 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:46.975793 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ff04c13c-a27f-4e13-bda7-af0e03322c68 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:51.243311 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-44c3260a-1ecd-45b1-9e28-7e2cae5dabfe tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 14 microversion: 2.1 time: 4.316651 Aug 25 05:31:51.247340 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 70/159] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:31:46 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 14 bytes in 4319 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 05:31:51.255512 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-81aa4c8d-a9be-4eb2-8222-707428801f51 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:51.255512 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-81aa4c8d-a9be-4eb2-8222-707428801f51 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:51.256317 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-81aa4c8d-a9be-4eb2-8222-707428801f51 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:51.256755 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-81aa4c8d-a9be-4eb2-8222-707428801f51 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:51.257542 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-81aa4c8d-a9be-4eb2-8222-707428801f51 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:51.258230 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-81aa4c8d-a9be-4eb2-8222-707428801f51 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:51.278674 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ff04c13c-a27f-4e13-bda7-af0e03322c68 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 14 microversion: 2.20 time: 4.321287 Aug 25 05:31:51.279573 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 90/160] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:31:46 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 14 bytes in 4323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:51.388049 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-81aa4c8d-a9be-4eb2-8222-707428801f51 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:51.395365 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-81aa4c8d-a9be-4eb2-8222-707428801f51 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1520 microversion: 2.1 time: 0.150072 Aug 25 05:31:51.395933 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 71/161] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:51 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:52.255273 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b109e97a-e89a-4324-9ce1-5c2e01e05988 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:31:52.256476 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b109e97a-e89a-4324-9ce1-5c2e01e05988 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:52.263826 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b109e97a-e89a-4324-9ce1-5c2e01e05988 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:52.264272 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b109e97a-e89a-4324-9ce1-5c2e01e05988 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:52.265065 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b109e97a-e89a-4324-9ce1-5c2e01e05988 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:52.265518 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b109e97a-e89a-4324-9ce1-5c2e01e05988 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:52.291770 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-40f22ce9-11de-45c1-be2f-84dcedc16ba2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:31:52.292938 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-40f22ce9-11de-45c1-be2f-84dcedc16ba2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:52.299542 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-40f22ce9-11de-45c1-be2f-84dcedc16ba2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:52.299979 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-40f22ce9-11de-45c1-be2f-84dcedc16ba2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:52.300766 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-40f22ce9-11de-45c1-be2f-84dcedc16ba2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:52.301373 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-40f22ce9-11de-45c1-be2f-84dcedc16ba2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:52.335669 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b109e97a-e89a-4324-9ce1-5c2e01e05988 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 14 microversion: 2.1 time: 0.083945 Aug 25 05:31:52.336921 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 91/162] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:31:52 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 05:31:52.392651 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-40f22ce9-11de-45c1-be2f-84dcedc16ba2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 14 microversion: 2.20 time: 0.104756 Aug 25 05:31:52.396299 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 72/163] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:31:52 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:31:52.412383 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1e15b488-255f-4c75-9628-8d26ef9ebe69 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:52.413772 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1e15b488-255f-4c75-9628-8d26ef9ebe69 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:52.421398 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1e15b488-255f-4c75-9628-8d26ef9ebe69 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:52.421874 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1e15b488-255f-4c75-9628-8d26ef9ebe69 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:52.422723 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1e15b488-255f-4c75-9628-8d26ef9ebe69 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:52.423153 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1e15b488-255f-4c75-9628-8d26ef9ebe69 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:52.561992 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-1e15b488-255f-4c75-9628-8d26ef9ebe69 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:52.566742 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1e15b488-255f-4c75-9628-8d26ef9ebe69 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1520 microversion: 2.1 time: 0.158273 Aug 25 05:31:52.576825 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 92/164] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:52 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:53.347783 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-afb1c63a-c328-4623-80c4-828721b4cdce tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:31:53.349011 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-afb1c63a-c328-4623-80c4-828721b4cdce tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:53.355721 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-afb1c63a-c328-4623-80c4-828721b4cdce tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:53.356179 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-afb1c63a-c328-4623-80c4-828721b4cdce tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:53.356938 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-afb1c63a-c328-4623-80c4-828721b4cdce tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:53.357379 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-afb1c63a-c328-4623-80c4-828721b4cdce tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:53.404879 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5eebddbc-958c-49df-81d5-9aabed6a6e67 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:31:53.405755 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5eebddbc-958c-49df-81d5-9aabed6a6e67 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:53.411749 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5eebddbc-958c-49df-81d5-9aabed6a6e67 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:53.412195 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5eebddbc-958c-49df-81d5-9aabed6a6e67 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:53.413001 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5eebddbc-958c-49df-81d5-9aabed6a6e67 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:53.413429 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5eebddbc-958c-49df-81d5-9aabed6a6e67 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:56.815108 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-afb1c63a-c328-4623-80c4-828721b4cdce tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 14 microversion: 2.1 time: 3.471323 Aug 25 05:31:56.815753 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 73/165] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:31:53 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 14 bytes in 3473 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 05:31:56.823387 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d6a4e616-c5e9-46c1-8d0c-8caede503bcb tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:56.824239 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-d6a4e616-c5e9-46c1-8d0c-8caede503bcb tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:56.830853 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d6a4e616-c5e9-46c1-8d0c-8caede503bcb tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:56.831347 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d6a4e616-c5e9-46c1-8d0c-8caede503bcb tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:56.832160 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d6a4e616-c5e9-46c1-8d0c-8caede503bcb tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:56.832608 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d6a4e616-c5e9-46c1-8d0c-8caede503bcb tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:56.840881 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5eebddbc-958c-49df-81d5-9aabed6a6e67 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 14 microversion: 2.20 time: 3.440695 Aug 25 05:31:56.841854 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 93/166] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:31:53 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 14 bytes in 3442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:31:56.847314 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-662f2245-79e3-46c9-93c2-f0d1a0b8642e tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:56.853717 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-662f2245-79e3-46c9-93c2-f0d1a0b8642e tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:56.855485 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-662f2245-79e3-46c9-93c2-f0d1a0b8642e tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:56.856120 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-662f2245-79e3-46c9-93c2-f0d1a0b8642e tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:56.857515 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-662f2245-79e3-46c9-93c2-f0d1a0b8642e tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:56.857993 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-662f2245-79e3-46c9-93c2-f0d1a0b8642e tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:56.884049 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-662f2245-79e3-46c9-93c2-f0d1a0b8642e tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Going to try to terminate instance {{(pid=108885) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 25 05:31:56.976236 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-d6a4e616-c5e9-46c1-8d0c-8caede503bcb tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:56.984060 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d6a4e616-c5e9-46c1-8d0c-8caede503bcb tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1520 microversion: 2.1 time: 0.166770 Aug 25 05:31:56.984661 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 74/167] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:56 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:57.349339 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-662f2245-79e3-46c9-93c2-f0d1a0b8642e tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d" status: 204 len: 0 microversion: 2.1 time: 0.505694 Aug 25 05:31:57.349911 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 94/168] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 25 05:31:56 2021] DELETE /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 05:31:57.358724 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-440b425b-ef60-4a2c-bb17-832fca091d40 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:57.359448 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-440b425b-ef60-4a2c-bb17-832fca091d40 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:57.365420 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-440b425b-ef60-4a2c-bb17-832fca091d40 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:57.365891 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-440b425b-ef60-4a2c-bb17-832fca091d40 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:57.366644 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-440b425b-ef60-4a2c-bb17-832fca091d40 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:57.367141 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-440b425b-ef60-4a2c-bb17-832fca091d40 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:57.508930 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-440b425b-ef60-4a2c-bb17-832fca091d40 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35da6a5109cb482bbf144927215467f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a213191904a64205b483c88adabf87a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:57.518244 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-440b425b-ef60-4a2c-bb17-832fca091d40 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d" status: 200 len: 1554 microversion: 2.1 time: 0.163825 Aug 25 05:31:57.521937 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 75/169] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:57 2021] GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:57.831921 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7d867d3b-93a0-4868-b11e-a1aab764a119 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:31:57.832935 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-7d867d3b-93a0-4868-b11e-a1aab764a119 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:57.838933 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7d867d3b-93a0-4868-b11e-a1aab764a119 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:57.839384 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7d867d3b-93a0-4868-b11e-a1aab764a119 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:57.840164 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7d867d3b-93a0-4868-b11e-a1aab764a119 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:57.840966 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7d867d3b-93a0-4868-b11e-a1aab764a119 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:57.853639 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7fa092ff-3a86-4f63-96a3-f8be0308f96c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:31:57.854978 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7fa092ff-3a86-4f63-96a3-f8be0308f96c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:57.861926 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7fa092ff-3a86-4f63-96a3-f8be0308f96c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:57.862450 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7fa092ff-3a86-4f63-96a3-f8be0308f96c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:57.863310 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7fa092ff-3a86-4f63-96a3-f8be0308f96c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:57.863802 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7fa092ff-3a86-4f63-96a3-f8be0308f96c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:57.931288 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-7d867d3b-93a0-4868-b11e-a1aab764a119 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 14 microversion: 2.1 time: 0.106802 Aug 25 05:31:57.931971 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 95/170] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:31:57 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 05:31:57.948900 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7fa092ff-3a86-4f63-96a3-f8be0308f96c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 14 microversion: 2.20 time: 0.100228 Aug 25 05:31:57.955897 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 76/171] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:31:57 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:31:58.003106 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-8436c34c-5761-43f9-8e23-e79281e50962 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:58.003866 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-8436c34c-5761-43f9-8e23-e79281e50962 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:58.010265 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8436c34c-5761-43f9-8e23-e79281e50962 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:58.010702 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8436c34c-5761-43f9-8e23-e79281e50962 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:58.011484 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8436c34c-5761-43f9-8e23-e79281e50962 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:58.011933 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8436c34c-5761-43f9-8e23-e79281e50962 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:58.146840 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-8436c34c-5761-43f9-8e23-e79281e50962 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:58.154885 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-8436c34c-5761-43f9-8e23-e79281e50962 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1520 microversion: 2.1 time: 0.155580 Aug 25 05:31:58.155884 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 96/172] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:57 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:58.535655 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-81fbd46d-f474-4701-8663-b976d50a3d6e tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:58.536347 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-81fbd46d-f474-4701-8663-b976d50a3d6e tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:58.543307 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-81fbd46d-f474-4701-8663-b976d50a3d6e tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:58.543752 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-81fbd46d-f474-4701-8663-b976d50a3d6e tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:58.545605 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-81fbd46d-f474-4701-8663-b976d50a3d6e tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:58.546055 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-81fbd46d-f474-4701-8663-b976d50a3d6e tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:58.673614 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-81fbd46d-f474-4701-8663-b976d50a3d6e tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35da6a5109cb482bbf144927215467f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a213191904a64205b483c88adabf87a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:58.681677 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-81fbd46d-f474-4701-8663-b976d50a3d6e tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d" status: 200 len: 1554 microversion: 2.1 time: 0.149942 Aug 25 05:31:58.682245 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 77/173] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:31:58 2021] GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:58.943199 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-23636205-3bdc-4b0e-9f89-5b711b765614 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:31:58.944932 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-23636205-3bdc-4b0e-9f89-5b711b765614 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:58.951409 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-23636205-3bdc-4b0e-9f89-5b711b765614 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:58.951851 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-23636205-3bdc-4b0e-9f89-5b711b765614 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:58.952633 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-23636205-3bdc-4b0e-9f89-5b711b765614 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:58.953062 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-23636205-3bdc-4b0e-9f89-5b711b765614 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:58.965596 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6bb96844-12fb-4c1e-96dc-044d25d79c5a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:31:58.967382 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6bb96844-12fb-4c1e-96dc-044d25d79c5a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:31:58.973513 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6bb96844-12fb-4c1e-96dc-044d25d79c5a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:58.973989 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6bb96844-12fb-4c1e-96dc-044d25d79c5a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:31:58.974758 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6bb96844-12fb-4c1e-96dc-044d25d79c5a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:31:58.980660 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6bb96844-12fb-4c1e-96dc-044d25d79c5a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:02.820497 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6bb96844-12fb-4c1e-96dc-044d25d79c5a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 15025 microversion: 2.20 time: 3.858831 Aug 25 05:32:02.821279 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 78/174] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:31:58 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 15025 bytes in 3862 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 25 05:32:02.828740 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ec51b97c-26a1-4e62-9293-1e395703ec9d tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:02.829436 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ec51b97c-26a1-4e62-9293-1e395703ec9d tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:02.834649 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-23636205-3bdc-4b0e-9f89-5b711b765614 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 15064 microversion: 2.1 time: 3.895020 Aug 25 05:32:02.835448 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 97/175] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:31:58 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 15064 bytes in 3897 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:32:02.836533 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ec51b97c-26a1-4e62-9293-1e395703ec9d tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:02.836977 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ec51b97c-26a1-4e62-9293-1e395703ec9d tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:02.837940 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ec51b97c-26a1-4e62-9293-1e395703ec9d tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:02.838286 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ec51b97c-26a1-4e62-9293-1e395703ec9d tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:02.840689 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-8d402b53-f3dd-4add-a142-b2aa0c56f1da tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:02.842625 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-8d402b53-f3dd-4add-a142-b2aa0c56f1da tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:02.849388 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8d402b53-f3dd-4add-a142-b2aa0c56f1da tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:02.849856 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8d402b53-f3dd-4add-a142-b2aa0c56f1da tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:02.850667 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8d402b53-f3dd-4add-a142-b2aa0c56f1da tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:02.851094 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8d402b53-f3dd-4add-a142-b2aa0c56f1da tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:03.035388 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-8d402b53-f3dd-4add-a142-b2aa0c56f1da tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35da6a5109cb482bbf144927215467f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a213191904a64205b483c88adabf87a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:03.042988 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ec51b97c-26a1-4e62-9293-1e395703ec9d tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:03.044041 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-8d402b53-f3dd-4add-a142-b2aa0c56f1da tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d" status: 200 len: 1554 microversion: 2.1 time: 0.207268 Aug 25 05:32:03.044802 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 98/176] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:02 2021] GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d => generated 1554 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:32:03.052604 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ec51b97c-26a1-4e62-9293-1e395703ec9d tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1520 microversion: 2.1 time: 0.229747 Aug 25 05:32:03.052702 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 79/177] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:02 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:32:03.834270 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-71623f77-6a0c-4de8-960e-835433932b53 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:03.835228 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-71623f77-6a0c-4de8-960e-835433932b53 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:03.841271 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-71623f77-6a0c-4de8-960e-835433932b53 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:03.842389 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-71623f77-6a0c-4de8-960e-835433932b53 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:03.843296 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-71623f77-6a0c-4de8-960e-835433932b53 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:03.843732 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-71623f77-6a0c-4de8-960e-835433932b53 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:03.846183 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b61af06d-af4f-4683-acf2-40744612b4e1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:03.847083 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b61af06d-af4f-4683-acf2-40744612b4e1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:03.854854 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b61af06d-af4f-4683-acf2-40744612b4e1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:03.855377 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b61af06d-af4f-4683-acf2-40744612b4e1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:03.856226 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b61af06d-af4f-4683-acf2-40744612b4e1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:03.856698 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b61af06d-af4f-4683-acf2-40744612b4e1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:04.009724 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b61af06d-af4f-4683-acf2-40744612b4e1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 17602 microversion: 2.1 time: 0.164564 Aug 25 05:32:04.010982 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 80/178] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:32:03 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 17602 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:32:04.027703 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-71623f77-6a0c-4de8-960e-835433932b53 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 17686 microversion: 2.20 time: 0.196721 Aug 25 05:32:04.029280 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 99/179] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:32:03 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 17686 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:32:04.071001 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5fb3622b-df5c-4933-826a-4fd450cf8e3f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:04.081440 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5fb3622b-df5c-4933-826a-4fd450cf8e3f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:04.081873 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-4ae9157f-f3aa-4308-898c-9c2d8a738af5 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:04.081873 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-4ae9157f-f3aa-4308-898c-9c2d8a738af5 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:04.082037 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5fb3622b-df5c-4933-826a-4fd450cf8e3f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:04.082037 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5fb3622b-df5c-4933-826a-4fd450cf8e3f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:04.082466 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5fb3622b-df5c-4933-826a-4fd450cf8e3f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:04.082970 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5fb3622b-df5c-4933-826a-4fd450cf8e3f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:04.084844 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4ae9157f-f3aa-4308-898c-9c2d8a738af5 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:04.085233 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4ae9157f-f3aa-4308-898c-9c2d8a738af5 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:04.086050 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4ae9157f-f3aa-4308-898c-9c2d8a738af5 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:04.086480 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4ae9157f-f3aa-4308-898c-9c2d8a738af5 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:04.287073 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-4ae9157f-f3aa-4308-898c-9c2d8a738af5 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35da6a5109cb482bbf144927215467f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a213191904a64205b483c88adabf87a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:04.294683 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-5fb3622b-df5c-4933-826a-4fd450cf8e3f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:04.296867 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-4ae9157f-f3aa-4308-898c-9c2d8a738af5 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d" status: 200 len: 1554 microversion: 2.1 time: 0.235734 Aug 25 05:32:04.297787 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 81/180] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:04 2021] GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d => generated 1554 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:32:04.304105 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5fb3622b-df5c-4933-826a-4fd450cf8e3f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1520 microversion: 2.1 time: 0.237360 Aug 25 05:32:04.304683 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 100/181] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:04 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:32:05.019991 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-85e42860-4b40-4ab4-87dc-3558f127b3cc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:05.020920 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-85e42860-4b40-4ab4-87dc-3558f127b3cc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:05.027028 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-85e42860-4b40-4ab4-87dc-3558f127b3cc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:05.027478 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-85e42860-4b40-4ab4-87dc-3558f127b3cc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:05.028253 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-85e42860-4b40-4ab4-87dc-3558f127b3cc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:05.028740 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-85e42860-4b40-4ab4-87dc-3558f127b3cc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:05.053902 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1e3e35d6-4b36-4bb8-972a-50b8192928f9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:05.054537 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1e3e35d6-4b36-4bb8-972a-50b8192928f9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:05.062074 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1e3e35d6-4b36-4bb8-972a-50b8192928f9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:05.062552 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1e3e35d6-4b36-4bb8-972a-50b8192928f9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:05.063329 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1e3e35d6-4b36-4bb8-972a-50b8192928f9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:05.063758 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1e3e35d6-4b36-4bb8-972a-50b8192928f9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:08.996826 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-85e42860-4b40-4ab4-87dc-3558f127b3cc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 24384 microversion: 2.1 time: 3.980189 Aug 25 05:32:08.998986 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 82/182] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:32:05 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 24384 bytes in 3983 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:32:09.009262 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e1cf700e-5137-4feb-80ec-1b157411a505 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:09.010822 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e1cf700e-5137-4feb-80ec-1b157411a505 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:09.020801 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e1cf700e-5137-4feb-80ec-1b157411a505 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:09.022723 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1e3e35d6-4b36-4bb8-972a-50b8192928f9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 23882 microversion: 2.20 time: 3.972131 Aug 25 05:32:09.023259 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e1cf700e-5137-4feb-80ec-1b157411a505 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:09.023342 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 101/183] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:32:05 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 23882 bytes in 3974 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 25 05:32:09.023433 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e1cf700e-5137-4feb-80ec-1b157411a505 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:09.023680 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e1cf700e-5137-4feb-80ec-1b157411a505 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:09.028913 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9398d398-71a4-4c4d-955e-3cf279295359 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:09.030626 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9398d398-71a4-4c4d-955e-3cf279295359 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:09.037276 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9398d398-71a4-4c4d-955e-3cf279295359 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:09.038172 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9398d398-71a4-4c4d-955e-3cf279295359 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:09.046508 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9398d398-71a4-4c4d-955e-3cf279295359 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:09.046508 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9398d398-71a4-4c4d-955e-3cf279295359 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:09.275325 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e1cf700e-5137-4feb-80ec-1b157411a505 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35da6a5109cb482bbf144927215467f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a213191904a64205b483c88adabf87a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:09.288389 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-9398d398-71a4-4c4d-955e-3cf279295359 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:09.291515 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e1cf700e-5137-4feb-80ec-1b157411a505 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d" status: 200 len: 1554 microversion: 2.1 time: 0.290495 Aug 25 05:32:09.292807 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 83/184] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:08 2021] GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d => generated 1554 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:32:09.296420 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9398d398-71a4-4c4d-955e-3cf279295359 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1520 microversion: 2.1 time: 0.271944 Aug 25 05:32:09.297222 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 102/185] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:09 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1520 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:32:09.306384 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [req-f6a8d457-3088-4e75-bf06-374b413e340d req-065ffcea-3343-463a-93f3-62adb08acf37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d7a5079-3e2a-4e51-ba95-5feb0d27b87d", "name": "network-vif-unplugged", "status": "completed", "tag": "e5c62734-8dcc-4f75-a5c1-7470ccc335d9"}]} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:09.306384 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:32:09.306384 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: warnings.warn(msg) Aug 25 05:32:09.314442 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-f6a8d457-3088-4e75-bf06-374b413e340d req-065ffcea-3343-463a-93f3-62adb08acf37 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:09.314975 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-f6a8d457-3088-4e75-bf06-374b413e340d req-065ffcea-3343-463a-93f3-62adb08acf37 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:09.328409 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.compute.server_external_events [req-f6a8d457-3088-4e75-bf06-374b413e340d req-065ffcea-3343-463a-93f3-62adb08acf37 service nova] Creating event network-vif-unplugged:e5c62734-8dcc-4f75-a5c1-7470ccc335d9 for instance 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d on hv-cinder-78662 Aug 25 05:32:09.333810 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [req-f6a8d457-3088-4e75-bf06-374b413e340d req-065ffcea-3343-463a-93f3-62adb08acf37 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039518 Aug 25 05:32:09.334775 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 84/186] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:32:09 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:32:10.010826 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-fa68e5bc-7adc-4fb2-9db0-3ff30a24de9b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:10.011851 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-fa68e5bc-7adc-4fb2-9db0-3ff30a24de9b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:10.019510 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fa68e5bc-7adc-4fb2-9db0-3ff30a24de9b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:10.019973 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fa68e5bc-7adc-4fb2-9db0-3ff30a24de9b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:10.020741 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fa68e5bc-7adc-4fb2-9db0-3ff30a24de9b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:10.021173 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fa68e5bc-7adc-4fb2-9db0-3ff30a24de9b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:10.034342 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b456a081-2c4a-4266-9ec8-0fd2e0a441d2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:10.036874 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b456a081-2c4a-4266-9ec8-0fd2e0a441d2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:10.051671 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b456a081-2c4a-4266-9ec8-0fd2e0a441d2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:10.051671 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b456a081-2c4a-4266-9ec8-0fd2e0a441d2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:10.052336 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b456a081-2c4a-4266-9ec8-0fd2e0a441d2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:10.056194 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b456a081-2c4a-4266-9ec8-0fd2e0a441d2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:10.174528 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-fa68e5bc-7adc-4fb2-9db0-3ff30a24de9b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 25337 microversion: 2.1 time: 0.167491 Aug 25 05:32:10.179015 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 103/187] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:32:10 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 25337 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:32:10.187094 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [req-bb42fc46-0436-48ad-bf33-771c8bfaba87 req-265b0078-25a9-4efa-9cfc-74166bf3267a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d7a5079-3e2a-4e51-ba95-5feb0d27b87d", "name": "network-vif-deleted", "tag": "e5c62734-8dcc-4f75-a5c1-7470ccc335d9"}]} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:10.187094 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:32:10.187094 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: warnings.warn(msg) Aug 25 05:32:10.191326 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-bb42fc46-0436-48ad-bf33-771c8bfaba87 req-265b0078-25a9-4efa-9cfc-74166bf3267a service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:10.191762 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-bb42fc46-0436-48ad-bf33-771c8bfaba87 req-265b0078-25a9-4efa-9cfc-74166bf3267a service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:10.203992 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.compute.server_external_events [req-bb42fc46-0436-48ad-bf33-771c8bfaba87 req-265b0078-25a9-4efa-9cfc-74166bf3267a service nova] Creating event network-vif-deleted:e5c62734-8dcc-4f75-a5c1-7470ccc335d9 for instance 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d on hv-cinder-78662 Aug 25 05:32:10.208996 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [req-bb42fc46-0436-48ad-bf33-771c8bfaba87 req-265b0078-25a9-4efa-9cfc-74166bf3267a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032352 Aug 25 05:32:10.209568 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 104/188] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:32:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:32:10.243979 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b456a081-2c4a-4266-9ec8-0fd2e0a441d2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 24857 microversion: 2.20 time: 0.214837 Aug 25 05:32:10.244702 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 85/189] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:32:10 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 24857 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:32:10.313408 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2b00f3f7-201d-4ce5-9317-ee8fd0b789e9 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:10.314231 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2b00f3f7-201d-4ce5-9317-ee8fd0b789e9 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:10.315969 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6ec557ea-524d-41bc-abf0-9cb47fb9b868 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:10.316736 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6ec557ea-524d-41bc-abf0-9cb47fb9b868 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:10.321623 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2b00f3f7-201d-4ce5-9317-ee8fd0b789e9 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:10.322168 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2b00f3f7-201d-4ce5-9317-ee8fd0b789e9 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:10.323161 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2b00f3f7-201d-4ce5-9317-ee8fd0b789e9 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:10.323494 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2b00f3f7-201d-4ce5-9317-ee8fd0b789e9 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:10.325378 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6ec557ea-524d-41bc-abf0-9cb47fb9b868 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:10.326256 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6ec557ea-524d-41bc-abf0-9cb47fb9b868 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:10.327043 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6ec557ea-524d-41bc-abf0-9cb47fb9b868 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:10.327551 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6ec557ea-524d-41bc-abf0-9cb47fb9b868 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:10.420752 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-2b00f3f7-201d-4ce5-9317-ee8fd0b789e9 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35da6a5109cb482bbf144927215467f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a213191904a64205b483c88adabf87a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:10.441242 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2b00f3f7-201d-4ce5-9317-ee8fd0b789e9 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d" status: 200 len: 1512 microversion: 2.1 time: 0.129900 Aug 25 05:32:10.442062 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 105/190] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:10 2021] GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d => generated 1512 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:32:10.504473 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6ec557ea-524d-41bc-abf0-9cb47fb9b868 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:10.512128 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6ec557ea-524d-41bc-abf0-9cb47fb9b868 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1520 microversion: 2.1 time: 0.200274 Aug 25 05:32:10.512694 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 86/191] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:10 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:32:11.186861 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-87d042af-ae3d-47db-a6c4-840d2dd9764e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:11.187793 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-87d042af-ae3d-47db-a6c4-840d2dd9764e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:11.194928 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-87d042af-ae3d-47db-a6c4-840d2dd9764e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:11.195422 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-87d042af-ae3d-47db-a6c4-840d2dd9764e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:11.196248 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-87d042af-ae3d-47db-a6c4-840d2dd9764e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:11.196687 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-87d042af-ae3d-47db-a6c4-840d2dd9764e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:11.256721 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5ff75083-8ad5-4973-9217-85a3df38a20c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:11.257622 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5ff75083-8ad5-4973-9217-85a3df38a20c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:11.264485 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5ff75083-8ad5-4973-9217-85a3df38a20c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:11.265045 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5ff75083-8ad5-4973-9217-85a3df38a20c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:11.265872 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5ff75083-8ad5-4973-9217-85a3df38a20c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:11.266372 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5ff75083-8ad5-4973-9217-85a3df38a20c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:11.291499 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-87d042af-ae3d-47db-a6c4-840d2dd9764e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 26228 microversion: 2.1 time: 0.108389 Aug 25 05:32:11.295928 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 106/192] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:32:11 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 26228 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:32:11.354991 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5ff75083-8ad5-4973-9217-85a3df38a20c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 25864 microversion: 2.20 time: 0.102107 Aug 25 05:32:11.357462 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 87/193] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:32:11 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 25864 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 25 05:32:11.466389 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a400dc0f-bc8c-40c3-8198-bdac21b11e6c tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:11.467048 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a400dc0f-bc8c-40c3-8198-bdac21b11e6c tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:11.474283 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a400dc0f-bc8c-40c3-8198-bdac21b11e6c tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:11.474766 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a400dc0f-bc8c-40c3-8198-bdac21b11e6c tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:11.475508 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a400dc0f-bc8c-40c3-8198-bdac21b11e6c tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:11.475942 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a400dc0f-bc8c-40c3-8198-bdac21b11e6c tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:11.508006 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a400dc0f-bc8c-40c3-8198-bdac21b11e6c tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:11.508355 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a400dc0f-bc8c-40c3-8198-bdac21b11e6c tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:11.508812 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.objects.instance [None req-a400dc0f-bc8c-40c3-8198-bdac21b11e6c tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lazy-loading 'fault' on Instance uuid 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d {{(pid=108885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 05:32:11.530398 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a369d84c-06ad-4cf5-8ab4-1a5ac06b468b tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:11.531125 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a369d84c-06ad-4cf5-8ab4-1a5ac06b468b tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:11.538015 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a369d84c-06ad-4cf5-8ab4-1a5ac06b468b tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:11.538491 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a369d84c-06ad-4cf5-8ab4-1a5ac06b468b tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:11.539417 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a369d84c-06ad-4cf5-8ab4-1a5ac06b468b tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:11.540087 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a369d84c-06ad-4cf5-8ab4-1a5ac06b468b tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:11.555883 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-a400dc0f-bc8c-40c3-8198-bdac21b11e6c tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35da6a5109cb482bbf144927215467f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a213191904a64205b483c88adabf87a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:11.562406 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a400dc0f-bc8c-40c3-8198-bdac21b11e6c tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d" status: 200 len: 1351 microversion: 2.1 time: 0.100182 Aug 25 05:32:11.565668 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 107/194] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:11 2021] GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d => generated 1351 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:32:11.868194 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-a369d84c-06ad-4cf5-8ab4-1a5ac06b468b tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:11.878812 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a369d84c-06ad-4cf5-8ab4-1a5ac06b468b tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1520 microversion: 2.1 time: 0.352571 Aug 25 05:32:11.888645 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 88/195] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:11 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1520 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:32:12.303544 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-27e543ce-7778-477a-bb56-2cbc65a8127a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:12.304449 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-27e543ce-7778-477a-bb56-2cbc65a8127a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:12.311130 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-27e543ce-7778-477a-bb56-2cbc65a8127a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:12.311716 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-27e543ce-7778-477a-bb56-2cbc65a8127a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:12.312480 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-27e543ce-7778-477a-bb56-2cbc65a8127a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:12.312965 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-27e543ce-7778-477a-bb56-2cbc65a8127a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:12.368255 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5aded975-1bf9-49f1-b071-421a29cea0b7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:12.369180 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5aded975-1bf9-49f1-b071-421a29cea0b7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:12.376340 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5aded975-1bf9-49f1-b071-421a29cea0b7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:12.376794 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5aded975-1bf9-49f1-b071-421a29cea0b7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:12.377595 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5aded975-1bf9-49f1-b071-421a29cea0b7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:12.378037 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5aded975-1bf9-49f1-b071-421a29cea0b7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:16.895334 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-27e543ce-7778-477a-bb56-2cbc65a8127a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 27717 microversion: 2.1 time: 4.595267 Aug 25 05:32:16.896041 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 108/196] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:32:12 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 27717 bytes in 4597 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:32:16.900921 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-359dfe56-5aa5-42fb-b11b-2be4170b2f6a tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:16.901636 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-359dfe56-5aa5-42fb-b11b-2be4170b2f6a tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:16.909241 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-359dfe56-5aa5-42fb-b11b-2be4170b2f6a tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:16.909724 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-359dfe56-5aa5-42fb-b11b-2be4170b2f6a tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:16.910497 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-359dfe56-5aa5-42fb-b11b-2be4170b2f6a tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:16.910928 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-359dfe56-5aa5-42fb-b11b-2be4170b2f6a tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:16.919219 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5aded975-1bf9-49f1-b071-421a29cea0b7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 27728 microversion: 2.20 time: 4.554513 Aug 25 05:32:16.924101 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 89/197] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:32:12 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 27728 bytes in 4557 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 25 05:32:16.928557 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.wsgi [None req-359dfe56-5aa5-42fb-b11b-2be4170b2f6a tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] HTTP exception thrown: Instance 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d could not be found. Aug 25 05:32:16.928860 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8381eaf0-00dc-408f-a3f6-d5fb02980cf8 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:16.929205 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-359dfe56-5aa5-42fb-b11b-2be4170b2f6a tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Returning 404 to user: Instance 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d could not be found. {{(pid=108885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 05:32:16.930069 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-359dfe56-5aa5-42fb-b11b-2be4170b2f6a tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d" status: 404 len: 111 microversion: 2.1 time: 0.032971 Aug 25 05:32:16.930196 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8381eaf0-00dc-408f-a3f6-d5fb02980cf8 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:16.930620 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 109/198] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:16 2021] GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:32:16.936767 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8381eaf0-00dc-408f-a3f6-d5fb02980cf8 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:16.937219 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8381eaf0-00dc-408f-a3f6-d5fb02980cf8 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:16.938445 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8381eaf0-00dc-408f-a3f6-d5fb02980cf8 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:16.938651 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8381eaf0-00dc-408f-a3f6-d5fb02980cf8 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:17.053170 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-625d5b53-8830-44e0-b067-8db5794bddf8 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:17.053623 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-625d5b53-8830-44e0-b067-8db5794bddf8 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:17.060264 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-625d5b53-8830-44e0-b067-8db5794bddf8 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:17.060357 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-625d5b53-8830-44e0-b067-8db5794bddf8 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:17.061169 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-625d5b53-8830-44e0-b067-8db5794bddf8 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:17.062514 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-625d5b53-8830-44e0-b067-8db5794bddf8 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:17.081611 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-8381eaf0-00dc-408f-a3f6-d5fb02980cf8 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:17.082546 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.wsgi [None req-625d5b53-8830-44e0-b067-8db5794bddf8 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] HTTP exception thrown: Instance 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d could not be found. Aug 25 05:32:17.083149 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-625d5b53-8830-44e0-b067-8db5794bddf8 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Returning 404 to user: Instance 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d could not be found. {{(pid=108885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 05:32:17.084275 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-625d5b53-8830-44e0-b067-8db5794bddf8 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035604 Aug 25 05:32:17.084858 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 110/199] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:32:17 2021] GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 05:32:17.089610 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8381eaf0-00dc-408f-a3f6-d5fb02980cf8 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1520 microversion: 2.1 time: 0.167216 Aug 25 05:32:17.094518 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 90/200] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:16 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:32:17.910168 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5d463478-924e-4990-ad02-0719b1084aba tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:17.911073 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5d463478-924e-4990-ad02-0719b1084aba tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:17.917724 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5d463478-924e-4990-ad02-0719b1084aba tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:17.918167 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5d463478-924e-4990-ad02-0719b1084aba tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:17.919039 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5d463478-924e-4990-ad02-0719b1084aba tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:17.919471 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5d463478-924e-4990-ad02-0719b1084aba tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:17.936173 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d3b35436-ec8e-4134-b3f3-7ba7dbba7096 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:17.938098 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-d3b35436-ec8e-4134-b3f3-7ba7dbba7096 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:17.947159 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d3b35436-ec8e-4134-b3f3-7ba7dbba7096 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:17.947867 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d3b35436-ec8e-4134-b3f3-7ba7dbba7096 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:17.949550 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d3b35436-ec8e-4134-b3f3-7ba7dbba7096 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:17.949983 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d3b35436-ec8e-4134-b3f3-7ba7dbba7096 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:18.017558 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5d463478-924e-4990-ad02-0719b1084aba tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 27783 microversion: 2.1 time: 0.113375 Aug 25 05:32:18.018434 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 111/201] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:32:17 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 27783 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:32:18.092831 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d3b35436-ec8e-4134-b3f3-7ba7dbba7096 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 27793 microversion: 2.20 time: 0.163849 Aug 25 05:32:18.093497 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 91/202] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:32:17 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 27793 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 25 05:32:18.107309 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d08f458e-7f7f-40df-92a8-97090dfc0d53 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:18.108043 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d08f458e-7f7f-40df-92a8-97090dfc0d53 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:18.115455 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d08f458e-7f7f-40df-92a8-97090dfc0d53 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:18.115902 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d08f458e-7f7f-40df-92a8-97090dfc0d53 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:18.116676 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d08f458e-7f7f-40df-92a8-97090dfc0d53 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:18.117138 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d08f458e-7f7f-40df-92a8-97090dfc0d53 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:18.252046 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d08f458e-7f7f-40df-92a8-97090dfc0d53 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:18.259768 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d08f458e-7f7f-40df-92a8-97090dfc0d53 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1520 microversion: 2.1 time: 0.156384 Aug 25 05:32:18.260587 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 112/203] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:18 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:32:19.031295 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3241e13f-eebb-4e18-a268-33fbd36612cb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:19.032356 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3241e13f-eebb-4e18-a268-33fbd36612cb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:19.039005 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3241e13f-eebb-4e18-a268-33fbd36612cb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:19.039476 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3241e13f-eebb-4e18-a268-33fbd36612cb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:19.040482 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3241e13f-eebb-4e18-a268-33fbd36612cb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:19.040907 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3241e13f-eebb-4e18-a268-33fbd36612cb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:19.104968 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f16cdb99-6c98-49bd-8dd5-bdc385782672 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:19.105807 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f16cdb99-6c98-49bd-8dd5-bdc385782672 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:19.112507 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f16cdb99-6c98-49bd-8dd5-bdc385782672 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:19.112950 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f16cdb99-6c98-49bd-8dd5-bdc385782672 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:19.113773 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f16cdb99-6c98-49bd-8dd5-bdc385782672 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:19.114173 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f16cdb99-6c98-49bd-8dd5-bdc385782672 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:22.622898 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3241e13f-eebb-4e18-a268-33fbd36612cb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 27783 microversion: 2.1 time: 3.595843 Aug 25 05:32:22.623462 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 92/204] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:32:19 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 27783 bytes in 3598 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:32:22.629067 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-efa6ac65-1b84-4e2c-a1c5-8cea1f60a3ee tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:22.629794 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-efa6ac65-1b84-4e2c-a1c5-8cea1f60a3ee tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:22.635495 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f16cdb99-6c98-49bd-8dd5-bdc385782672 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 27793 microversion: 2.20 time: 3.534233 Aug 25 05:32:22.639337 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 113/205] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:32:19 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 27793 bytes in 3536 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:32:22.639489 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-efa6ac65-1b84-4e2c-a1c5-8cea1f60a3ee tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:22.639489 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-efa6ac65-1b84-4e2c-a1c5-8cea1f60a3ee tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:22.639489 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-efa6ac65-1b84-4e2c-a1c5-8cea1f60a3ee tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:22.639489 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-efa6ac65-1b84-4e2c-a1c5-8cea1f60a3ee tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:22.761072 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-efa6ac65-1b84-4e2c-a1c5-8cea1f60a3ee tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:22.769081 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-efa6ac65-1b84-4e2c-a1c5-8cea1f60a3ee tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1520 microversion: 2.1 time: 0.143683 Aug 25 05:32:22.769708 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 93/206] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:22 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1520 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:32:23.636211 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-97a842d2-4f7f-4d2a-b7d1-99529316e67a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:23.637166 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-97a842d2-4f7f-4d2a-b7d1-99529316e67a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:23.644716 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-97a842d2-4f7f-4d2a-b7d1-99529316e67a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:23.645152 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-97a842d2-4f7f-4d2a-b7d1-99529316e67a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:23.645952 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-97a842d2-4f7f-4d2a-b7d1-99529316e67a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:23.646375 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-97a842d2-4f7f-4d2a-b7d1-99529316e67a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:23.647613 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3a13bbd6-1653-4eb3-b9e1-30e8e81f1879 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:23.648525 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3a13bbd6-1653-4eb3-b9e1-30e8e81f1879 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:23.654737 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3a13bbd6-1653-4eb3-b9e1-30e8e81f1879 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:23.655173 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3a13bbd6-1653-4eb3-b9e1-30e8e81f1879 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:23.655940 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3a13bbd6-1653-4eb3-b9e1-30e8e81f1879 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:23.656391 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3a13bbd6-1653-4eb3-b9e1-30e8e81f1879 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:23.745824 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-97a842d2-4f7f-4d2a-b7d1-99529316e67a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 27910 microversion: 2.1 time: 0.113594 Aug 25 05:32:23.746476 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 114/207] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:32:23 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 27910 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:32:23.762681 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3a13bbd6-1653-4eb3-b9e1-30e8e81f1879 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 27920 microversion: 2.20 time: 0.118507 Aug 25 05:32:23.763328 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 94/208] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:32:23 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 27920 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 25 05:32:23.786482 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a3404706-9961-4dc2-a99d-0a82a305a065 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:23.787205 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a3404706-9961-4dc2-a99d-0a82a305a065 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:23.794774 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a3404706-9961-4dc2-a99d-0a82a305a065 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:23.795215 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a3404706-9961-4dc2-a99d-0a82a305a065 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:23.796183 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a3404706-9961-4dc2-a99d-0a82a305a065 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:23.797361 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a3404706-9961-4dc2-a99d-0a82a305a065 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:23.927536 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-a3404706-9961-4dc2-a99d-0a82a305a065 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:23.935006 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a3404706-9961-4dc2-a99d-0a82a305a065 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1520 microversion: 2.1 time: 0.153237 Aug 25 05:32:23.935568 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 115/209] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:23 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:32:24.758866 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-35641726-5cc9-4ed0-b0ef-1596bee58c54 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:24.759879 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-35641726-5cc9-4ed0-b0ef-1596bee58c54 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:24.767323 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-35641726-5cc9-4ed0-b0ef-1596bee58c54 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:24.767774 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-35641726-5cc9-4ed0-b0ef-1596bee58c54 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:24.768570 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-35641726-5cc9-4ed0-b0ef-1596bee58c54 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:24.768994 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-35641726-5cc9-4ed0-b0ef-1596bee58c54 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:24.774949 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-951c66a8-8e31-4a73-a26c-76a2b0fde833 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:24.775888 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-951c66a8-8e31-4a73-a26c-76a2b0fde833 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:24.782695 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-951c66a8-8e31-4a73-a26c-76a2b0fde833 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:24.783129 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-951c66a8-8e31-4a73-a26c-76a2b0fde833 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:24.783915 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-951c66a8-8e31-4a73-a26c-76a2b0fde833 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:24.784337 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-951c66a8-8e31-4a73-a26c-76a2b0fde833 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:24.881264 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-35641726-5cc9-4ed0-b0ef-1596bee58c54 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28028 microversion: 2.1 time: 0.126341 Aug 25 05:32:24.885342 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 95/210] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:32:24 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28028 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:32:24.901109 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-951c66a8-8e31-4a73-a26c-76a2b0fde833 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28038 microversion: 2.20 time: 0.130055 Aug 25 05:32:24.902080 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 116/211] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:32:24 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28038 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 25 05:32:24.955759 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-00311652-f6d0-4e41-a8ba-4d07d9f33ffb tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:24.956442 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-00311652-f6d0-4e41-a8ba-4d07d9f33ffb tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:24.962654 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-00311652-f6d0-4e41-a8ba-4d07d9f33ffb tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:24.963101 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-00311652-f6d0-4e41-a8ba-4d07d9f33ffb tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:24.963871 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-00311652-f6d0-4e41-a8ba-4d07d9f33ffb tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:24.964315 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-00311652-f6d0-4e41-a8ba-4d07d9f33ffb tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:25.110501 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-00311652-f6d0-4e41-a8ba-4d07d9f33ffb tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:25.118106 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-00311652-f6d0-4e41-a8ba-4d07d9f33ffb tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1520 microversion: 2.1 time: 0.168354 Aug 25 05:32:25.118682 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 96/212] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:24 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:32:25.895192 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-52cc216f-7789-4bf3-8668-778ead87e13d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:25.897211 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-52cc216f-7789-4bf3-8668-778ead87e13d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:25.904114 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-52cc216f-7789-4bf3-8668-778ead87e13d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:25.904552 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-52cc216f-7789-4bf3-8668-778ead87e13d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:25.905578 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-52cc216f-7789-4bf3-8668-778ead87e13d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:25.911885 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-52cc216f-7789-4bf3-8668-778ead87e13d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:25.920832 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-469c1ea6-d49a-4365-8def-5964a8094299 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:25.922681 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-469c1ea6-d49a-4365-8def-5964a8094299 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:25.930629 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-469c1ea6-d49a-4365-8def-5964a8094299 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:25.931159 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-469c1ea6-d49a-4365-8def-5964a8094299 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:25.932464 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-469c1ea6-d49a-4365-8def-5964a8094299 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:25.932981 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-469c1ea6-d49a-4365-8def-5964a8094299 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:26.099211 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-52cc216f-7789-4bf3-8668-778ead87e13d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28141 microversion: 2.1 time: 0.208048 Aug 25 05:32:26.100045 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 117/213] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:32:25 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28141 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:32:26.105300 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d2ad3e19-065a-428b-88f5-f57ba648bb46 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:26.105894 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d2ad3e19-065a-428b-88f5-f57ba648bb46 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:26.113405 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d2ad3e19-065a-428b-88f5-f57ba648bb46 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:26.113973 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d2ad3e19-065a-428b-88f5-f57ba648bb46 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:26.114748 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d2ad3e19-065a-428b-88f5-f57ba648bb46 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:26.115178 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d2ad3e19-065a-428b-88f5-f57ba648bb46 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:26.123748 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-469c1ea6-d49a-4365-8def-5964a8094299 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28111 microversion: 2.20 time: 0.214415 Aug 25 05:32:26.125837 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 97/214] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:32:25 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28111 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:32:26.132624 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.wsgi [None req-d2ad3e19-065a-428b-88f5-f57ba648bb46 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] HTTP exception thrown: Instance 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d could not be found. Aug 25 05:32:26.133226 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d2ad3e19-065a-428b-88f5-f57ba648bb46 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Returning 404 to user: Instance 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d could not be found. {{(pid=108885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 05:32:26.134188 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d2ad3e19-065a-428b-88f5-f57ba648bb46 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d" status: 404 len: 111 microversion: 2.1 time: 0.033217 Aug 25 05:32:26.134832 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 118/215] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 25 05:32:26 2021] DELETE /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:32:26.136494 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5b4729e9-5ef5-4df5-8110-4462e779ceea tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:26.141364 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5b4729e9-5ef5-4df5-8110-4462e779ceea tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:26.144539 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5b4729e9-5ef5-4df5-8110-4462e779ceea tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:26.145092 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5b4729e9-5ef5-4df5-8110-4462e779ceea tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:26.145973 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5b4729e9-5ef5-4df5-8110-4462e779ceea tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:26.146493 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ea6b7382-25cc-445e-a6ac-2d76295bdd74 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:26.146665 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5b4729e9-5ef5-4df5-8110-4462e779ceea tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:26.147105 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ea6b7382-25cc-445e-a6ac-2d76295bdd74 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] [instance: 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:26.153047 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ea6b7382-25cc-445e-a6ac-2d76295bdd74 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:26.153509 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ea6b7382-25cc-445e-a6ac-2d76295bdd74 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:26.154362 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ea6b7382-25cc-445e-a6ac-2d76295bdd74 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:26.154923 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ea6b7382-25cc-445e-a6ac-2d76295bdd74 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:26.168956 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.wsgi [None req-ea6b7382-25cc-445e-a6ac-2d76295bdd74 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] HTTP exception thrown: Instance 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d could not be found. Aug 25 05:32:26.169661 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ea6b7382-25cc-445e-a6ac-2d76295bdd74 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] Returning 404 to user: Instance 4d7a5079-3e2a-4e51-ba95-5feb0d27b87d could not be found. {{(pid=108885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 05:32:26.170478 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ea6b7382-25cc-445e-a6ac-2d76295bdd74 tempest-DeleteServersTestJSON-1664461844 tempest-DeleteServersTestJSON-1664461844-project] 10.222.0.42 "GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d" status: 404 len: 111 microversion: 2.1 time: 0.027844 Aug 25 05:32:26.171024 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 119/216] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:26 2021] GET /compute/v2.1/servers/4d7a5079-3e2a-4e51-ba95-5feb0d27b87d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:32:26.280857 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-5b4729e9-5ef5-4df5-8110-4462e779ceea tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:26.289164 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5b4729e9-5ef5-4df5-8110-4462e779ceea tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1520 microversion: 2.1 time: 0.157235 Aug 25 05:32:26.289887 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 98/217] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:26 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:32:27.111338 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-cb863fce-067b-472a-8298-0d56a473e95b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:27.112271 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-cb863fce-067b-472a-8298-0d56a473e95b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:27.118620 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cb863fce-067b-472a-8298-0d56a473e95b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:27.119055 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cb863fce-067b-472a-8298-0d56a473e95b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:27.120011 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cb863fce-067b-472a-8298-0d56a473e95b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:27.125640 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cb863fce-067b-472a-8298-0d56a473e95b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:27.136908 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-680dd56f-b5c6-4b7f-85d3-10fdd68e098d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:27.137846 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-680dd56f-b5c6-4b7f-85d3-10fdd68e098d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:27.144047 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-680dd56f-b5c6-4b7f-85d3-10fdd68e098d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:27.144548 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-680dd56f-b5c6-4b7f-85d3-10fdd68e098d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:27.145405 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-680dd56f-b5c6-4b7f-85d3-10fdd68e098d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:27.145881 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-680dd56f-b5c6-4b7f-85d3-10fdd68e098d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:30.764317 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-cb863fce-067b-472a-8298-0d56a473e95b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28143 microversion: 2.1 time: 3.657135 Aug 25 05:32:30.768782 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 120/218] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:32:27 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28143 bytes in 3659 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:32:30.770506 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-4693ada9-50af-4c59-9926-2c817cb99bf4 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:30.771227 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-4693ada9-50af-4c59-9926-2c817cb99bf4 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:30.777360 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4693ada9-50af-4c59-9926-2c817cb99bf4 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:30.777834 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4693ada9-50af-4c59-9926-2c817cb99bf4 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:30.778606 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4693ada9-50af-4c59-9926-2c817cb99bf4 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:30.779046 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4693ada9-50af-4c59-9926-2c817cb99bf4 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:30.783388 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-680dd56f-b5c6-4b7f-85d3-10fdd68e098d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28155 microversion: 2.20 time: 3.650691 Aug 25 05:32:30.787565 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 99/219] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:32:27 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28155 bytes in 3653 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 25 05:32:30.909068 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-4693ada9-50af-4c59-9926-2c817cb99bf4 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:30.917117 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-4693ada9-50af-4c59-9926-2c817cb99bf4 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1520 microversion: 2.1 time: 0.150547 Aug 25 05:32:30.917718 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 121/220] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:30 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:32:31.776937 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b103b4a5-b9e1-4489-82fe-ccaa84cac99d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:31.778269 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b103b4a5-b9e1-4489-82fe-ccaa84cac99d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:31.784682 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b103b4a5-b9e1-4489-82fe-ccaa84cac99d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:31.785846 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b103b4a5-b9e1-4489-82fe-ccaa84cac99d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:31.786799 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b103b4a5-b9e1-4489-82fe-ccaa84cac99d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:31.787183 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b103b4a5-b9e1-4489-82fe-ccaa84cac99d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:31.794292 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-20dda2d6-77e7-434b-b826-dd46ed5e0652 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:31.795201 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-20dda2d6-77e7-434b-b826-dd46ed5e0652 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:31.801578 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-20dda2d6-77e7-434b-b826-dd46ed5e0652 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:31.811140 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-20dda2d6-77e7-434b-b826-dd46ed5e0652 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:31.811140 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-20dda2d6-77e7-434b-b826-dd46ed5e0652 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:31.811140 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-20dda2d6-77e7-434b-b826-dd46ed5e0652 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:31.898289 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b103b4a5-b9e1-4489-82fe-ccaa84cac99d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28143 microversion: 2.1 time: 0.125234 Aug 25 05:32:31.899014 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 100/221] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:32:31 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28143 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:32:31.909516 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-20dda2d6-77e7-434b-b826-dd46ed5e0652 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28155 microversion: 2.20 time: 0.118894 Aug 25 05:32:31.910513 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 122/222] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:32:31 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28155 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:32:31.937207 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-683704ed-3c00-40e9-909b-71b8751f2ea3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:31.938661 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-683704ed-3c00-40e9-909b-71b8751f2ea3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:31.945917 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-683704ed-3c00-40e9-909b-71b8751f2ea3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:31.946457 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-683704ed-3c00-40e9-909b-71b8751f2ea3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:31.947242 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-683704ed-3c00-40e9-909b-71b8751f2ea3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:31.947672 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-683704ed-3c00-40e9-909b-71b8751f2ea3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:32.086944 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-683704ed-3c00-40e9-909b-71b8751f2ea3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:32.095512 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-683704ed-3c00-40e9-909b-71b8751f2ea3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1500 microversion: 2.1 time: 0.163242 Aug 25 05:32:32.096033 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 101/223] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:31 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1500 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:32:32.113266 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7efe5bc6-385d-4a64-8993-454748024dd1 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:32.114042 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-7efe5bc6-385d-4a64-8993-454748024dd1 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:32.123308 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7efe5bc6-385d-4a64-8993-454748024dd1 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:32.123308 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7efe5bc6-385d-4a64-8993-454748024dd1 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:32.123308 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7efe5bc6-385d-4a64-8993-454748024dd1 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:32.123308 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7efe5bc6-385d-4a64-8993-454748024dd1 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:32.253688 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-7efe5bc6-385d-4a64-8993-454748024dd1 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:32.274760 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-7efe5bc6-385d-4a64-8993-454748024dd1 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1515 microversion: 2.1 time: 0.153263 Aug 25 05:32:32.274760 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 123/224] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:32 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:32:32.912070 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c088e19c-362f-4fdd-a0ae-fcd221823ea0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:32.912982 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c088e19c-362f-4fdd-a0ae-fcd221823ea0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:32.921718 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f3b6e06d-7f5f-4f11-b81e-65c71ba7b049 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:32.923028 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f3b6e06d-7f5f-4f11-b81e-65c71ba7b049 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:32.930654 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c088e19c-362f-4fdd-a0ae-fcd221823ea0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:32.937224 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c088e19c-362f-4fdd-a0ae-fcd221823ea0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:32.937224 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c088e19c-362f-4fdd-a0ae-fcd221823ea0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:32.937224 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c088e19c-362f-4fdd-a0ae-fcd221823ea0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:32.940644 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f3b6e06d-7f5f-4f11-b81e-65c71ba7b049 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:32.941021 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f3b6e06d-7f5f-4f11-b81e-65c71ba7b049 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:32.941832 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f3b6e06d-7f5f-4f11-b81e-65c71ba7b049 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:32.942260 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f3b6e06d-7f5f-4f11-b81e-65c71ba7b049 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:33.005257 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c088e19c-362f-4fdd-a0ae-fcd221823ea0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28143 microversion: 2.1 time: 0.096734 Aug 25 05:32:33.006434 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 102/225] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:32:32 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28143 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:32:33.021806 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f3b6e06d-7f5f-4f11-b81e-65c71ba7b049 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28155 microversion: 2.20 time: 0.103763 Aug 25 05:32:33.027932 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 124/226] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:32:32 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28155 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:32:34.017354 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-17bdb4b9-fa3d-4542-ac16-6b3cbca9e100 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:34.018524 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-17bdb4b9-fa3d-4542-ac16-6b3cbca9e100 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:34.025419 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-17bdb4b9-fa3d-4542-ac16-6b3cbca9e100 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:34.025987 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-17bdb4b9-fa3d-4542-ac16-6b3cbca9e100 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:34.026732 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-17bdb4b9-fa3d-4542-ac16-6b3cbca9e100 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:34.027350 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-17bdb4b9-fa3d-4542-ac16-6b3cbca9e100 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:34.037727 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-18334ca0-4d10-47cd-84d7-af2d9cb7e79d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:34.039671 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-18334ca0-4d10-47cd-84d7-af2d9cb7e79d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:34.052448 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-18334ca0-4d10-47cd-84d7-af2d9cb7e79d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:34.052877 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-18334ca0-4d10-47cd-84d7-af2d9cb7e79d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:34.053719 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-18334ca0-4d10-47cd-84d7-af2d9cb7e79d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:34.054304 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-18334ca0-4d10-47cd-84d7-af2d9cb7e79d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:34.114672 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-17bdb4b9-fa3d-4542-ac16-6b3cbca9e100 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28143 microversion: 2.1 time: 0.101661 Aug 25 05:32:34.115475 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 103/227] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:32:34 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28143 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:32:34.132609 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-18334ca0-4d10-47cd-84d7-af2d9cb7e79d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28155 microversion: 2.20 time: 0.095033 Aug 25 05:32:34.139237 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 125/228] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:32:34 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28155 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 25 05:32:35.131166 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a0c78233-7001-4b44-8311-c915587de64f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:35.131166 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a0c78233-7001-4b44-8311-c915587de64f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:35.145876 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a0c78233-7001-4b44-8311-c915587de64f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:35.146815 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a0c78233-7001-4b44-8311-c915587de64f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:35.147655 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a0c78233-7001-4b44-8311-c915587de64f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:35.148291 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a0c78233-7001-4b44-8311-c915587de64f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:35.168322 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-00ce4e1d-5228-4b3f-bce8-ee9a3c3464e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:35.170098 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-00ce4e1d-5228-4b3f-bce8-ee9a3c3464e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:35.197591 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-00ce4e1d-5228-4b3f-bce8-ee9a3c3464e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:35.198358 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-00ce4e1d-5228-4b3f-bce8-ee9a3c3464e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:35.200665 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-00ce4e1d-5228-4b3f-bce8-ee9a3c3464e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:35.201669 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-00ce4e1d-5228-4b3f-bce8-ee9a3c3464e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:35.243293 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a0c78233-7001-4b44-8311-c915587de64f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28143 microversion: 2.1 time: 0.120346 Aug 25 05:32:35.247624 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 104/229] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:32:35 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28143 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:32:35.337754 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-00ce4e1d-5228-4b3f-bce8-ee9a3c3464e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28155 microversion: 2.20 time: 0.190743 Aug 25 05:32:35.342747 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 126/230] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:32:35 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28155 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:32:35.378439 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8f6d6b65-5550-466b-8fc0-8248d57873d6 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:35.380128 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8f6d6b65-5550-466b-8fc0-8248d57873d6 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:35.388083 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8f6d6b65-5550-466b-8fc0-8248d57873d6 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:35.388738 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8f6d6b65-5550-466b-8fc0-8248d57873d6 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:35.389704 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8f6d6b65-5550-466b-8fc0-8248d57873d6 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:35.391035 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8f6d6b65-5550-466b-8fc0-8248d57873d6 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:35.434122 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.objects.instance [None req-8f6d6b65-5550-466b-8fc0-8248d57873d6 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lazy-loading 'flavor' on Instance uuid 2163e566-1832-40df-8925-09e54ae2974c {{(pid=108884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 05:32:35.791389 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8f6d6b65-5550-466b-8fc0-8248d57873d6 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "POST /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c/action" status: 200 len: 32 microversion: 2.1 time: 0.415106 Aug 25 05:32:35.791389 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 105/231] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:32:35 2021] POST /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c/action => generated 32 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 25 05:32:35.799930 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ba7aca36-af6e-470b-a8a1-f9bbfd81b15e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:35.800738 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ba7aca36-af6e-470b-a8a1-f9bbfd81b15e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:35.807393 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ba7aca36-af6e-470b-a8a1-f9bbfd81b15e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:35.807842 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ba7aca36-af6e-470b-a8a1-f9bbfd81b15e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:35.808614 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ba7aca36-af6e-470b-a8a1-f9bbfd81b15e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:35.809047 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ba7aca36-af6e-470b-a8a1-f9bbfd81b15e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:35.969980 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ba7aca36-af6e-470b-a8a1-f9bbfd81b15e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:35.987616 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ba7aca36-af6e-470b-a8a1-f9bbfd81b15e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1521 microversion: 2.1 time: 0.192013 Aug 25 05:32:35.988212 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 127/232] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:35 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:32:36.261999 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-58ceb4e7-eb8b-4b12-8814-992261eae7aa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:36.264117 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-58ceb4e7-eb8b-4b12-8814-992261eae7aa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:36.277193 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-58ceb4e7-eb8b-4b12-8814-992261eae7aa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:36.278186 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-58ceb4e7-eb8b-4b12-8814-992261eae7aa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:36.279313 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-58ceb4e7-eb8b-4b12-8814-992261eae7aa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:36.279995 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-58ceb4e7-eb8b-4b12-8814-992261eae7aa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:36.354177 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e572d7a1-f6ac-41c7-934a-e8afefe51f4c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:36.355867 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e572d7a1-f6ac-41c7-934a-e8afefe51f4c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:36.356967 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-58ceb4e7-eb8b-4b12-8814-992261eae7aa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28143 microversion: 2.1 time: 0.103259 Aug 25 05:32:36.362845 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 106/233] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:32:36 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28143 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:32:36.370626 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e572d7a1-f6ac-41c7-934a-e8afefe51f4c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:36.374005 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e572d7a1-f6ac-41c7-934a-e8afefe51f4c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:36.376133 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e572d7a1-f6ac-41c7-934a-e8afefe51f4c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:36.377005 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e572d7a1-f6ac-41c7-934a-e8afefe51f4c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:36.499532 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e572d7a1-f6ac-41c7-934a-e8afefe51f4c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28155 microversion: 2.20 time: 0.151952 Aug 25 05:32:36.500492 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 128/234] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:32:36 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28155 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 25 05:32:37.009440 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5433b6ac-40bb-4526-bb84-a07b27bec354 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:37.010081 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5433b6ac-40bb-4526-bb84-a07b27bec354 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:37.016888 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5433b6ac-40bb-4526-bb84-a07b27bec354 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:37.017347 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5433b6ac-40bb-4526-bb84-a07b27bec354 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:37.018114 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5433b6ac-40bb-4526-bb84-a07b27bec354 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:37.018560 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5433b6ac-40bb-4526-bb84-a07b27bec354 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:37.154990 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-5433b6ac-40bb-4526-bb84-a07b27bec354 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:37.179147 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5433b6ac-40bb-4526-bb84-a07b27bec354 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1521 microversion: 2.1 time: 0.173542 Aug 25 05:32:37.180091 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 107/235] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:37 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:32:37.370089 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1755b228-d85d-47c5-aafc-9d9cb080a11b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:37.371062 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1755b228-d85d-47c5-aafc-9d9cb080a11b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:37.377949 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1755b228-d85d-47c5-aafc-9d9cb080a11b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:37.378394 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1755b228-d85d-47c5-aafc-9d9cb080a11b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:37.379166 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1755b228-d85d-47c5-aafc-9d9cb080a11b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:37.379601 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1755b228-d85d-47c5-aafc-9d9cb080a11b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:37.462825 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1755b228-d85d-47c5-aafc-9d9cb080a11b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28143 microversion: 2.1 time: 0.096782 Aug 25 05:32:37.463502 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 129/236] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:32:37 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28143 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:32:37.511532 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-0f10c461-50cd-4178-aced-a56b2309bfab tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:37.512642 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-0f10c461-50cd-4178-aced-a56b2309bfab tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:37.520327 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0f10c461-50cd-4178-aced-a56b2309bfab tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:37.521010 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0f10c461-50cd-4178-aced-a56b2309bfab tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:37.522027 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0f10c461-50cd-4178-aced-a56b2309bfab tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:37.522978 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0f10c461-50cd-4178-aced-a56b2309bfab tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:37.591646 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-0f10c461-50cd-4178-aced-a56b2309bfab tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28155 microversion: 2.20 time: 0.083305 Aug 25 05:32:37.593013 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 108/237] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:32:37 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28155 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 25 05:32:38.197118 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e690b403-660b-43bc-a9c4-127669f3a1cf tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:38.197964 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e690b403-660b-43bc-a9c4-127669f3a1cf tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:38.206375 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e690b403-660b-43bc-a9c4-127669f3a1cf tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:38.209251 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e690b403-660b-43bc-a9c4-127669f3a1cf tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:38.210152 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e690b403-660b-43bc-a9c4-127669f3a1cf tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:38.210682 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e690b403-660b-43bc-a9c4-127669f3a1cf tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:38.372108 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-e690b403-660b-43bc-a9c4-127669f3a1cf tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:38.380127 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e690b403-660b-43bc-a9c4-127669f3a1cf tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1521 microversion: 2.1 time: 0.186954 Aug 25 05:32:38.380702 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 130/238] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:38 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:32:38.476260 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-37d0f2e9-4673-4b31-abbc-b9f0c9bc84c4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:38.477373 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-37d0f2e9-4673-4b31-abbc-b9f0c9bc84c4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:38.483704 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-37d0f2e9-4673-4b31-abbc-b9f0c9bc84c4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:38.484150 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-37d0f2e9-4673-4b31-abbc-b9f0c9bc84c4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:38.484922 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-37d0f2e9-4673-4b31-abbc-b9f0c9bc84c4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:38.485352 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-37d0f2e9-4673-4b31-abbc-b9f0c9bc84c4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:38.554157 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-37d0f2e9-4673-4b31-abbc-b9f0c9bc84c4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28143 microversion: 2.1 time: 0.082906 Aug 25 05:32:38.555821 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 109/239] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:32:38 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28143 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:32:38.604385 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2dcbfc4f-442d-4ce1-a47c-4f14842044b4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:38.605600 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2dcbfc4f-442d-4ce1-a47c-4f14842044b4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:38.611827 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2dcbfc4f-442d-4ce1-a47c-4f14842044b4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:38.612271 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2dcbfc4f-442d-4ce1-a47c-4f14842044b4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:38.613038 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2dcbfc4f-442d-4ce1-a47c-4f14842044b4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:38.613472 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2dcbfc4f-442d-4ce1-a47c-4f14842044b4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:38.685892 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2dcbfc4f-442d-4ce1-a47c-4f14842044b4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28155 microversion: 2.20 time: 0.084899 Aug 25 05:32:38.686546 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 131/240] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:32:38 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28155 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:32:39.397864 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8c9897d9-8bd0-4aa0-ac9d-1ff029318070 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:39.398704 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8c9897d9-8bd0-4aa0-ac9d-1ff029318070 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:39.405268 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8c9897d9-8bd0-4aa0-ac9d-1ff029318070 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:39.405735 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8c9897d9-8bd0-4aa0-ac9d-1ff029318070 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:39.407032 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8c9897d9-8bd0-4aa0-ac9d-1ff029318070 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:39.407627 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8c9897d9-8bd0-4aa0-ac9d-1ff029318070 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:39.569043 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-4aae2450-871e-4742-9119-ea0b9dc3e9cc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:39.571064 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-4aae2450-871e-4742-9119-ea0b9dc3e9cc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:39.577415 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4aae2450-871e-4742-9119-ea0b9dc3e9cc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:39.578103 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4aae2450-871e-4742-9119-ea0b9dc3e9cc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:39.579683 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4aae2450-871e-4742-9119-ea0b9dc3e9cc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:39.584776 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4aae2450-871e-4742-9119-ea0b9dc3e9cc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:39.602756 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-8c9897d9-8bd0-4aa0-ac9d-1ff029318070 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:39.610466 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8c9897d9-8bd0-4aa0-ac9d-1ff029318070 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1521 microversion: 2.1 time: 0.216600 Aug 25 05:32:39.611043 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 110/241] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:39 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:32:39.645904 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-4aae2450-871e-4742-9119-ea0b9dc3e9cc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28143 microversion: 2.1 time: 0.082918 Aug 25 05:32:39.650076 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 132/242] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:32:39 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28143 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:32:39.698999 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-42d30e69-3a2c-4a47-9fde-a725466ef533 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:39.699900 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-42d30e69-3a2c-4a47-9fde-a725466ef533 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:39.706620 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-42d30e69-3a2c-4a47-9fde-a725466ef533 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:39.707062 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-42d30e69-3a2c-4a47-9fde-a725466ef533 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:39.707814 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-42d30e69-3a2c-4a47-9fde-a725466ef533 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:39.708265 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-42d30e69-3a2c-4a47-9fde-a725466ef533 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:39.771113 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-42d30e69-3a2c-4a47-9fde-a725466ef533 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28155 microversion: 2.20 time: 0.075689 Aug 25 05:32:39.772839 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 111/243] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:32:39 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28155 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:32:40.628703 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-dead2e91-a940-4e70-bba8-66fcd71d96d3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:40.629979 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-dead2e91-a940-4e70-bba8-66fcd71d96d3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:40.636605 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-dead2e91-a940-4e70-bba8-66fcd71d96d3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:40.637103 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-dead2e91-a940-4e70-bba8-66fcd71d96d3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:40.637994 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-dead2e91-a940-4e70-bba8-66fcd71d96d3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:40.638499 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-dead2e91-a940-4e70-bba8-66fcd71d96d3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:40.658801 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-556dd975-34e9-4561-a6f9-a23f68671424 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:40.659706 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-556dd975-34e9-4561-a6f9-a23f68671424 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:40.667444 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-556dd975-34e9-4561-a6f9-a23f68671424 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:40.667886 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-556dd975-34e9-4561-a6f9-a23f68671424 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:40.668657 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-556dd975-34e9-4561-a6f9-a23f68671424 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:40.669086 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-556dd975-34e9-4561-a6f9-a23f68671424 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:40.786950 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-dead2e91-a940-4e70-bba8-66fcd71d96d3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:40.795196 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-dead2e91-a940-4e70-bba8-66fcd71d96d3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1521 microversion: 2.1 time: 0.170959 Aug 25 05:32:40.795797 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 133/244] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:40 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:32:40.800601 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5d9b7c2c-d755-4652-9251-6e6bacc467fb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:40.801549 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5d9b7c2c-d755-4652-9251-6e6bacc467fb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:40.809793 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5d9b7c2c-d755-4652-9251-6e6bacc467fb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:40.809793 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5d9b7c2c-d755-4652-9251-6e6bacc467fb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:40.809793 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5d9b7c2c-d755-4652-9251-6e6bacc467fb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:40.809793 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5d9b7c2c-d755-4652-9251-6e6bacc467fb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:43.839221 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-556dd975-34e9-4561-a6f9-a23f68671424 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28143 microversion: 2.1 time: 3.183863 Aug 25 05:32:43.841144 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5d9b7c2c-d755-4652-9251-6e6bacc467fb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28155 microversion: 2.20 time: 3.043878 Aug 25 05:32:43.842157 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 112/245] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:32:40 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28143 bytes in 3188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:32:43.842947 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 134/246] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:32:40 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28155 bytes in 3046 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:32:43.855830 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-eda4431a-5b1d-464c-9aca-3b8696165e4a tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:43.856991 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-eda4431a-5b1d-464c-9aca-3b8696165e4a tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:43.875172 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-eda4431a-5b1d-464c-9aca-3b8696165e4a tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:43.876428 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-eda4431a-5b1d-464c-9aca-3b8696165e4a tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:43.877748 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-eda4431a-5b1d-464c-9aca-3b8696165e4a tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:43.878538 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-eda4431a-5b1d-464c-9aca-3b8696165e4a tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:44.084108 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-eda4431a-5b1d-464c-9aca-3b8696165e4a tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:44.092758 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-eda4431a-5b1d-464c-9aca-3b8696165e4a tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1521 microversion: 2.1 time: 0.248529 Aug 25 05:32:44.093326 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 113/247] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:43 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:32:44.858224 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c1a5c9d0-4b98-4373-aaff-157133eb3e98 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:44.859846 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c1a5c9d0-4b98-4373-aaff-157133eb3e98 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:44.865253 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-aae03859-7e0f-438f-8391-c429953f2566 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:44.866395 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-aae03859-7e0f-438f-8391-c429953f2566 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:44.866812 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c1a5c9d0-4b98-4373-aaff-157133eb3e98 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:44.869834 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c1a5c9d0-4b98-4373-aaff-157133eb3e98 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:44.869834 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c1a5c9d0-4b98-4373-aaff-157133eb3e98 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:44.869834 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c1a5c9d0-4b98-4373-aaff-157133eb3e98 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:44.875187 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-aae03859-7e0f-438f-8391-c429953f2566 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:44.876426 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-aae03859-7e0f-438f-8391-c429953f2566 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:44.877658 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-aae03859-7e0f-438f-8391-c429953f2566 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:44.878588 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-aae03859-7e0f-438f-8391-c429953f2566 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:44.967653 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-aae03859-7e0f-438f-8391-c429953f2566 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28143 microversion: 2.1 time: 0.107529 Aug 25 05:32:44.968726 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 114/248] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:32:44 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28143 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:32:44.978398 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c1a5c9d0-4b98-4373-aaff-157133eb3e98 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28155 microversion: 2.20 time: 0.124049 Aug 25 05:32:44.983138 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 135/249] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:32:44 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28155 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:32:45.111313 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-aa7107e2-8f8f-4eac-8853-23c067f4d3e8 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:45.112097 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-aa7107e2-8f8f-4eac-8853-23c067f4d3e8 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:45.119204 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-aa7107e2-8f8f-4eac-8853-23c067f4d3e8 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:45.119363 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-aa7107e2-8f8f-4eac-8853-23c067f4d3e8 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:45.120091 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-aa7107e2-8f8f-4eac-8853-23c067f4d3e8 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:45.120519 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-aa7107e2-8f8f-4eac-8853-23c067f4d3e8 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:45.312518 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-aa7107e2-8f8f-4eac-8853-23c067f4d3e8 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:45.324480 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-aa7107e2-8f8f-4eac-8853-23c067f4d3e8 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1521 microversion: 2.1 time: 0.218009 Aug 25 05:32:45.325458 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 115/250] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:45 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:32:45.601199 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b280a32e-3c2b-4218-bf11-f040509dfdbb tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-975785167", "imageRef": "05da2439-78f2-405c-b60a-89671b21a373", "flavorRef": "452"}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:45.687825 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.network.neutron [None req-b280a32e-3c2b-4218-bf11-f040509dfdbb tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] validate_networks() for None {{(pid=108885) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 25 05:32:45.986340 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-4ea7cbe2-39d6-4751-b136-72e7bc672eb1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:45.987333 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-4ea7cbe2-39d6-4751-b136-72e7bc672eb1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:45.994666 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4ea7cbe2-39d6-4751-b136-72e7bc672eb1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:45.995104 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4ea7cbe2-39d6-4751-b136-72e7bc672eb1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:45.995939 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4ea7cbe2-39d6-4751-b136-72e7bc672eb1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:45.996370 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4ea7cbe2-39d6-4751-b136-72e7bc672eb1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:46.008622 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-b280a32e-3c2b-4218-bf11-f040509dfdbb tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Flavor limits 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 05:32:46.009097 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-b280a32e-3c2b-4218-bf11-f040509dfdbb tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Image limits 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 05:32:46.009480 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-b280a32e-3c2b-4218-bf11-f040509dfdbb tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Flavor pref 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 05:32:46.009914 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-b280a32e-3c2b-4218-bf11-f040509dfdbb tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Image pref 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 05:32:46.010315 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-b280a32e-3c2b-4218-bf11-f040509dfdbb tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 05:32:46.019744 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b280a32e-3c2b-4218-bf11-f040509dfdbb tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:46.020395 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b280a32e-3c2b-4218-bf11-f040509dfdbb tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:46.021314 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b280a32e-3c2b-4218-bf11-f040509dfdbb tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:46.031409 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b280a32e-3c2b-4218-bf11-f040509dfdbb tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:46.068912 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-4ea7cbe2-39d6-4751-b136-72e7bc672eb1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28143 microversion: 2.1 time: 0.087825 Aug 25 05:32:46.069599 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 116/251] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:32:45 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28143 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:32:46.075063 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7d525a90-a880-4257-88c4-ed2db2fef881 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:46.076312 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.quota [None req-b280a32e-3c2b-4218-bf11-f040509dfdbb tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Getting quotas for project 7e08a9b0891a4b2e84b4e1daabc7bfe7. Resources: {'ram', 'cores', 'instances'} {{(pid=108885) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 05:32:46.079157 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7d525a90-a880-4257-88c4-ed2db2fef881 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:46.083684 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.quota [None req-b280a32e-3c2b-4218-bf11-f040509dfdbb tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Getting quotas for user ed7e59bcbcd843db87ce96d5f2173e8d and project 7e08a9b0891a4b2e84b4e1daabc7bfe7. Resources: {'ram', 'cores', 'instances'} {{(pid=108885) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 05:32:46.090438 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7d525a90-a880-4257-88c4-ed2db2fef881 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:46.093505 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7d525a90-a880-4257-88c4-ed2db2fef881 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:46.093505 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7d525a90-a880-4257-88c4-ed2db2fef881 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:46.093505 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7d525a90-a880-4257-88c4-ed2db2fef881 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:46.101256 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b280a32e-3c2b-4218-bf11-f040509dfdbb tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Going to run 1 instances... {{(pid=108885) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 25 05:32:46.103990 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b280a32e-3c2b-4218-bf11-f040509dfdbb tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] [instance: a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05da2439-78f2-405c-b60a-89671b21a373',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 25 05:32:46.169838 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7d525a90-a880-4257-88c4-ed2db2fef881 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28155 microversion: 2.20 time: 0.098415 Aug 25 05:32:46.171087 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 117/252] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:32:46 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28155 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:32:46.247621 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b280a32e-3c2b-4218-bf11-f040509dfdbb tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.650330 Aug 25 05:32:46.248252 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 136/253] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 25 05:32:45 2021] POST /compute/v2.1/servers => generated 380 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 05:32:46.260356 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e27a64a1-5a5b-429d-a5bd-e07db756ff15 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:46.261040 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e27a64a1-5a5b-429d-a5bd-e07db756ff15 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] [instance: a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:46.346073 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e27a64a1-5a5b-429d-a5bd-e07db756ff15 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7e59bcbcd843db87ce96d5f2173e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e08a9b0891a4b2e84b4e1daabc7bfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:46.348921 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a16e1aff-caaa-45b8-8509-ce230a18c6f6 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:46.350517 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a16e1aff-caaa-45b8-8509-ce230a18c6f6 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:46.359602 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a16e1aff-caaa-45b8-8509-ce230a18c6f6 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:46.361142 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a16e1aff-caaa-45b8-8509-ce230a18c6f6 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:46.363274 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a16e1aff-caaa-45b8-8509-ce230a18c6f6 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:46.364144 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a16e1aff-caaa-45b8-8509-ce230a18c6f6 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:46.374669 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e27a64a1-5a5b-429d-a5bd-e07db756ff15 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] 10.222.0.42 "GET /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c" status: 200 len: 1214 microversion: 2.1 time: 0.097212 Aug 25 05:32:46.375542 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 118/254] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:46 2021] GET /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c => generated 1214 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:32:46.568472 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-a16e1aff-caaa-45b8-8509-ce230a18c6f6 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:46.587525 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a16e1aff-caaa-45b8-8509-ce230a18c6f6 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1521 microversion: 2.1 time: 0.241042 Aug 25 05:32:46.587525 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 137/255] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:46 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:32:47.084055 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-f5f22b6a-8cfc-4cee-988e-08fedcc0020f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:47.085358 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-f5f22b6a-8cfc-4cee-988e-08fedcc0020f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:47.093877 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f5f22b6a-8cfc-4cee-988e-08fedcc0020f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:47.094645 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f5f22b6a-8cfc-4cee-988e-08fedcc0020f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:47.095479 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f5f22b6a-8cfc-4cee-988e-08fedcc0020f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:47.101156 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f5f22b6a-8cfc-4cee-988e-08fedcc0020f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:47.181362 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-f5f22b6a-8cfc-4cee-988e-08fedcc0020f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28143 microversion: 2.1 time: 0.102657 Aug 25 05:32:47.182800 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 119/256] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:32:47 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28143 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:32:47.184005 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f915fcb2-4f3f-43b2-95ba-663d2ed38af0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:47.185341 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f915fcb2-4f3f-43b2-95ba-663d2ed38af0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:47.194822 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f915fcb2-4f3f-43b2-95ba-663d2ed38af0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:47.195329 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f915fcb2-4f3f-43b2-95ba-663d2ed38af0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:47.196134 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f915fcb2-4f3f-43b2-95ba-663d2ed38af0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:47.196568 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f915fcb2-4f3f-43b2-95ba-663d2ed38af0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:47.276718 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f915fcb2-4f3f-43b2-95ba-663d2ed38af0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28155 microversion: 2.20 time: 0.097929 Aug 25 05:32:47.277372 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 138/257] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:32:47 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28155 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 25 05:32:47.396561 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8aedd7a7-8abb-4284-8f87-c272cfffba79 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:47.397240 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8aedd7a7-8abb-4284-8f87-c272cfffba79 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] [instance: a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:47.452278 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-8aedd7a7-8abb-4284-8f87-c272cfffba79 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7e59bcbcd843db87ce96d5f2173e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e08a9b0891a4b2e84b4e1daabc7bfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:47.459595 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8aedd7a7-8abb-4284-8f87-c272cfffba79 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] 10.222.0.42 "GET /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c" status: 200 len: 1214 microversion: 2.1 time: 0.067068 Aug 25 05:32:47.460221 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 120/258] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:47 2021] GET /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:32:47.604160 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b119a23f-e026-4a82-bd6a-f62ff25a561f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:47.604878 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b119a23f-e026-4a82-bd6a-f62ff25a561f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:47.612398 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b119a23f-e026-4a82-bd6a-f62ff25a561f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:47.612843 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b119a23f-e026-4a82-bd6a-f62ff25a561f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:47.613638 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b119a23f-e026-4a82-bd6a-f62ff25a561f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:47.614074 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b119a23f-e026-4a82-bd6a-f62ff25a561f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:47.751343 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-b119a23f-e026-4a82-bd6a-f62ff25a561f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:47.760079 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b119a23f-e026-4a82-bd6a-f62ff25a561f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1521 microversion: 2.1 time: 0.159904 Aug 25 05:32:47.760622 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 139/259] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:47 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:32:48.198813 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c8438d70-e7ce-4479-a99f-75cd7afc1133 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:48.200349 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c8438d70-e7ce-4479-a99f-75cd7afc1133 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:48.211372 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c8438d70-e7ce-4479-a99f-75cd7afc1133 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:48.212099 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c8438d70-e7ce-4479-a99f-75cd7afc1133 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:48.213621 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c8438d70-e7ce-4479-a99f-75cd7afc1133 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:48.214538 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c8438d70-e7ce-4479-a99f-75cd7afc1133 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:48.290540 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e01ff208-206d-48c6-86c9-958c6cbdd445 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:48.292649 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e01ff208-206d-48c6-86c9-958c6cbdd445 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:48.301865 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e01ff208-206d-48c6-86c9-958c6cbdd445 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:48.302529 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e01ff208-206d-48c6-86c9-958c6cbdd445 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:48.303653 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e01ff208-206d-48c6-86c9-958c6cbdd445 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:48.304259 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e01ff208-206d-48c6-86c9-958c6cbdd445 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:48.304657 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c8438d70-e7ce-4479-a99f-75cd7afc1133 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28143 microversion: 2.1 time: 0.111159 Aug 25 05:32:48.306636 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 121/260] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:32:48 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28143 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:32:48.432084 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e01ff208-206d-48c6-86c9-958c6cbdd445 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28155 microversion: 2.20 time: 0.146475 Aug 25 05:32:48.434304 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 140/261] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:32:48 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28155 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 25 05:32:48.481882 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5af018d1-9afc-4475-8089-4c4fcda3fa75 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:48.481882 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5af018d1-9afc-4475-8089-4c4fcda3fa75 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] [instance: a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:48.501844 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5af018d1-9afc-4475-8089-4c4fcda3fa75 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:48.515029 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5af018d1-9afc-4475-8089-4c4fcda3fa75 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:48.515029 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5af018d1-9afc-4475-8089-4c4fcda3fa75 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:48.515029 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5af018d1-9afc-4475-8089-4c4fcda3fa75 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:48.585501 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-5af018d1-9afc-4475-8089-4c4fcda3fa75 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7e59bcbcd843db87ce96d5f2173e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e08a9b0891a4b2e84b4e1daabc7bfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:48.593085 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5af018d1-9afc-4475-8089-4c4fcda3fa75 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] 10.222.0.42 "GET /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c" status: 200 len: 1266 microversion: 2.1 time: 0.117514 Aug 25 05:32:48.593834 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 122/262] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:48 2021] GET /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c => generated 1266 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:32:48.792442 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-61067fef-908d-4ee1-93a1-13d6716b3eb8 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:48.793713 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-61067fef-908d-4ee1-93a1-13d6716b3eb8 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:48.808200 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-61067fef-908d-4ee1-93a1-13d6716b3eb8 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:48.808991 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-61067fef-908d-4ee1-93a1-13d6716b3eb8 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:48.810538 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-61067fef-908d-4ee1-93a1-13d6716b3eb8 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:48.811699 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-61067fef-908d-4ee1-93a1-13d6716b3eb8 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:48.971807 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-61067fef-908d-4ee1-93a1-13d6716b3eb8 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:48.979964 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-61067fef-908d-4ee1-93a1-13d6716b3eb8 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1521 microversion: 2.1 time: 0.197851 Aug 25 05:32:48.981571 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 141/263] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:48 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:32:49.317774 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6ee4dcc5-a4df-41e6-99de-a8dd1b4e34d4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:49.318860 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6ee4dcc5-a4df-41e6-99de-a8dd1b4e34d4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:49.324875 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6ee4dcc5-a4df-41e6-99de-a8dd1b4e34d4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:49.325322 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6ee4dcc5-a4df-41e6-99de-a8dd1b4e34d4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:49.326126 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6ee4dcc5-a4df-41e6-99de-a8dd1b4e34d4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:49.326557 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6ee4dcc5-a4df-41e6-99de-a8dd1b4e34d4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:49.420096 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6ee4dcc5-a4df-41e6-99de-a8dd1b4e34d4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28143 microversion: 2.1 time: 0.105981 Aug 25 05:32:49.421161 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 123/264] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:32:49 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28143 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:32:49.447290 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-de0fb4ab-078e-489e-b8a1-147277e61a9c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:49.448753 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-de0fb4ab-078e-489e-b8a1-147277e61a9c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:49.465031 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-de0fb4ab-078e-489e-b8a1-147277e61a9c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:49.465483 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-de0fb4ab-078e-489e-b8a1-147277e61a9c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:49.467180 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-de0fb4ab-078e-489e-b8a1-147277e61a9c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:49.467180 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-de0fb4ab-078e-489e-b8a1-147277e61a9c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:49.577846 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-de0fb4ab-078e-489e-b8a1-147277e61a9c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28155 microversion: 2.20 time: 0.134253 Aug 25 05:32:49.583311 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 142/265] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:32:49 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28155 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 25 05:32:49.616443 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-4f8e82e5-fc7b-4ab5-aa9d-f76c6ae3366b tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:49.617932 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-4f8e82e5-fc7b-4ab5-aa9d-f76c6ae3366b tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] [instance: a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:49.626417 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4f8e82e5-fc7b-4ab5-aa9d-f76c6ae3366b tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:49.627226 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4f8e82e5-fc7b-4ab5-aa9d-f76c6ae3366b tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:49.628259 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4f8e82e5-fc7b-4ab5-aa9d-f76c6ae3366b tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:49.629508 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4f8e82e5-fc7b-4ab5-aa9d-f76c6ae3366b tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:49.710355 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-4f8e82e5-fc7b-4ab5-aa9d-f76c6ae3366b tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7e59bcbcd843db87ce96d5f2173e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e08a9b0891a4b2e84b4e1daabc7bfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:49.718533 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-4f8e82e5-fc7b-4ab5-aa9d-f76c6ae3366b tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] 10.222.0.42 "GET /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c" status: 200 len: 1284 microversion: 2.1 time: 0.110650 Aug 25 05:32:49.719630 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 124/266] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:49 2021] GET /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c => generated 1284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:32:50.000023 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ae1e2e39-d0fb-4d5d-9c3a-67fbaec039f4 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:50.001231 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ae1e2e39-d0fb-4d5d-9c3a-67fbaec039f4 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:50.010513 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ae1e2e39-d0fb-4d5d-9c3a-67fbaec039f4 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:50.011230 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ae1e2e39-d0fb-4d5d-9c3a-67fbaec039f4 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:50.012265 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ae1e2e39-d0fb-4d5d-9c3a-67fbaec039f4 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:50.012873 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ae1e2e39-d0fb-4d5d-9c3a-67fbaec039f4 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:50.195240 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ae1e2e39-d0fb-4d5d-9c3a-67fbaec039f4 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:50.202909 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ae1e2e39-d0fb-4d5d-9c3a-67fbaec039f4 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1521 microversion: 2.1 time: 0.208225 Aug 25 05:32:50.204016 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 143/267] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:49 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:32:50.436735 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-60d37805-f803-43ee-bb2d-8028174f735e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:50.437778 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-60d37805-f803-43ee-bb2d-8028174f735e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:50.444316 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-60d37805-f803-43ee-bb2d-8028174f735e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:50.444763 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-60d37805-f803-43ee-bb2d-8028174f735e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:50.445779 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-60d37805-f803-43ee-bb2d-8028174f735e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:50.446247 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-60d37805-f803-43ee-bb2d-8028174f735e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:50.521625 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-60d37805-f803-43ee-bb2d-8028174f735e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28143 microversion: 2.1 time: 0.088793 Aug 25 05:32:50.522433 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 125/268] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:32:50 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28143 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:32:50.591844 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6aff84f3-a8aa-4848-836d-1439e86905b8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:50.594818 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6aff84f3-a8aa-4848-836d-1439e86905b8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:50.605338 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6aff84f3-a8aa-4848-836d-1439e86905b8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:50.606482 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6aff84f3-a8aa-4848-836d-1439e86905b8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:50.607797 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6aff84f3-a8aa-4848-836d-1439e86905b8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:50.608509 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6aff84f3-a8aa-4848-836d-1439e86905b8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:50.695862 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6aff84f3-a8aa-4848-836d-1439e86905b8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28155 microversion: 2.20 time: 0.108200 Aug 25 05:32:50.698885 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 144/269] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:32:50 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28155 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:32:50.745012 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1a9c5291-daa7-40af-9c4f-7890331ea51b tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:50.745880 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1a9c5291-daa7-40af-9c4f-7890331ea51b tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] [instance: a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:50.753257 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1a9c5291-daa7-40af-9c4f-7890331ea51b tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:50.756120 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1a9c5291-daa7-40af-9c4f-7890331ea51b tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:50.756120 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1a9c5291-daa7-40af-9c4f-7890331ea51b tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:50.756120 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1a9c5291-daa7-40af-9c4f-7890331ea51b tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:50.830591 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-1a9c5291-daa7-40af-9c4f-7890331ea51b tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7e59bcbcd843db87ce96d5f2173e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e08a9b0891a4b2e84b4e1daabc7bfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:50.839108 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1a9c5291-daa7-40af-9c4f-7890331ea51b tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] 10.222.0.42 "GET /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c" status: 200 len: 1272 microversion: 2.1 time: 0.097944 Aug 25 05:32:50.839695 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 126/270] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:50 2021] GET /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c => generated 1272 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:32:51.225662 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1b862b00-3bf5-49f2-829b-88697c7bdcba tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:51.226621 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1b862b00-3bf5-49f2-829b-88697c7bdcba tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:51.234598 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1b862b00-3bf5-49f2-829b-88697c7bdcba tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:51.240349 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1b862b00-3bf5-49f2-829b-88697c7bdcba tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:51.240349 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1b862b00-3bf5-49f2-829b-88697c7bdcba tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:51.240349 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1b862b00-3bf5-49f2-829b-88697c7bdcba tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:51.514128 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-1b862b00-3bf5-49f2-829b-88697c7bdcba tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:51.527796 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1b862b00-3bf5-49f2-829b-88697c7bdcba tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1501 microversion: 2.1 time: 0.306022 Aug 25 05:32:51.528962 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 145/271] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:51 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1501 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:32:51.550491 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-cf8a2124-64e8-4b70-91da-8f0343db933f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:51.552202 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-cf8a2124-64e8-4b70-91da-8f0343db933f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:51.560029 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cf8a2124-64e8-4b70-91da-8f0343db933f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:51.560672 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cf8a2124-64e8-4b70-91da-8f0343db933f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:51.561011 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a010508c-ec57-473b-a24f-dc325c877a05 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "febccd00-363c-479f-ab39-44f037c1c8c7"}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:51.562735 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cf8a2124-64e8-4b70-91da-8f0343db933f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:51.562735 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cf8a2124-64e8-4b70-91da-8f0343db933f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:51.562982 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a010508c-ec57-473b-a24f-dc325c877a05 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:51.574283 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a010508c-ec57-473b-a24f-dc325c877a05 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:51.574739 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a010508c-ec57-473b-a24f-dc325c877a05 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:51.577561 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a010508c-ec57-473b-a24f-dc325c877a05 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:51.581981 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a010508c-ec57-473b-a24f-dc325c877a05 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:51.616555 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.wsgi [None req-a010508c-ec57-473b-a24f-dc325c877a05 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] HTTP exception thrown: Cannot 'attach_volume' instance 2163e566-1832-40df-8925-09e54ae2974c while it is in vm_state rescued Aug 25 05:32:51.617311 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a010508c-ec57-473b-a24f-dc325c877a05 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Returning 409 to user: Cannot 'attach_volume' instance 2163e566-1832-40df-8925-09e54ae2974c while it is in vm_state rescued {{(pid=108885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 05:32:51.618139 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a010508c-ec57-473b-a24f-dc325c877a05 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "POST /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.063047 Aug 25 05:32:51.618773 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 146/272] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 25 05:32:51 2021] POST /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c/os-volume_attachments => generated 152 bytes in 65 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 05:32:51.639590 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-558e7c64-7ea6-4782-996b-3c17bf4f0616 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:51.646582 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-558e7c64-7ea6-4782-996b-3c17bf4f0616 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:51.656291 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-cf8a2124-64e8-4b70-91da-8f0343db933f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28434 microversion: 2.1 time: 0.124057 Aug 25 05:32:51.656506 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-558e7c64-7ea6-4782-996b-3c17bf4f0616 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:51.657160 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-558e7c64-7ea6-4782-996b-3c17bf4f0616 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:51.659739 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 127/273] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:32:51 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28434 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:32:51.663612 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-558e7c64-7ea6-4782-996b-3c17bf4f0616 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:51.665417 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-558e7c64-7ea6-4782-996b-3c17bf4f0616 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:51.710920 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6691114e-eee0-41ac-bbff-114cfebd8f12 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:51.712257 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6691114e-eee0-41ac-bbff-114cfebd8f12 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:51.724899 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6691114e-eee0-41ac-bbff-114cfebd8f12 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:51.725710 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6691114e-eee0-41ac-bbff-114cfebd8f12 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:51.727085 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6691114e-eee0-41ac-bbff-114cfebd8f12 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:51.727852 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6691114e-eee0-41ac-bbff-114cfebd8f12 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:51.851540 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6691114e-eee0-41ac-bbff-114cfebd8f12 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28446 microversion: 2.20 time: 0.144548 Aug 25 05:32:51.852676 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 128/274] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:32:51 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28446 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 25 05:32:51.881628 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-41b4e9d9-9534-4014-b253-9d05a6dcb373 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:51.882909 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-41b4e9d9-9534-4014-b253-9d05a6dcb373 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] [instance: a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:51.895659 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-558e7c64-7ea6-4782-996b-3c17bf4f0616 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "POST /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c/action" status: 202 len: 0 microversion: 2.1 time: 0.265824 Aug 25 05:32:51.898577 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 147/275] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:32:51 2021] POST /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:32:51.912909 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d1680a20-993f-4d09-a565-d46568307bb6 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:51.921260 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-41b4e9d9-9534-4014-b253-9d05a6dcb373 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:51.923465 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-41b4e9d9-9534-4014-b253-9d05a6dcb373 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:51.924936 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-41b4e9d9-9534-4014-b253-9d05a6dcb373 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:51.927985 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d1680a20-993f-4d09-a565-d46568307bb6 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:51.930058 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-41b4e9d9-9534-4014-b253-9d05a6dcb373 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:51.944189 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d1680a20-993f-4d09-a565-d46568307bb6 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:51.958092 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d1680a20-993f-4d09-a565-d46568307bb6 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:51.959496 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d1680a20-993f-4d09-a565-d46568307bb6 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:51.960189 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d1680a20-993f-4d09-a565-d46568307bb6 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:52.295533 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d1680a20-993f-4d09-a565-d46568307bb6 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:52.311275 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d1680a20-993f-4d09-a565-d46568307bb6 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1509 microversion: 2.1 time: 0.404962 Aug 25 05:32:52.311992 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 148/276] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:51 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1509 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:32:52.333311 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-41b4e9d9-9534-4014-b253-9d05a6dcb373 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7e59bcbcd843db87ce96d5f2173e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e08a9b0891a4b2e84b4e1daabc7bfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:52.342583 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-41b4e9d9-9534-4014-b253-9d05a6dcb373 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] 10.222.0.42 "GET /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c" status: 200 len: 1314 microversion: 2.1 time: 0.478239 Aug 25 05:32:52.352766 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 129/277] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:51 2021] GET /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c => generated 1314 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:32:52.677578 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b2eebcb8-1363-4fba-b891-7e5cfebff7b8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:52.679893 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b2eebcb8-1363-4fba-b891-7e5cfebff7b8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:52.689542 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b2eebcb8-1363-4fba-b891-7e5cfebff7b8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:52.690268 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b2eebcb8-1363-4fba-b891-7e5cfebff7b8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:52.691220 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b2eebcb8-1363-4fba-b891-7e5cfebff7b8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:52.691823 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b2eebcb8-1363-4fba-b891-7e5cfebff7b8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:52.789082 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b2eebcb8-1363-4fba-b891-7e5cfebff7b8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28434 microversion: 2.1 time: 0.117731 Aug 25 05:32:52.789769 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 149/278] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:32:52 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28434 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:32:52.866795 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3c82f2b9-6598-4091-a87e-e0be17c6bf0a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:52.867856 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3c82f2b9-6598-4091-a87e-e0be17c6bf0a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:52.878427 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3c82f2b9-6598-4091-a87e-e0be17c6bf0a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:52.882561 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3c82f2b9-6598-4091-a87e-e0be17c6bf0a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:52.882561 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3c82f2b9-6598-4091-a87e-e0be17c6bf0a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:52.882561 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3c82f2b9-6598-4091-a87e-e0be17c6bf0a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:52.977403 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3c82f2b9-6598-4091-a87e-e0be17c6bf0a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28446 microversion: 2.20 time: 0.115121 Aug 25 05:32:52.978685 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 130/279] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:32:52 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28446 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:32:53.302383 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [req-b3d63f02-ecc7-4db8-8a85-7388ecc022b7 req-448736b7-703a-4757-83c3-e5ffdae37bd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c", "tag": "cf8331ac-d87a-4427-8de0-76a29886f17f"}]} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:53.304725 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:32:53.304725 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: warnings.warn(msg) Aug 25 05:32:53.320149 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-b3d63f02-ecc7-4db8-8a85-7388ecc022b7 req-448736b7-703a-4757-83c3-e5ffdae37bd5 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:53.320992 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-b3d63f02-ecc7-4db8-8a85-7388ecc022b7 req-448736b7-703a-4757-83c3-e5ffdae37bd5 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:53.335817 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b12952d3-3e85-4fcf-ac90-56bacbd7895f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:53.336830 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b12952d3-3e85-4fcf-ac90-56bacbd7895f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:53.338743 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.compute.server_external_events [req-b3d63f02-ecc7-4db8-8a85-7388ecc022b7 req-448736b7-703a-4757-83c3-e5ffdae37bd5 service nova] Creating event network-changed:cf8331ac-d87a-4427-8de0-76a29886f17f for instance a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c on hv-cinder-78662 Aug 25 05:32:53.348163 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [req-b3d63f02-ecc7-4db8-8a85-7388ecc022b7 req-448736b7-703a-4757-83c3-e5ffdae37bd5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051655 Aug 25 05:32:53.349802 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 150/280] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:32:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:32:53.350208 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b12952d3-3e85-4fcf-ac90-56bacbd7895f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:53.350726 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b12952d3-3e85-4fcf-ac90-56bacbd7895f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:53.353193 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b12952d3-3e85-4fcf-ac90-56bacbd7895f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:53.353703 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b12952d3-3e85-4fcf-ac90-56bacbd7895f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:53.363944 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-844b656d-686d-4dc3-9483-c56267a77a3f tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:53.365108 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-844b656d-686d-4dc3-9483-c56267a77a3f tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] [instance: a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:53.377309 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-844b656d-686d-4dc3-9483-c56267a77a3f tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:53.378242 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-844b656d-686d-4dc3-9483-c56267a77a3f tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:53.379267 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-844b656d-686d-4dc3-9483-c56267a77a3f tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:53.379877 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-844b656d-686d-4dc3-9483-c56267a77a3f tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:53.791666 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-b12952d3-3e85-4fcf-ac90-56bacbd7895f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:53.802008 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b12952d3-3e85-4fcf-ac90-56bacbd7895f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1509 microversion: 2.1 time: 0.470943 Aug 25 05:32:53.805275 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 131/281] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:53 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1509 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:32:53.818493 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-4f268b67-8e00-41ae-9838-e1030bbcb27f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:53.818493 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-4f268b67-8e00-41ae-9838-e1030bbcb27f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:53.828282 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4f268b67-8e00-41ae-9838-e1030bbcb27f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:53.830255 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4f268b67-8e00-41ae-9838-e1030bbcb27f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:53.831303 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4f268b67-8e00-41ae-9838-e1030bbcb27f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:53.832066 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4f268b67-8e00-41ae-9838-e1030bbcb27f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:53.926092 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-844b656d-686d-4dc3-9483-c56267a77a3f tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7e59bcbcd843db87ce96d5f2173e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e08a9b0891a4b2e84b4e1daabc7bfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:53.961880 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-844b656d-686d-4dc3-9483-c56267a77a3f tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] 10.222.0.42 "GET /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c" status: 200 len: 1314 microversion: 2.1 time: 0.600895 Aug 25 05:32:53.987515 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 151/282] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:53 2021] GET /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c => generated 1314 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:32:54.006558 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-fc1b7401-0ae1-4326-a79b-9392e19bb5d0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:54.009729 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-fc1b7401-0ae1-4326-a79b-9392e19bb5d0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:54.032762 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fc1b7401-0ae1-4326-a79b-9392e19bb5d0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:54.035620 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fc1b7401-0ae1-4326-a79b-9392e19bb5d0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:54.037322 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fc1b7401-0ae1-4326-a79b-9392e19bb5d0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:54.038520 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fc1b7401-0ae1-4326-a79b-9392e19bb5d0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:54.147672 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-fc1b7401-0ae1-4326-a79b-9392e19bb5d0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28614 microversion: 2.20 time: 0.157875 Aug 25 05:32:54.148503 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 152/283] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:32:53 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28614 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:32:54.177221 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-4f268b67-8e00-41ae-9838-e1030bbcb27f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28602 microversion: 2.1 time: 0.370087 Aug 25 05:32:54.178965 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 132/284] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:32:53 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28602 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:32:54.832306 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-04a2af06-de0a-4cdc-a162-91446a3b7450 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:54.833460 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-04a2af06-de0a-4cdc-a162-91446a3b7450 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:54.841429 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-04a2af06-de0a-4cdc-a162-91446a3b7450 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:54.841931 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-04a2af06-de0a-4cdc-a162-91446a3b7450 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:54.842715 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-04a2af06-de0a-4cdc-a162-91446a3b7450 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:54.843108 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-04a2af06-de0a-4cdc-a162-91446a3b7450 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:54.979469 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-bfb47028-70dd-4061-95e4-35f907d5a82d tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:54.980553 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-bfb47028-70dd-4061-95e4-35f907d5a82d tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] [instance: a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:54.987636 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bfb47028-70dd-4061-95e4-35f907d5a82d tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:54.988077 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bfb47028-70dd-4061-95e4-35f907d5a82d tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:54.988955 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bfb47028-70dd-4061-95e4-35f907d5a82d tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:54.989389 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bfb47028-70dd-4061-95e4-35f907d5a82d tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:55.080377 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-04a2af06-de0a-4cdc-a162-91446a3b7450 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:55.102051 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-04a2af06-de0a-4cdc-a162-91446a3b7450 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1509 microversion: 2.1 time: 0.275547 Aug 25 05:32:55.103063 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 153/285] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:54 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1509 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:32:55.165563 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-81d860f4-fa52-4ed6-9701-3affc41d4beb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:55.167040 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-81d860f4-fa52-4ed6-9701-3affc41d4beb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:55.173515 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-81d860f4-fa52-4ed6-9701-3affc41d4beb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:55.174053 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-81d860f4-fa52-4ed6-9701-3affc41d4beb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:55.174847 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-81d860f4-fa52-4ed6-9701-3affc41d4beb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:55.175294 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-81d860f4-fa52-4ed6-9701-3affc41d4beb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:55.227329 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-bfb47028-70dd-4061-95e4-35f907d5a82d tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7e59bcbcd843db87ce96d5f2173e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e08a9b0891a4b2e84b4e1daabc7bfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:55.245401 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-bfb47028-70dd-4061-95e4-35f907d5a82d tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] 10.222.0.42 "GET /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c" status: 200 len: 1314 microversion: 2.1 time: 0.269418 Aug 25 05:32:55.246861 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 133/286] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:54 2021] GET /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:32:55.263674 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-cb8ed543-4c6e-47a1-975e-df9aa7bf6d54 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:55.267255 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-cb8ed543-4c6e-47a1-975e-df9aa7bf6d54 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:55.269986 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-81d860f4-fa52-4ed6-9701-3affc41d4beb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28614 microversion: 2.20 time: 0.109684 Aug 25 05:32:55.272322 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 154/287] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:32:55 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28614 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 25 05:32:55.279583 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cb8ed543-4c6e-47a1-975e-df9aa7bf6d54 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:55.280364 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cb8ed543-4c6e-47a1-975e-df9aa7bf6d54 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:55.285771 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cb8ed543-4c6e-47a1-975e-df9aa7bf6d54 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:55.285771 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cb8ed543-4c6e-47a1-975e-df9aa7bf6d54 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:55.461617 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-cb8ed543-4c6e-47a1-975e-df9aa7bf6d54 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28602 microversion: 2.1 time: 0.212791 Aug 25 05:32:55.463240 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 134/288] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:32:55 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28602 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:32:56.127769 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-64b2f03d-480e-488e-9b69-69774e1e286a tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:56.128469 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-64b2f03d-480e-488e-9b69-69774e1e286a tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:56.134766 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-64b2f03d-480e-488e-9b69-69774e1e286a tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:56.135214 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-64b2f03d-480e-488e-9b69-69774e1e286a tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:56.135985 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-64b2f03d-480e-488e-9b69-69774e1e286a tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:56.136420 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-64b2f03d-480e-488e-9b69-69774e1e286a tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:56.264759 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b73a7c2a-ee3d-4317-b8d5-2f2d40653db8 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:56.265447 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b73a7c2a-ee3d-4317-b8d5-2f2d40653db8 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] [instance: a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:56.277274 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b73a7c2a-ee3d-4317-b8d5-2f2d40653db8 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:56.277786 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b73a7c2a-ee3d-4317-b8d5-2f2d40653db8 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:56.278586 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b73a7c2a-ee3d-4317-b8d5-2f2d40653db8 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:56.279014 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b73a7c2a-ee3d-4317-b8d5-2f2d40653db8 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:56.303224 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-64b2f03d-480e-488e-9b69-69774e1e286a tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:56.311968 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-64b2f03d-480e-488e-9b69-69774e1e286a tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1509 microversion: 2.1 time: 0.189704 Aug 25 05:32:56.312619 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 155/289] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:56 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1509 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:32:56.337276 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-449f1310-18ba-40d3-afbd-77bb8205f516 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:56.349961 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-449f1310-18ba-40d3-afbd-77bb8205f516 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:56.369313 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-449f1310-18ba-40d3-afbd-77bb8205f516 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:56.370258 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-449f1310-18ba-40d3-afbd-77bb8205f516 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:56.371315 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-449f1310-18ba-40d3-afbd-77bb8205f516 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:56.371925 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-449f1310-18ba-40d3-afbd-77bb8205f516 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:56.570671 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-449f1310-18ba-40d3-afbd-77bb8205f516 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28614 microversion: 2.20 time: 0.243526 Aug 25 05:32:56.572218 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 156/290] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:32:56 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28614 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:32:56.582458 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a57e55f6-5dec-4f78-8017-6e3ca1b5b162 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:56.583470 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a57e55f6-5dec-4f78-8017-6e3ca1b5b162 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:56.591371 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a57e55f6-5dec-4f78-8017-6e3ca1b5b162 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:56.592156 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a57e55f6-5dec-4f78-8017-6e3ca1b5b162 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:56.593634 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a57e55f6-5dec-4f78-8017-6e3ca1b5b162 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:56.593953 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a57e55f6-5dec-4f78-8017-6e3ca1b5b162 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:56.668953 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-b73a7c2a-ee3d-4317-b8d5-2f2d40653db8 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7e59bcbcd843db87ce96d5f2173e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e08a9b0891a4b2e84b4e1daabc7bfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:56.677046 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b73a7c2a-ee3d-4317-b8d5-2f2d40653db8 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] 10.222.0.42 "GET /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c" status: 200 len: 1314 microversion: 2.1 time: 0.416224 Aug 25 05:32:56.678134 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 135/291] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:56 2021] GET /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:32:56.682088 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a57e55f6-5dec-4f78-8017-6e3ca1b5b162 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28602 microversion: 2.1 time: 0.107239 Aug 25 05:32:56.682986 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 157/292] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:32:56 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28602 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:32:57.379736 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-077366f8-1829-463c-ac09-60293ac36e0b tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:57.379736 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-077366f8-1829-463c-ac09-60293ac36e0b tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:57.382849 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-077366f8-1829-463c-ac09-60293ac36e0b tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:57.383360 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-077366f8-1829-463c-ac09-60293ac36e0b tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:57.384139 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-077366f8-1829-463c-ac09-60293ac36e0b tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:57.384579 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-077366f8-1829-463c-ac09-60293ac36e0b tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:57.541431 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-077366f8-1829-463c-ac09-60293ac36e0b tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:57.551285 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-077366f8-1829-463c-ac09-60293ac36e0b tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1515 microversion: 2.1 time: 0.179948 Aug 25 05:32:57.552675 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 136/293] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:57 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1515 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:32:57.589908 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-231d5890-deca-4e62-ab15-fe58ab0cdec9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:57.593177 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-231d5890-deca-4e62-ab15-fe58ab0cdec9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:57.611579 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-231d5890-deca-4e62-ab15-fe58ab0cdec9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:57.611579 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-231d5890-deca-4e62-ab15-fe58ab0cdec9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:57.612873 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-231d5890-deca-4e62-ab15-fe58ab0cdec9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:57.613911 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-231d5890-deca-4e62-ab15-fe58ab0cdec9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:57.701403 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6b79df2f-6782-46ea-9a62-80bd162b2086 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:57.701937 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-231d5890-deca-4e62-ab15-fe58ab0cdec9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28614 microversion: 2.20 time: 0.118733 Aug 25 05:32:57.707962 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 158/294] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:32:57 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28614 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:32:57.710119 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6b79df2f-6782-46ea-9a62-80bd162b2086 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:57.713244 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b14d8b99-8c02-4bdc-8ccb-029765226fc5 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:57.714103 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b14d8b99-8c02-4bdc-8ccb-029765226fc5 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] [instance: a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:57.721353 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6b79df2f-6782-46ea-9a62-80bd162b2086 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:57.722620 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6b79df2f-6782-46ea-9a62-80bd162b2086 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:57.724274 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6b79df2f-6782-46ea-9a62-80bd162b2086 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:57.725218 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6b79df2f-6782-46ea-9a62-80bd162b2086 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:57.726282 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b14d8b99-8c02-4bdc-8ccb-029765226fc5 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:57.726805 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b14d8b99-8c02-4bdc-8ccb-029765226fc5 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:57.731165 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b14d8b99-8c02-4bdc-8ccb-029765226fc5 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:57.734712 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b14d8b99-8c02-4bdc-8ccb-029765226fc5 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:57.825462 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6b79df2f-6782-46ea-9a62-80bd162b2086 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28602 microversion: 2.1 time: 0.132169 Aug 25 05:32:57.826896 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 137/295] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:32:57 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28602 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:32:58.097089 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-b14d8b99-8c02-4bdc-8ccb-029765226fc5 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7e59bcbcd843db87ce96d5f2173e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e08a9b0891a4b2e84b4e1daabc7bfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:58.107508 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b14d8b99-8c02-4bdc-8ccb-029765226fc5 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] 10.222.0.42 "GET /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c" status: 200 len: 1314 microversion: 2.1 time: 0.402994 Aug 25 05:32:58.108101 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 159/296] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:57 2021] GET /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c => generated 1314 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:32:58.715488 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-0ea3d39f-2339-43d2-8829-886b1bc423d6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:58.716638 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-0ea3d39f-2339-43d2-8829-886b1bc423d6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:58.724052 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0ea3d39f-2339-43d2-8829-886b1bc423d6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:58.724501 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0ea3d39f-2339-43d2-8829-886b1bc423d6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:58.725281 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0ea3d39f-2339-43d2-8829-886b1bc423d6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:58.725924 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0ea3d39f-2339-43d2-8829-886b1bc423d6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:58.797759 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-0ea3d39f-2339-43d2-8829-886b1bc423d6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28614 microversion: 2.20 time: 0.085845 Aug 25 05:32:58.798508 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 138/297] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:32:58 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28614 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:32:58.843204 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d8eea19d-43e7-41f7-a635-5e1dd435f11d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:58.845865 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d8eea19d-43e7-41f7-a635-5e1dd435f11d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:58.857164 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d8eea19d-43e7-41f7-a635-5e1dd435f11d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:58.859865 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d8eea19d-43e7-41f7-a635-5e1dd435f11d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:58.859865 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d8eea19d-43e7-41f7-a635-5e1dd435f11d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:58.859865 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d8eea19d-43e7-41f7-a635-5e1dd435f11d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:58.954738 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d8eea19d-43e7-41f7-a635-5e1dd435f11d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28602 microversion: 2.1 time: 0.117053 Aug 25 05:32:58.959046 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 160/298] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:32:58 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28602 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:32:59.131031 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e61bb147-79d2-44f7-94e6-293227ca1a3e tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:32:59.143060 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e61bb147-79d2-44f7-94e6-293227ca1a3e tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] [instance: a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:59.154372 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e61bb147-79d2-44f7-94e6-293227ca1a3e tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:59.154372 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e61bb147-79d2-44f7-94e6-293227ca1a3e tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:59.154372 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e61bb147-79d2-44f7-94e6-293227ca1a3e tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:59.155592 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e61bb147-79d2-44f7-94e6-293227ca1a3e tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:59.339475 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e61bb147-79d2-44f7-94e6-293227ca1a3e tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7e59bcbcd843db87ce96d5f2173e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e08a9b0891a4b2e84b4e1daabc7bfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:32:59.351281 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e61bb147-79d2-44f7-94e6-293227ca1a3e tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] 10.222.0.42 "GET /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c" status: 200 len: 1314 microversion: 2.1 time: 0.225212 Aug 25 05:32:59.352235 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 139/299] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:32:59 2021] GET /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:32:59.821840 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-36e7965f-f0b1-4f6d-8437-b23744eeb1fc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:59.821840 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-36e7965f-f0b1-4f6d-8437-b23744eeb1fc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:59.825258 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-36e7965f-f0b1-4f6d-8437-b23744eeb1fc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:59.825912 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-36e7965f-f0b1-4f6d-8437-b23744eeb1fc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:59.826817 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-36e7965f-f0b1-4f6d-8437-b23744eeb1fc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:59.827789 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-36e7965f-f0b1-4f6d-8437-b23744eeb1fc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:59.934099 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-36e7965f-f0b1-4f6d-8437-b23744eeb1fc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28614 microversion: 2.20 time: 0.112112 Aug 25 05:32:59.941229 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 161/300] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:32:59 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28614 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:32:59.974705 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8fe1b564-d1e6-4c99-94ee-90ccc28c3764 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:32:59.976263 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8fe1b564-d1e6-4c99-94ee-90ccc28c3764 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:32:59.987661 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8fe1b564-d1e6-4c99-94ee-90ccc28c3764 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:59.988444 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8fe1b564-d1e6-4c99-94ee-90ccc28c3764 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:32:59.990003 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8fe1b564-d1e6-4c99-94ee-90ccc28c3764 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:32:59.991072 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8fe1b564-d1e6-4c99-94ee-90ccc28c3764 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:00.082244 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8fe1b564-d1e6-4c99-94ee-90ccc28c3764 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28602 microversion: 2.1 time: 0.112434 Aug 25 05:33:00.085642 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 140/301] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:32:59 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28602 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:33:00.372091 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-bd11d9eb-0562-44a2-a755-f675751f9b63 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:00.372890 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-bd11d9eb-0562-44a2-a755-f675751f9b63 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] [instance: a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:00.379483 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bd11d9eb-0562-44a2-a755-f675751f9b63 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:00.380010 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bd11d9eb-0562-44a2-a755-f675751f9b63 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:00.380972 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bd11d9eb-0562-44a2-a755-f675751f9b63 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:00.381494 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bd11d9eb-0562-44a2-a755-f675751f9b63 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:00.554983 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-bd11d9eb-0562-44a2-a755-f675751f9b63 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7e59bcbcd843db87ce96d5f2173e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e08a9b0891a4b2e84b4e1daabc7bfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:00.568817 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-bd11d9eb-0562-44a2-a755-f675751f9b63 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] 10.222.0.42 "GET /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c" status: 200 len: 1314 microversion: 2.1 time: 0.202364 Aug 25 05:33:00.569495 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 162/302] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:00 2021] GET /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:00.955290 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-62d49a32-6002-4065-be39-1f72c99f7e9c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:00.955290 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-62d49a32-6002-4065-be39-1f72c99f7e9c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:00.955290 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-62d49a32-6002-4065-be39-1f72c99f7e9c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:00.955290 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-62d49a32-6002-4065-be39-1f72c99f7e9c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:00.955608 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-62d49a32-6002-4065-be39-1f72c99f7e9c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:00.955608 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-62d49a32-6002-4065-be39-1f72c99f7e9c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:00.955742 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-44b0300b-f605-45b5-a586-1d712d87d25f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:00.955742 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-44b0300b-f605-45b5-a586-1d712d87d25f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:00.956500 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-44b0300b-f605-45b5-a586-1d712d87d25f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:00.957125 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-44b0300b-f605-45b5-a586-1d712d87d25f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:00.958137 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-44b0300b-f605-45b5-a586-1d712d87d25f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:00.958625 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-44b0300b-f605-45b5-a586-1d712d87d25f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:01.035401 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-62d49a32-6002-4065-be39-1f72c99f7e9c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:01.043331 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-62d49a32-6002-4065-be39-1f72c99f7e9c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1515 microversion: 2.1 time: 0.171647 Aug 25 05:33:01.043896 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 141/303] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:00 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:01.065914 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-9ba2ca49-fc76-4bf5-aa21-aeb62f6f2b8c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b82283f-d3a8-4c15-a4eb-48fc85e7d377"}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:01.066989 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-9ba2ca49-fc76-4bf5-aa21-aeb62f6f2b8c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:01.073416 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9ba2ca49-fc76-4bf5-aa21-aeb62f6f2b8c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:01.073902 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9ba2ca49-fc76-4bf5-aa21-aeb62f6f2b8c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:01.074667 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9ba2ca49-fc76-4bf5-aa21-aeb62f6f2b8c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:01.075107 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9ba2ca49-fc76-4bf5-aa21-aeb62f6f2b8c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:01.092899 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-44b0300b-f605-45b5-a586-1d712d87d25f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28614 microversion: 2.20 time: 0.147767 Aug 25 05:33:01.097035 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 163/304] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:00 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28614 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 25 05:33:01.099323 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a8262b49-b17e-4fd2-94f1-52f96ca48615 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:01.100326 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a8262b49-b17e-4fd2-94f1-52f96ca48615 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:01.107850 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a8262b49-b17e-4fd2-94f1-52f96ca48615 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:01.108909 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a8262b49-b17e-4fd2-94f1-52f96ca48615 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:01.110422 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a8262b49-b17e-4fd2-94f1-52f96ca48615 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:01.110422 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a8262b49-b17e-4fd2-94f1-52f96ca48615 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:01.180437 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a8262b49-b17e-4fd2-94f1-52f96ca48615 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28602 microversion: 2.1 time: 0.085113 Aug 25 05:33:01.181206 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 164/305] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:01 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28602 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:33:01.596313 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e203694e-01c0-4d9b-8782-23f2876080da tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:01.597047 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e203694e-01c0-4d9b-8782-23f2876080da tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] [instance: a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:01.603782 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e203694e-01c0-4d9b-8782-23f2876080da tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:01.604216 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e203694e-01c0-4d9b-8782-23f2876080da tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:01.605000 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e203694e-01c0-4d9b-8782-23f2876080da tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:01.605737 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e203694e-01c0-4d9b-8782-23f2876080da tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:01.754246 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-e203694e-01c0-4d9b-8782-23f2876080da tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7e59bcbcd843db87ce96d5f2173e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e08a9b0891a4b2e84b4e1daabc7bfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:01.762374 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e203694e-01c0-4d9b-8782-23f2876080da tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] 10.222.0.42 "GET /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c" status: 200 len: 1314 microversion: 2.1 time: 0.171247 Aug 25 05:33:01.763084 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 165/306] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:01 2021] GET /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:33:02.007145 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-9ba2ca49-fc76-4bf5-aa21-aeb62f6f2b8c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "POST /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.949867 Aug 25 05:33:02.008326 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 142/307] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 25 05:33:01 2021] POST /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c/os-volume_attachments => generated 194 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:33:02.105153 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5785b117-6272-404f-8a8d-fc0a9450a0c4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:02.106101 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5785b117-6272-404f-8a8d-fc0a9450a0c4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:02.113364 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5785b117-6272-404f-8a8d-fc0a9450a0c4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:02.113817 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5785b117-6272-404f-8a8d-fc0a9450a0c4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:02.114624 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5785b117-6272-404f-8a8d-fc0a9450a0c4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:02.115222 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5785b117-6272-404f-8a8d-fc0a9450a0c4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:02.196251 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e77a21f9-55d9-48c9-aab6-a47e38b72095 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:02.199240 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e77a21f9-55d9-48c9-aab6-a47e38b72095 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:02.208339 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5785b117-6272-404f-8a8d-fc0a9450a0c4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28614 microversion: 2.20 time: 0.106795 Aug 25 05:33:02.209028 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 166/308] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:02 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28614 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 25 05:33:02.216734 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e77a21f9-55d9-48c9-aab6-a47e38b72095 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:02.218568 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e77a21f9-55d9-48c9-aab6-a47e38b72095 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:02.220271 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e77a21f9-55d9-48c9-aab6-a47e38b72095 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:02.220907 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e77a21f9-55d9-48c9-aab6-a47e38b72095 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:02.278696 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [req-12ae2200-d6ed-4626-851f-cb7fdecfe93f req-b151392e-173b-42f3-979f-997c6a249498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c", "name": "network-vif-plugged", "status": "completed", "tag": "cf8331ac-d87a-4427-8de0-76a29886f17f"}]} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:02.283170 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:33:02.283170 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: warnings.warn(msg) Aug 25 05:33:02.291888 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-12ae2200-d6ed-4626-851f-cb7fdecfe93f req-b151392e-173b-42f3-979f-997c6a249498 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:02.292340 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-12ae2200-d6ed-4626-851f-cb7fdecfe93f req-b151392e-173b-42f3-979f-997c6a249498 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:02.305709 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e77a21f9-55d9-48c9-aab6-a47e38b72095 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28602 microversion: 2.1 time: 0.115881 Aug 25 05:33:02.311864 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 143/309] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:02 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28602 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:33:02.321199 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.compute.server_external_events [req-12ae2200-d6ed-4626-851f-cb7fdecfe93f req-b151392e-173b-42f3-979f-997c6a249498 service nova] Creating event network-vif-plugged:cf8331ac-d87a-4427-8de0-76a29886f17f for instance a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c on hv-cinder-78662 Aug 25 05:33:02.328929 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [req-12ae2200-d6ed-4626-851f-cb7fdecfe93f req-b151392e-173b-42f3-979f-997c6a249498 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054063 Aug 25 05:33:02.330512 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 167/310] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:33:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:33:02.786593 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5cb279f1-a022-4d39-84ee-7f039c60885d tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:02.787504 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5cb279f1-a022-4d39-84ee-7f039c60885d tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] [instance: a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:02.803069 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5cb279f1-a022-4d39-84ee-7f039c60885d tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:02.803069 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5cb279f1-a022-4d39-84ee-7f039c60885d tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:02.803069 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5cb279f1-a022-4d39-84ee-7f039c60885d tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:02.803069 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5cb279f1-a022-4d39-84ee-7f039c60885d tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:02.957010 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-5cb279f1-a022-4d39-84ee-7f039c60885d tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7e59bcbcd843db87ce96d5f2173e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e08a9b0891a4b2e84b4e1daabc7bfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:02.966022 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5cb279f1-a022-4d39-84ee-7f039c60885d tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] 10.222.0.42 "GET /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c" status: 200 len: 1314 microversion: 2.1 time: 0.188996 Aug 25 05:33:02.966580 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 144/311] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:02 2021] GET /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:03.221166 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-4a2ff6b7-64f5-4534-84ab-1a3c02885e26 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:03.222212 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-4a2ff6b7-64f5-4534-84ab-1a3c02885e26 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:03.229103 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4a2ff6b7-64f5-4534-84ab-1a3c02885e26 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:03.229558 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4a2ff6b7-64f5-4534-84ab-1a3c02885e26 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:03.230490 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4a2ff6b7-64f5-4534-84ab-1a3c02885e26 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:03.230788 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4a2ff6b7-64f5-4534-84ab-1a3c02885e26 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:03.306876 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-4a2ff6b7-64f5-4534-84ab-1a3c02885e26 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28614 microversion: 2.20 time: 0.090556 Aug 25 05:33:03.307542 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 168/312] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:03 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28614 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:33:03.320533 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8f2abc01-3a01-4430-9fd9-16ca4a0a5f45 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:03.321562 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8f2abc01-3a01-4430-9fd9-16ca4a0a5f45 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:03.328071 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8f2abc01-3a01-4430-9fd9-16ca4a0a5f45 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:03.328511 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8f2abc01-3a01-4430-9fd9-16ca4a0a5f45 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:03.329461 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8f2abc01-3a01-4430-9fd9-16ca4a0a5f45 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:03.329950 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8f2abc01-3a01-4430-9fd9-16ca4a0a5f45 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:03.427752 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8f2abc01-3a01-4430-9fd9-16ca4a0a5f45 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28602 microversion: 2.1 time: 0.111531 Aug 25 05:33:03.428511 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 145/313] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:03 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28602 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:33:03.994766 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2aa59203-ebce-4f41-bf82-5eb6ed40646b tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:03.998384 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2aa59203-ebce-4f41-bf82-5eb6ed40646b tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] [instance: a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:04.009474 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2aa59203-ebce-4f41-bf82-5eb6ed40646b tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:04.010826 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2aa59203-ebce-4f41-bf82-5eb6ed40646b tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:04.012196 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2aa59203-ebce-4f41-bf82-5eb6ed40646b tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:04.013218 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2aa59203-ebce-4f41-bf82-5eb6ed40646b tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:04.193175 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-2aa59203-ebce-4f41-bf82-5eb6ed40646b tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7e59bcbcd843db87ce96d5f2173e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e08a9b0891a4b2e84b4e1daabc7bfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:04.201813 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2aa59203-ebce-4f41-bf82-5eb6ed40646b tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] 10.222.0.42 "GET /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c" status: 200 len: 1314 microversion: 2.1 time: 0.214962 Aug 25 05:33:04.202387 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 169/314] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:03 2021] GET /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:04.322388 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b225a5fe-cbc5-46ce-ac49-3e20195cdfad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:04.324290 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b225a5fe-cbc5-46ce-ac49-3e20195cdfad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:04.334814 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b225a5fe-cbc5-46ce-ac49-3e20195cdfad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:04.337303 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b225a5fe-cbc5-46ce-ac49-3e20195cdfad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:04.338909 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b225a5fe-cbc5-46ce-ac49-3e20195cdfad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:04.339361 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b225a5fe-cbc5-46ce-ac49-3e20195cdfad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:04.439526 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6d34eee7-77ab-4281-a0f9-def03f6cd98e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:04.440474 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6d34eee7-77ab-4281-a0f9-def03f6cd98e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:04.446223 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6d34eee7-77ab-4281-a0f9-def03f6cd98e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:04.446666 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6d34eee7-77ab-4281-a0f9-def03f6cd98e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:04.447422 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6d34eee7-77ab-4281-a0f9-def03f6cd98e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:04.447846 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6d34eee7-77ab-4281-a0f9-def03f6cd98e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:04.463534 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b225a5fe-cbc5-46ce-ac49-3e20195cdfad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28614 microversion: 2.20 time: 0.147080 Aug 25 05:33:04.464218 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 146/315] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:04 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28614 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 25 05:33:04.538010 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6d34eee7-77ab-4281-a0f9-def03f6cd98e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28602 microversion: 2.1 time: 0.102679 Aug 25 05:33:04.542848 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 170/316] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:04 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28602 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:33:05.227041 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-429c0eb6-94ad-45ea-8e8b-dbd664ec05fa tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:05.227041 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-429c0eb6-94ad-45ea-8e8b-dbd664ec05fa tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] [instance: a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:05.240539 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-429c0eb6-94ad-45ea-8e8b-dbd664ec05fa tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:05.242740 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-429c0eb6-94ad-45ea-8e8b-dbd664ec05fa tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:05.245956 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-429c0eb6-94ad-45ea-8e8b-dbd664ec05fa tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:05.245956 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-429c0eb6-94ad-45ea-8e8b-dbd664ec05fa tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:05.417079 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-429c0eb6-94ad-45ea-8e8b-dbd664ec05fa tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7e59bcbcd843db87ce96d5f2173e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e08a9b0891a4b2e84b4e1daabc7bfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:05.425811 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-429c0eb6-94ad-45ea-8e8b-dbd664ec05fa tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] 10.222.0.42 "GET /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c" status: 200 len: 1463 microversion: 2.1 time: 0.211048 Aug 25 05:33:05.426452 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 147/317] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:05 2021] GET /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c => generated 1463 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:05.474256 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-102d7cc8-ced8-4eca-ac47-13d00a5096f1 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:05.475446 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-102d7cc8-ced8-4eca-ac47-13d00a5096f1 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] [instance: a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:05.477029 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-452bd3ed-b8af-4c29-a735-24d22d1034ba tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:05.477988 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-452bd3ed-b8af-4c29-a735-24d22d1034ba tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:05.482253 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-102d7cc8-ced8-4eca-ac47-13d00a5096f1 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:05.482907 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-102d7cc8-ced8-4eca-ac47-13d00a5096f1 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:05.483830 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-102d7cc8-ced8-4eca-ac47-13d00a5096f1 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:05.484408 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-102d7cc8-ced8-4eca-ac47-13d00a5096f1 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:05.487751 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-452bd3ed-b8af-4c29-a735-24d22d1034ba tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:05.488472 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-452bd3ed-b8af-4c29-a735-24d22d1034ba tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:05.490298 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-452bd3ed-b8af-4c29-a735-24d22d1034ba tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:05.490430 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-452bd3ed-b8af-4c29-a735-24d22d1034ba tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:05.514332 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-102d7cc8-ced8-4eca-ac47-13d00a5096f1 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] [instance: a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c] Going to try to terminate instance {{(pid=108885) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 25 05:33:05.591003 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-452bd3ed-b8af-4c29-a735-24d22d1034ba tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28614 microversion: 2.20 time: 0.117426 Aug 25 05:33:05.592587 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 148/318] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:05 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28614 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:33:05.598471 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6e899059-e6a0-42eb-bb46-f2624c69e64f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:05.600320 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6e899059-e6a0-42eb-bb46-f2624c69e64f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:05.608765 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6e899059-e6a0-42eb-bb46-f2624c69e64f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:05.609408 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6e899059-e6a0-42eb-bb46-f2624c69e64f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:05.611105 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6e899059-e6a0-42eb-bb46-f2624c69e64f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:05.611726 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6e899059-e6a0-42eb-bb46-f2624c69e64f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:05.693886 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6e899059-e6a0-42eb-bb46-f2624c69e64f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28602 microversion: 2.1 time: 0.099245 Aug 25 05:33:05.694884 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 149/319] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:05 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28602 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:33:05.880800 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-102d7cc8-ced8-4eca-ac47-13d00a5096f1 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c" status: 204 len: 0 microversion: 2.1 time: 0.411403 Aug 25 05:33:05.881461 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 171/320] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 25 05:33:05 2021] DELETE /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 05:33:05.890796 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e8efc4bb-d1ce-403f-8f67-55d38e297576 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:05.892097 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e8efc4bb-d1ce-403f-8f67-55d38e297576 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] [instance: a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:05.899896 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e8efc4bb-d1ce-403f-8f67-55d38e297576 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:05.900625 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e8efc4bb-d1ce-403f-8f67-55d38e297576 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:05.901612 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e8efc4bb-d1ce-403f-8f67-55d38e297576 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:05.902374 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e8efc4bb-d1ce-403f-8f67-55d38e297576 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:06.069316 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e8efc4bb-d1ce-403f-8f67-55d38e297576 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7e59bcbcd843db87ce96d5f2173e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e08a9b0891a4b2e84b4e1daabc7bfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:06.077395 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e8efc4bb-d1ce-403f-8f67-55d38e297576 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] 10.222.0.42 "GET /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c" status: 200 len: 1469 microversion: 2.1 time: 0.190938 Aug 25 05:33:06.078408 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 150/321] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:05 2021] GET /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c => generated 1469 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:06.612281 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-cda2b590-1071-4ed6-aabf-c1e7a1aad8da tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:06.613286 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-cda2b590-1071-4ed6-aabf-c1e7a1aad8da tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:06.632087 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cda2b590-1071-4ed6-aabf-c1e7a1aad8da tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:06.632087 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cda2b590-1071-4ed6-aabf-c1e7a1aad8da tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:06.632750 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cda2b590-1071-4ed6-aabf-c1e7a1aad8da tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:06.633162 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cda2b590-1071-4ed6-aabf-c1e7a1aad8da tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:06.709015 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c1ecd7ef-d047-4d2c-b5d1-3538f764ff65 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:06.709965 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c1ecd7ef-d047-4d2c-b5d1-3538f764ff65 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:06.716037 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c1ecd7ef-d047-4d2c-b5d1-3538f764ff65 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:06.716483 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c1ecd7ef-d047-4d2c-b5d1-3538f764ff65 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:06.717248 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c1ecd7ef-d047-4d2c-b5d1-3538f764ff65 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:06.717716 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c1ecd7ef-d047-4d2c-b5d1-3538f764ff65 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:06.722644 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-cda2b590-1071-4ed6-aabf-c1e7a1aad8da tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28614 microversion: 2.20 time: 0.121564 Aug 25 05:33:06.723562 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 172/322] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:06 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28614 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:33:06.788629 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c1ecd7ef-d047-4d2c-b5d1-3538f764ff65 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28602 microversion: 2.1 time: 0.083424 Aug 25 05:33:06.793475 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 151/323] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:06 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28602 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:33:07.097776 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a815f1b5-3427-4020-8928-24ddff2d1719 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:07.103936 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a815f1b5-3427-4020-8928-24ddff2d1719 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] [instance: a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:07.105773 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a815f1b5-3427-4020-8928-24ddff2d1719 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:07.106450 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a815f1b5-3427-4020-8928-24ddff2d1719 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:07.107256 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a815f1b5-3427-4020-8928-24ddff2d1719 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:07.107690 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a815f1b5-3427-4020-8928-24ddff2d1719 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:07.354022 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-a815f1b5-3427-4020-8928-24ddff2d1719 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7e59bcbcd843db87ce96d5f2173e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e08a9b0891a4b2e84b4e1daabc7bfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:07.363771 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a815f1b5-3427-4020-8928-24ddff2d1719 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] 10.222.0.42 "GET /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c" status: 200 len: 1469 microversion: 2.1 time: 0.270991 Aug 25 05:33:07.364747 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 173/324] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:07 2021] GET /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c => generated 1469 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:33:07.736872 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8f7f86c8-c091-4bd2-af80-859a26f3ce15 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:07.739354 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8f7f86c8-c091-4bd2-af80-859a26f3ce15 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:07.745359 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8f7f86c8-c091-4bd2-af80-859a26f3ce15 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:07.745847 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8f7f86c8-c091-4bd2-af80-859a26f3ce15 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:07.746631 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8f7f86c8-c091-4bd2-af80-859a26f3ce15 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:07.747230 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8f7f86c8-c091-4bd2-af80-859a26f3ce15 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:07.807687 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-33494942-722a-44ab-824d-cd658a209112 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:07.807687 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-33494942-722a-44ab-824d-cd658a209112 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:07.814583 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-33494942-722a-44ab-824d-cd658a209112 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:07.815132 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-33494942-722a-44ab-824d-cd658a209112 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:07.815999 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-33494942-722a-44ab-824d-cd658a209112 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:07.816504 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-33494942-722a-44ab-824d-cd658a209112 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:07.825495 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8f7f86c8-c091-4bd2-af80-859a26f3ce15 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28614 microversion: 2.20 time: 0.092515 Aug 25 05:33:07.828221 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 152/325] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:07 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28614 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:33:07.908206 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-33494942-722a-44ab-824d-cd658a209112 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28602 microversion: 2.1 time: 0.108460 Aug 25 05:33:07.911731 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 174/326] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:07 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28602 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:33:08.382885 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7337afcd-2221-4e76-ba13-9d07d6eb41f8 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:08.383826 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7337afcd-2221-4e76-ba13-9d07d6eb41f8 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] [instance: a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:08.390360 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7337afcd-2221-4e76-ba13-9d07d6eb41f8 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:08.390818 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7337afcd-2221-4e76-ba13-9d07d6eb41f8 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:08.392136 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7337afcd-2221-4e76-ba13-9d07d6eb41f8 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:08.392567 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7337afcd-2221-4e76-ba13-9d07d6eb41f8 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:08.553672 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-7337afcd-2221-4e76-ba13-9d07d6eb41f8 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7e59bcbcd843db87ce96d5f2173e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e08a9b0891a4b2e84b4e1daabc7bfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:08.565197 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7337afcd-2221-4e76-ba13-9d07d6eb41f8 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] 10.222.0.42 "GET /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c" status: 200 len: 1469 microversion: 2.1 time: 0.186523 Aug 25 05:33:08.577399 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 153/327] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:08 2021] GET /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c => generated 1469 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:33:08.581150 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [req-07e4e06e-3bbd-477a-a7d5-d079280c0fc4 req-00d9d9a7-e84c-4676-9e89-8e0d57477fff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c", "name": "network-vif-deleted", "tag": "cf8331ac-d87a-4427-8de0-76a29886f17f"}]} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:08.588721 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:33:08.588721 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: warnings.warn(msg) Aug 25 05:33:08.601965 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-07e4e06e-3bbd-477a-a7d5-d079280c0fc4 req-00d9d9a7-e84c-4676-9e89-8e0d57477fff service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:08.602414 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-07e4e06e-3bbd-477a-a7d5-d079280c0fc4 req-00d9d9a7-e84c-4676-9e89-8e0d57477fff service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:08.615719 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.compute.server_external_events [req-07e4e06e-3bbd-477a-a7d5-d079280c0fc4 req-00d9d9a7-e84c-4676-9e89-8e0d57477fff service nova] Creating event network-vif-deleted:cf8331ac-d87a-4427-8de0-76a29886f17f for instance a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c on hv-cinder-78662 Aug 25 05:33:08.624287 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [req-07e4e06e-3bbd-477a-a7d5-d079280c0fc4 req-00d9d9a7-e84c-4676-9e89-8e0d57477fff service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051544 Aug 25 05:33:08.627938 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 175/328] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:33:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:33:08.839234 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-f974693b-2374-4c7d-8a32-8ea5015efde1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:08.840144 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-f974693b-2374-4c7d-8a32-8ea5015efde1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:08.846586 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f974693b-2374-4c7d-8a32-8ea5015efde1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:08.847024 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f974693b-2374-4c7d-8a32-8ea5015efde1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:08.847790 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f974693b-2374-4c7d-8a32-8ea5015efde1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:08.848246 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f974693b-2374-4c7d-8a32-8ea5015efde1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:08.920468 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a2c8ffbb-9c98-4779-9de3-4bf9cf29b027 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:08.921742 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a2c8ffbb-9c98-4779-9de3-4bf9cf29b027 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:08.928889 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-f974693b-2374-4c7d-8a32-8ea5015efde1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28614 microversion: 2.20 time: 0.093132 Aug 25 05:33:08.929097 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a2c8ffbb-9c98-4779-9de3-4bf9cf29b027 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:08.929494 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a2c8ffbb-9c98-4779-9de3-4bf9cf29b027 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:08.929979 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 154/329] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:08 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28614 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:33:08.930374 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a2c8ffbb-9c98-4779-9de3-4bf9cf29b027 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:08.930805 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a2c8ffbb-9c98-4779-9de3-4bf9cf29b027 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:08.995821 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a2c8ffbb-9c98-4779-9de3-4bf9cf29b027 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28602 microversion: 2.1 time: 0.079681 Aug 25 05:33:08.997481 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 176/330] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:08 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28602 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:33:09.587210 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-35f313a7-26b1-4fb5-9e72-9e62eddf309c tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:09.587849 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-35f313a7-26b1-4fb5-9e72-9e62eddf309c tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] [instance: a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:09.595930 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-35f313a7-26b1-4fb5-9e72-9e62eddf309c tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:09.596381 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-35f313a7-26b1-4fb5-9e72-9e62eddf309c tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:09.597170 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-35f313a7-26b1-4fb5-9e72-9e62eddf309c tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:09.597818 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-35f313a7-26b1-4fb5-9e72-9e62eddf309c tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:09.644158 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-35f313a7-26b1-4fb5-9e72-9e62eddf309c tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:09.644874 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-35f313a7-26b1-4fb5-9e72-9e62eddf309c tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:09.646146 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.objects.instance [None req-35f313a7-26b1-4fb5-9e72-9e62eddf309c tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lazy-loading 'fault' on Instance uuid a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c {{(pid=108884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 05:33:09.722822 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-35f313a7-26b1-4fb5-9e72-9e62eddf309c tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed7e59bcbcd843db87ce96d5f2173e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e08a9b0891a4b2e84b4e1daabc7bfe7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:09.730726 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-35f313a7-26b1-4fb5-9e72-9e62eddf309c tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] 10.222.0.42 "GET /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c" status: 200 len: 1304 microversion: 2.1 time: 0.148346 Aug 25 05:33:09.731726 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 155/331] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:09 2021] GET /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c => generated 1304 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:09.941601 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-35e518fe-dcd2-47b7-9cb2-cae5068ea6ff tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:09.942604 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-35e518fe-dcd2-47b7-9cb2-cae5068ea6ff tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:09.949824 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-35e518fe-dcd2-47b7-9cb2-cae5068ea6ff tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:09.950272 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-35e518fe-dcd2-47b7-9cb2-cae5068ea6ff tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:09.951060 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-35e518fe-dcd2-47b7-9cb2-cae5068ea6ff tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:09.951486 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-35e518fe-dcd2-47b7-9cb2-cae5068ea6ff tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:10.008248 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-61765e00-cbff-4845-97f7-55b6ef2def44 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:10.009089 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-61765e00-cbff-4845-97f7-55b6ef2def44 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:10.014964 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-61765e00-cbff-4845-97f7-55b6ef2def44 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:10.015414 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-61765e00-cbff-4845-97f7-55b6ef2def44 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:10.016457 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-61765e00-cbff-4845-97f7-55b6ef2def44 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:10.016735 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-61765e00-cbff-4845-97f7-55b6ef2def44 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:10.021319 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-35e518fe-dcd2-47b7-9cb2-cae5068ea6ff tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28614 microversion: 2.20 time: 0.084593 Aug 25 05:33:10.022051 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 177/332] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:09 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28614 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 25 05:33:10.085729 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-61765e00-cbff-4845-97f7-55b6ef2def44 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28602 microversion: 2.1 time: 0.080982 Aug 25 05:33:10.086391 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 156/333] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:10 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28602 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:33:10.753208 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f51d5688-7c1c-4498-a56d-9cc05b208d33 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:10.754250 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f51d5688-7c1c-4498-a56d-9cc05b208d33 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] [instance: a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:10.763388 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f51d5688-7c1c-4498-a56d-9cc05b208d33 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:10.764143 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f51d5688-7c1c-4498-a56d-9cc05b208d33 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:10.765085 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f51d5688-7c1c-4498-a56d-9cc05b208d33 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:10.765992 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f51d5688-7c1c-4498-a56d-9cc05b208d33 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:10.790363 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.wsgi [None req-f51d5688-7c1c-4498-a56d-9cc05b208d33 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] HTTP exception thrown: Instance a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c could not be found. Aug 25 05:33:10.791563 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f51d5688-7c1c-4498-a56d-9cc05b208d33 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] Returning 404 to user: Instance a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c could not be found. {{(pid=108885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 05:33:10.793105 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f51d5688-7c1c-4498-a56d-9cc05b208d33 tempest-VolumesNegativeTest-1842769380 tempest-VolumesNegativeTest-1842769380-project] 10.222.0.42 "GET /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c" status: 404 len: 111 microversion: 2.1 time: 0.047096 Aug 25 05:33:10.794188 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 178/334] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:10 2021] GET /compute/v2.1/servers/a00cf6f8-c7fb-4b99-98da-1f4b6e81c98c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:33:11.035195 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5b9bb6e1-5b6c-42e4-a007-00599c2794de tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:11.036224 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5b9bb6e1-5b6c-42e4-a007-00599c2794de tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:11.045379 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5b9bb6e1-5b6c-42e4-a007-00599c2794de tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:11.046011 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5b9bb6e1-5b6c-42e4-a007-00599c2794de tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:11.047987 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5b9bb6e1-5b6c-42e4-a007-00599c2794de tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:11.047987 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5b9bb6e1-5b6c-42e4-a007-00599c2794de tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:11.102662 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-8fb7940b-cd0e-46ac-b277-01a01e0463f3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:11.102662 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-8fb7940b-cd0e-46ac-b277-01a01e0463f3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:11.109853 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8fb7940b-cd0e-46ac-b277-01a01e0463f3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:11.110565 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8fb7940b-cd0e-46ac-b277-01a01e0463f3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:11.111712 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8fb7940b-cd0e-46ac-b277-01a01e0463f3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:11.112223 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8fb7940b-cd0e-46ac-b277-01a01e0463f3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:11.132087 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5b9bb6e1-5b6c-42e4-a007-00599c2794de tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28614 microversion: 2.20 time: 0.101580 Aug 25 05:33:11.132815 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 157/335] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:11 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28614 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 25 05:33:11.188972 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-8fb7940b-cd0e-46ac-b277-01a01e0463f3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28602 microversion: 2.1 time: 0.092173 Aug 25 05:33:11.192980 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 179/336] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:11 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28602 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:33:11.403694 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-76a2d55b-870d-449c-8f08-ce63e8f96c94 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:11.405307 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-76a2d55b-870d-449c-8f08-ce63e8f96c94 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:11.415414 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-76a2d55b-870d-449c-8f08-ce63e8f96c94 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:11.416310 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-76a2d55b-870d-449c-8f08-ce63e8f96c94 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:11.417499 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-76a2d55b-870d-449c-8f08-ce63e8f96c94 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:11.418188 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-76a2d55b-870d-449c-8f08-ce63e8f96c94 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:11.465501 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.objects.instance [None req-76a2d55b-870d-449c-8f08-ce63e8f96c94 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lazy-loading 'flavor' on Instance uuid 2163e566-1832-40df-8925-09e54ae2974c {{(pid=108884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 05:33:11.506064 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9d12d625-312d-495e-b47d-62345aaf3f96 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1081544888", "imageRef": "05da2439-78f2-405c-b60a-89671b21a373", "flavorRef": "452", "networks": [{"uuid": "f95d7096-591e-4d19-be73-e1e513e5e2b6"}]}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:11.771654 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.network.neutron [None req-9d12d625-312d-495e-b47d-62345aaf3f96 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] validate_networks() for [('f95d7096-591e-4d19-be73-e1e513e5e2b6', None, None, None, None, None)] {{(pid=108885) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 25 05:33:11.907297 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-76a2d55b-870d-449c-8f08-ce63e8f96c94 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "POST /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c/action" status: 200 len: 32 microversion: 2.1 time: 0.512067 Aug 25 05:33:11.910538 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 158/337] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:11 2021] POST /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c/action => generated 32 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 25 05:33:11.917809 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3dbd0030-2b95-447d-a435-5c96095fc335 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:11.918596 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3dbd0030-2b95-447d-a435-5c96095fc335 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:11.925039 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3dbd0030-2b95-447d-a435-5c96095fc335 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:11.925776 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3dbd0030-2b95-447d-a435-5c96095fc335 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:11.926766 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3dbd0030-2b95-447d-a435-5c96095fc335 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:11.927202 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3dbd0030-2b95-447d-a435-5c96095fc335 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:12.259555 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-3dbd0030-2b95-447d-a435-5c96095fc335 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:12.261187 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3dbd0030-2b95-447d-a435-5c96095fc335 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1567 microversion: 2.1 time: 0.347587 Aug 25 05:33:12.279524 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 159/338] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:11 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1567 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:33:12.287740 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b21f71db-98fb-435b-8b2b-89e3b3c3d41e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:12.289018 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b21f71db-98fb-435b-8b2b-89e3b3c3d41e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:12.293487 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-9d12d625-312d-495e-b47d-62345aaf3f96 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Flavor limits 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 05:33:12.293960 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-9d12d625-312d-495e-b47d-62345aaf3f96 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Image limits 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 05:33:12.296007 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-9d12d625-312d-495e-b47d-62345aaf3f96 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Flavor pref 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 05:33:12.296007 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-9d12d625-312d-495e-b47d-62345aaf3f96 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Image pref 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 05:33:12.296007 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-9d12d625-312d-495e-b47d-62345aaf3f96 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 05:33:12.296747 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b21f71db-98fb-435b-8b2b-89e3b3c3d41e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:12.297262 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b21f71db-98fb-435b-8b2b-89e3b3c3d41e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:12.298149 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b21f71db-98fb-435b-8b2b-89e3b3c3d41e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:12.299326 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b21f71db-98fb-435b-8b2b-89e3b3c3d41e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:12.305510 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9d12d625-312d-495e-b47d-62345aaf3f96 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:12.306000 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9d12d625-312d-495e-b47d-62345aaf3f96 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:12.306957 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9d12d625-312d-495e-b47d-62345aaf3f96 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:12.307383 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9d12d625-312d-495e-b47d-62345aaf3f96 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:12.349237 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.quota [None req-9d12d625-312d-495e-b47d-62345aaf3f96 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Getting quotas for project 376eee360a8940d998c21a88309ac903. Resources: {'ram', 'cores', 'instances'} {{(pid=108885) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 05:33:12.354725 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.quota [None req-9d12d625-312d-495e-b47d-62345aaf3f96 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Getting quotas for user a9ae7c08cdf04609a1ba446d0960a7ff and project 376eee360a8940d998c21a88309ac903. Resources: {'ram', 'cores', 'instances'} {{(pid=108885) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 05:33:12.374531 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9d12d625-312d-495e-b47d-62345aaf3f96 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Going to run 1 instances... {{(pid=108885) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 25 05:33:12.377535 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9d12d625-312d-495e-b47d-62345aaf3f96 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: 3f45744c-63f5-4685-bf64-56a5b1669e7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05da2439-78f2-405c-b60a-89671b21a373',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 25 05:33:12.407531 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b21f71db-98fb-435b-8b2b-89e3b3c3d41e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28614 microversion: 2.20 time: 0.125661 Aug 25 05:33:12.410773 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 160/339] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:12 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28614 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:33:12.419346 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-f8914bc1-2168-435c-b40b-2dc205bf97ec tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:12.420358 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-f8914bc1-2168-435c-b40b-2dc205bf97ec tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:12.427989 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f8914bc1-2168-435c-b40b-2dc205bf97ec tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:12.428444 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f8914bc1-2168-435c-b40b-2dc205bf97ec tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:12.429222 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f8914bc1-2168-435c-b40b-2dc205bf97ec tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:12.429919 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f8914bc1-2168-435c-b40b-2dc205bf97ec tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:12.515062 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-f8914bc1-2168-435c-b40b-2dc205bf97ec tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28602 microversion: 2.1 time: 0.102526 Aug 25 05:33:12.515632 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 161/340] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:12 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28602 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:33:12.596860 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9d12d625-312d-495e-b47d-62345aaf3f96 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.097362 Aug 25 05:33:12.605130 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 180/341] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 25 05:33:11 2021] POST /compute/v2.1/servers => generated 380 bytes in 1107 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 05:33:12.617395 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b346917e-9693-4fb8-a5c8-63208777818e tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:12.618136 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b346917e-9693-4fb8-a5c8-63208777818e tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: 3f45744c-63f5-4685-bf64-56a5b1669e7c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:12.684773 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-b346917e-9693-4fb8-a5c8-63208777818e tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:12.698510 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b346917e-9693-4fb8-a5c8-63208777818e tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c" status: 200 len: 1214 microversion: 2.1 time: 0.091840 Aug 25 05:33:12.706584 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 162/342] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:12 2021] GET /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c => generated 1214 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:33:13.286928 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5baf8a54-b75a-40a1-b6b1-0569589cab9c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:13.288145 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5baf8a54-b75a-40a1-b6b1-0569589cab9c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:13.298007 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5baf8a54-b75a-40a1-b6b1-0569589cab9c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:13.298007 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5baf8a54-b75a-40a1-b6b1-0569589cab9c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:13.298862 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5baf8a54-b75a-40a1-b6b1-0569589cab9c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:13.299173 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5baf8a54-b75a-40a1-b6b1-0569589cab9c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:13.424901 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-239bab4b-8497-4f05-8c77-c2d7b7a8fa71 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:13.426734 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-239bab4b-8497-4f05-8c77-c2d7b7a8fa71 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:13.436297 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-239bab4b-8497-4f05-8c77-c2d7b7a8fa71 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:13.436811 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-239bab4b-8497-4f05-8c77-c2d7b7a8fa71 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:13.437948 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-239bab4b-8497-4f05-8c77-c2d7b7a8fa71 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:13.439093 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-239bab4b-8497-4f05-8c77-c2d7b7a8fa71 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:13.448695 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-5baf8a54-b75a-40a1-b6b1-0569589cab9c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:13.466380 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5baf8a54-b75a-40a1-b6b1-0569589cab9c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1567 microversion: 2.1 time: 0.185713 Aug 25 05:33:13.471702 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 181/343] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:13 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1567 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:13.526881 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c17e742d-6073-4140-9694-b0078cbfe646 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:13.528000 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c17e742d-6073-4140-9694-b0078cbfe646 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:13.534059 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c17e742d-6073-4140-9694-b0078cbfe646 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:13.534526 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c17e742d-6073-4140-9694-b0078cbfe646 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:13.535292 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c17e742d-6073-4140-9694-b0078cbfe646 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:13.535722 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c17e742d-6073-4140-9694-b0078cbfe646 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:13.542279 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-239bab4b-8497-4f05-8c77-c2d7b7a8fa71 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28614 microversion: 2.20 time: 0.121974 Aug 25 05:33:13.545594 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 163/344] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:13 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28614 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 25 05:33:13.620315 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c17e742d-6073-4140-9694-b0078cbfe646 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28602 microversion: 2.1 time: 0.096739 Aug 25 05:33:13.621428 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 182/345] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:13 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28602 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:33:13.718316 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c8260e54-8a37-4c88-9ce2-bc3ec73f9a21 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:13.718991 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c8260e54-8a37-4c88-9ce2-bc3ec73f9a21 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: 3f45744c-63f5-4685-bf64-56a5b1669e7c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:13.780372 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-c8260e54-8a37-4c88-9ce2-bc3ec73f9a21 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:13.787286 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c8260e54-8a37-4c88-9ce2-bc3ec73f9a21 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c" status: 200 len: 1214 microversion: 2.1 time: 0.073426 Aug 25 05:33:13.788060 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 164/346] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:13 2021] GET /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:14.494138 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9cfbd131-853f-4bcf-a721-157282476fed tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:14.494905 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9cfbd131-853f-4bcf-a721-157282476fed tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:14.506172 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9cfbd131-853f-4bcf-a721-157282476fed tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:14.506623 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9cfbd131-853f-4bcf-a721-157282476fed tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:14.507452 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9cfbd131-853f-4bcf-a721-157282476fed tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:14.508915 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9cfbd131-853f-4bcf-a721-157282476fed tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:14.555497 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-f3bf16a8-a97e-41d7-998f-11c3cc6544e1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:14.557596 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-f3bf16a8-a97e-41d7-998f-11c3cc6544e1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:14.572731 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f3bf16a8-a97e-41d7-998f-11c3cc6544e1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:14.585743 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f3bf16a8-a97e-41d7-998f-11c3cc6544e1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:14.586763 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f3bf16a8-a97e-41d7-998f-11c3cc6544e1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:14.587937 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f3bf16a8-a97e-41d7-998f-11c3cc6544e1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:14.667685 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-f3bf16a8-a97e-41d7-998f-11c3cc6544e1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28614 microversion: 2.20 time: 0.116622 Aug 25 05:33:14.671708 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 165/347] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:14 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28614 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 25 05:33:14.675462 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-50aae2b8-e8f9-4e24-9770-17b344031bf7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:14.676712 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-50aae2b8-e8f9-4e24-9770-17b344031bf7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:14.683450 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-50aae2b8-e8f9-4e24-9770-17b344031bf7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:14.683890 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-50aae2b8-e8f9-4e24-9770-17b344031bf7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:14.684664 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-50aae2b8-e8f9-4e24-9770-17b344031bf7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:14.685228 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-50aae2b8-e8f9-4e24-9770-17b344031bf7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:14.700201 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-9cfbd131-853f-4bcf-a721-157282476fed tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:14.712958 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9cfbd131-853f-4bcf-a721-157282476fed tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1567 microversion: 2.1 time: 0.223292 Aug 25 05:33:14.715695 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 183/348] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:14 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1567 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:14.778529 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-50aae2b8-e8f9-4e24-9770-17b344031bf7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28602 microversion: 2.1 time: 0.107810 Aug 25 05:33:14.779332 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 166/349] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:14 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28602 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:33:14.805049 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5621a097-85b5-4fb1-8421-b25f1a483848 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:14.805711 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5621a097-85b5-4fb1-8421-b25f1a483848 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: 3f45744c-63f5-4685-bf64-56a5b1669e7c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:14.815451 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5621a097-85b5-4fb1-8421-b25f1a483848 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:14.816181 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5621a097-85b5-4fb1-8421-b25f1a483848 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:14.817458 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5621a097-85b5-4fb1-8421-b25f1a483848 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:14.818066 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5621a097-85b5-4fb1-8421-b25f1a483848 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:14.915895 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-5621a097-85b5-4fb1-8421-b25f1a483848 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:14.925513 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5621a097-85b5-4fb1-8421-b25f1a483848 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c" status: 200 len: 1210 microversion: 2.1 time: 0.124008 Aug 25 05:33:14.926471 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 184/350] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:14 2021] GET /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c => generated 1210 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:15.684985 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-738d2435-3aa3-4c18-a1ea-7c74a6320906 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:15.685865 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-738d2435-3aa3-4c18-a1ea-7c74a6320906 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:15.697751 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-738d2435-3aa3-4c18-a1ea-7c74a6320906 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:15.698204 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-738d2435-3aa3-4c18-a1ea-7c74a6320906 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:15.698992 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-738d2435-3aa3-4c18-a1ea-7c74a6320906 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:15.699613 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-738d2435-3aa3-4c18-a1ea-7c74a6320906 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:15.732114 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-058d20e4-8295-4d74-a218-eb7abe47a938 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:15.732720 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-058d20e4-8295-4d74-a218-eb7abe47a938 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:15.739424 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-058d20e4-8295-4d74-a218-eb7abe47a938 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:15.745195 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-058d20e4-8295-4d74-a218-eb7abe47a938 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:15.745195 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-058d20e4-8295-4d74-a218-eb7abe47a938 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:15.745195 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-058d20e4-8295-4d74-a218-eb7abe47a938 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:15.778636 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-738d2435-3aa3-4c18-a1ea-7c74a6320906 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28614 microversion: 2.20 time: 0.100369 Aug 25 05:33:15.779368 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 167/351] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:15 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28614 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:33:15.796757 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8559617c-2915-4a46-808e-c135a8c876ae tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:15.797911 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8559617c-2915-4a46-808e-c135a8c876ae tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:15.811016 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8559617c-2915-4a46-808e-c135a8c876ae tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:15.811485 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8559617c-2915-4a46-808e-c135a8c876ae tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:15.812284 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8559617c-2915-4a46-808e-c135a8c876ae tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:15.812729 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8559617c-2915-4a46-808e-c135a8c876ae tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:15.905090 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8559617c-2915-4a46-808e-c135a8c876ae tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28602 microversion: 2.1 time: 0.116501 Aug 25 05:33:15.906991 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 168/352] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:15 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28602 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:33:15.943595 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-53056d25-72b8-4b84-af60-91ade4f692df tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:15.944319 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-53056d25-72b8-4b84-af60-91ade4f692df tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: 3f45744c-63f5-4685-bf64-56a5b1669e7c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:15.950769 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-53056d25-72b8-4b84-af60-91ade4f692df tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:15.951220 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-53056d25-72b8-4b84-af60-91ade4f692df tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:15.951995 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-53056d25-72b8-4b84-af60-91ade4f692df tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:15.952427 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-53056d25-72b8-4b84-af60-91ade4f692df tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:15.979895 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-058d20e4-8295-4d74-a218-eb7abe47a938 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:15.988966 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-058d20e4-8295-4d74-a218-eb7abe47a938 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1567 microversion: 2.1 time: 0.260698 Aug 25 05:33:15.989564 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 185/353] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:15 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1567 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:33:16.030732 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-53056d25-72b8-4b84-af60-91ade4f692df tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:16.050042 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-53056d25-72b8-4b84-af60-91ade4f692df tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c" status: 200 len: 1274 microversion: 2.1 time: 0.109126 Aug 25 05:33:16.050042 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 169/354] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:15 2021] GET /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c => generated 1274 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:33:16.791863 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1883fc57-70ce-4979-b311-f14484d2b8d1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:16.798767 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1883fc57-70ce-4979-b311-f14484d2b8d1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:16.806235 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1883fc57-70ce-4979-b311-f14484d2b8d1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:16.806893 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1883fc57-70ce-4979-b311-f14484d2b8d1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:16.808188 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1883fc57-70ce-4979-b311-f14484d2b8d1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:16.809045 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1883fc57-70ce-4979-b311-f14484d2b8d1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:16.892974 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1883fc57-70ce-4979-b311-f14484d2b8d1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28614 microversion: 2.20 time: 0.104869 Aug 25 05:33:16.893957 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 186/355] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:16 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28614 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:33:16.917772 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c6c59022-d8fe-48a3-b849-08ac7fa971d4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:16.919091 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c6c59022-d8fe-48a3-b849-08ac7fa971d4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:16.929822 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c6c59022-d8fe-48a3-b849-08ac7fa971d4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:16.929822 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c6c59022-d8fe-48a3-b849-08ac7fa971d4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:16.929822 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c6c59022-d8fe-48a3-b849-08ac7fa971d4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:16.929822 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c6c59022-d8fe-48a3-b849-08ac7fa971d4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:17.010760 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5f7b5ba3-0600-4c8b-beb6-6d951fb366ec tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:17.011441 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5f7b5ba3-0600-4c8b-beb6-6d951fb366ec tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:17.018541 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5f7b5ba3-0600-4c8b-beb6-6d951fb366ec tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:17.018984 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5f7b5ba3-0600-4c8b-beb6-6d951fb366ec tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:17.019771 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5f7b5ba3-0600-4c8b-beb6-6d951fb366ec tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:17.020197 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5f7b5ba3-0600-4c8b-beb6-6d951fb366ec tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:17.074120 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c6c59022-d8fe-48a3-b849-08ac7fa971d4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28602 microversion: 2.1 time: 0.159809 Aug 25 05:33:17.087288 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 170/356] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:16 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28602 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:33:17.090439 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-f9cbcce9-92b2-4ec0-99a6-aeb2b57880cd tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:17.091436 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-f9cbcce9-92b2-4ec0-99a6-aeb2b57880cd tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: 3f45744c-63f5-4685-bf64-56a5b1669e7c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:17.104524 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f9cbcce9-92b2-4ec0-99a6-aeb2b57880cd tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:17.105788 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f9cbcce9-92b2-4ec0-99a6-aeb2b57880cd tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:17.108035 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f9cbcce9-92b2-4ec0-99a6-aeb2b57880cd tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:17.108821 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f9cbcce9-92b2-4ec0-99a6-aeb2b57880cd tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:17.334879 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-5f7b5ba3-0600-4c8b-beb6-6d951fb366ec tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:17.346388 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5f7b5ba3-0600-4c8b-beb6-6d951fb366ec tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1567 microversion: 2.1 time: 0.339799 Aug 25 05:33:17.349434 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 187/357] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:17 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1567 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:17.353873 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-f9cbcce9-92b2-4ec0-99a6-aeb2b57880cd tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:17.364766 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-f9cbcce9-92b2-4ec0-99a6-aeb2b57880cd tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c" status: 200 len: 1314 microversion: 2.1 time: 0.284033 Aug 25 05:33:17.365824 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 171/358] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:17 2021] GET /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:17.911318 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ab6827ce-957d-4214-ba73-56f0514b659e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:17.916109 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ab6827ce-957d-4214-ba73-56f0514b659e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:17.923699 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ab6827ce-957d-4214-ba73-56f0514b659e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:17.924540 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ab6827ce-957d-4214-ba73-56f0514b659e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:17.926219 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ab6827ce-957d-4214-ba73-56f0514b659e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:17.926974 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ab6827ce-957d-4214-ba73-56f0514b659e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:17.953108 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [req-a117150f-ca68-4252-97b8-9243976a1593 req-7e6b7bfb-09cb-495e-a998-4e3852f5ad90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f45744c-63f5-4685-bf64-56a5b1669e7c", "tag": "f5fd84a6-3d22-4ddc-aebe-935207ca11d4"}]} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:17.956268 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:33:17.956268 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: warnings.warn(msg) Aug 25 05:33:17.964695 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-a117150f-ca68-4252-97b8-9243976a1593 req-7e6b7bfb-09cb-495e-a998-4e3852f5ad90 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:17.965427 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-a117150f-ca68-4252-97b8-9243976a1593 req-7e6b7bfb-09cb-495e-a998-4e3852f5ad90 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:17.978314 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.compute.server_external_events [req-a117150f-ca68-4252-97b8-9243976a1593 req-7e6b7bfb-09cb-495e-a998-4e3852f5ad90 service nova] Creating event network-changed:f5fd84a6-3d22-4ddc-aebe-935207ca11d4 for instance 3f45744c-63f5-4685-bf64-56a5b1669e7c on hv-cinder-78662 Aug 25 05:33:17.984890 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [req-a117150f-ca68-4252-97b8-9243976a1593 req-7e6b7bfb-09cb-495e-a998-4e3852f5ad90 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039318 Aug 25 05:33:17.986562 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 172/359] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:33:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:33:18.035115 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ab6827ce-957d-4214-ba73-56f0514b659e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28614 microversion: 2.20 time: 0.132635 Aug 25 05:33:18.035774 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 188/360] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:17 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28614 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:33:18.098732 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-805f56fb-908d-480d-bbae-aeceaaf02eb1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:18.099953 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-805f56fb-908d-480d-bbae-aeceaaf02eb1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:18.106621 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-805f56fb-908d-480d-bbae-aeceaaf02eb1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:18.107080 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-805f56fb-908d-480d-bbae-aeceaaf02eb1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:18.107862 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-805f56fb-908d-480d-bbae-aeceaaf02eb1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:18.108478 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-805f56fb-908d-480d-bbae-aeceaaf02eb1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:18.178728 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-805f56fb-908d-480d-bbae-aeceaaf02eb1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28602 microversion: 2.1 time: 0.085148 Aug 25 05:33:18.180987 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 173/361] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:18 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28602 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:33:18.372003 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a72f1239-ef06-48a0-8909-125d43a9d985 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:18.372960 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a72f1239-ef06-48a0-8909-125d43a9d985 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:18.384209 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a72f1239-ef06-48a0-8909-125d43a9d985 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:18.384866 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a72f1239-ef06-48a0-8909-125d43a9d985 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:18.386387 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a72f1239-ef06-48a0-8909-125d43a9d985 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:18.386999 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a72f1239-ef06-48a0-8909-125d43a9d985 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:18.398227 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e1a852cb-06bb-4522-a6ea-42fa17120246 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:18.399023 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e1a852cb-06bb-4522-a6ea-42fa17120246 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: 3f45744c-63f5-4685-bf64-56a5b1669e7c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:18.414106 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e1a852cb-06bb-4522-a6ea-42fa17120246 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:18.416492 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e1a852cb-06bb-4522-a6ea-42fa17120246 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:18.417485 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e1a852cb-06bb-4522-a6ea-42fa17120246 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:18.418001 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e1a852cb-06bb-4522-a6ea-42fa17120246 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:18.780205 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e1a852cb-06bb-4522-a6ea-42fa17120246 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:18.787684 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e1a852cb-06bb-4522-a6ea-42fa17120246 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c" status: 200 len: 1314 microversion: 2.1 time: 0.394849 Aug 25 05:33:18.788263 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 174/362] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:18 2021] GET /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:18.795893 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-a72f1239-ef06-48a0-8909-125d43a9d985 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:18.815668 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a72f1239-ef06-48a0-8909-125d43a9d985 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1567 microversion: 2.1 time: 0.448592 Aug 25 05:33:18.818515 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 189/363] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:18 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1567 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:19.048008 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-781b6a4f-993f-4b1a-9cf4-305e609ff16a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:19.049121 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-781b6a4f-993f-4b1a-9cf4-305e609ff16a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:19.055940 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-781b6a4f-993f-4b1a-9cf4-305e609ff16a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:19.056718 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-781b6a4f-993f-4b1a-9cf4-305e609ff16a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:19.057707 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-781b6a4f-993f-4b1a-9cf4-305e609ff16a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:19.061072 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-781b6a4f-993f-4b1a-9cf4-305e609ff16a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:19.212357 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1d9141d0-2424-4e08-bf84-ba70fa7f23be tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:19.213285 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1d9141d0-2424-4e08-bf84-ba70fa7f23be tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:19.219193 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1d9141d0-2424-4e08-bf84-ba70fa7f23be tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:19.220200 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1d9141d0-2424-4e08-bf84-ba70fa7f23be tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:19.221074 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1d9141d0-2424-4e08-bf84-ba70fa7f23be tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:19.221509 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1d9141d0-2424-4e08-bf84-ba70fa7f23be tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:19.602345 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1d9141d0-2424-4e08-bf84-ba70fa7f23be tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28602 microversion: 2.1 time: 0.393562 Aug 25 05:33:19.603467 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 190/364] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:19 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28602 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:33:19.607289 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-781b6a4f-993f-4b1a-9cf4-305e609ff16a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28614 microversion: 2.20 time: 0.560833 Aug 25 05:33:19.607289 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 175/365] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:19 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28614 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:33:19.805247 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-bbcba316-1214-4bfb-a6b4-13810a202d74 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:19.806220 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-bbcba316-1214-4bfb-a6b4-13810a202d74 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: 3f45744c-63f5-4685-bf64-56a5b1669e7c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:19.812771 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bbcba316-1214-4bfb-a6b4-13810a202d74 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:19.813496 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bbcba316-1214-4bfb-a6b4-13810a202d74 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:19.814508 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bbcba316-1214-4bfb-a6b4-13810a202d74 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:19.815013 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bbcba316-1214-4bfb-a6b4-13810a202d74 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:19.835708 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-95468184-86fc-4bac-84fb-98bf099f90df tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:19.836392 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-95468184-86fc-4bac-84fb-98bf099f90df tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:19.843708 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-95468184-86fc-4bac-84fb-98bf099f90df tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:19.844153 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-95468184-86fc-4bac-84fb-98bf099f90df tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:19.845096 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-95468184-86fc-4bac-84fb-98bf099f90df tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:19.845559 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-95468184-86fc-4bac-84fb-98bf099f90df tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:20.097966 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-bbcba316-1214-4bfb-a6b4-13810a202d74 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:20.106335 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-95468184-86fc-4bac-84fb-98bf099f90df tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:20.108161 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-bbcba316-1214-4bfb-a6b4-13810a202d74 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c" status: 200 len: 1314 microversion: 2.1 time: 0.306902 Aug 25 05:33:20.109109 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 176/366] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:19 2021] GET /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:20.118389 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-95468184-86fc-4bac-84fb-98bf099f90df tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1567 microversion: 2.1 time: 0.286572 Aug 25 05:33:20.119287 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 191/367] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:19 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1567 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:33:20.619625 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-589e1603-c61e-49dd-86cf-0d788c1409e2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:20.620834 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a14da319-aa0d-4e2e-9a1d-b6602694ac3b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:20.622031 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-589e1603-c61e-49dd-86cf-0d788c1409e2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:20.622734 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a14da319-aa0d-4e2e-9a1d-b6602694ac3b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:20.631349 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-589e1603-c61e-49dd-86cf-0d788c1409e2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:20.631659 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a14da319-aa0d-4e2e-9a1d-b6602694ac3b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:20.631983 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-589e1603-c61e-49dd-86cf-0d788c1409e2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:20.632118 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a14da319-aa0d-4e2e-9a1d-b6602694ac3b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:20.632873 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a14da319-aa0d-4e2e-9a1d-b6602694ac3b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:20.632992 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-589e1603-c61e-49dd-86cf-0d788c1409e2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:20.633330 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a14da319-aa0d-4e2e-9a1d-b6602694ac3b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:20.633488 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-589e1603-c61e-49dd-86cf-0d788c1409e2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:20.847721 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-589e1603-c61e-49dd-86cf-0d788c1409e2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28602 microversion: 2.1 time: 0.236304 Aug 25 05:33:20.848584 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 177/368] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:20 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28602 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:33:20.854366 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a14da319-aa0d-4e2e-9a1d-b6602694ac3b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28614 microversion: 2.20 time: 0.241636 Aug 25 05:33:20.858195 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 192/369] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:20 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28614 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:33:21.139418 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b11f4ebf-434d-4304-b0ca-c007fd4fd79c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:21.140119 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b11f4ebf-434d-4304-b0ca-c007fd4fd79c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:21.143119 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ef76421f-b627-4a20-b8ba-80e46effca60 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:21.144010 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ef76421f-b627-4a20-b8ba-80e46effca60 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: 3f45744c-63f5-4685-bf64-56a5b1669e7c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:21.147418 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b11f4ebf-434d-4304-b0ca-c007fd4fd79c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:21.151248 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b11f4ebf-434d-4304-b0ca-c007fd4fd79c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:21.151248 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b11f4ebf-434d-4304-b0ca-c007fd4fd79c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:21.151248 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b11f4ebf-434d-4304-b0ca-c007fd4fd79c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:21.152031 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ef76421f-b627-4a20-b8ba-80e46effca60 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:21.152635 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ef76421f-b627-4a20-b8ba-80e46effca60 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:21.153717 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ef76421f-b627-4a20-b8ba-80e46effca60 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:21.154208 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ef76421f-b627-4a20-b8ba-80e46effca60 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:21.344526 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-b11f4ebf-434d-4304-b0ca-c007fd4fd79c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:21.353800 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b11f4ebf-434d-4304-b0ca-c007fd4fd79c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1567 microversion: 2.1 time: 0.219980 Aug 25 05:33:21.354961 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 178/370] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:21 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1567 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:21.359333 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ef76421f-b627-4a20-b8ba-80e46effca60 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:21.368689 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ef76421f-b627-4a20-b8ba-80e46effca60 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c" status: 200 len: 1314 microversion: 2.1 time: 0.232347 Aug 25 05:33:21.369588 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 193/371] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:21 2021] GET /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:21.859790 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-57ddfef7-e0d0-4da9-a0f6-242708c3d8d2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:21.861953 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-57ddfef7-e0d0-4da9-a0f6-242708c3d8d2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:21.867552 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-eed6add3-fa51-48ff-967d-1851e7dcf4a4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:21.868461 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-eed6add3-fa51-48ff-967d-1851e7dcf4a4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:21.869820 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-57ddfef7-e0d0-4da9-a0f6-242708c3d8d2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:21.870276 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-57ddfef7-e0d0-4da9-a0f6-242708c3d8d2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:21.871074 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-57ddfef7-e0d0-4da9-a0f6-242708c3d8d2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:21.871631 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-57ddfef7-e0d0-4da9-a0f6-242708c3d8d2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:21.876030 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-eed6add3-fa51-48ff-967d-1851e7dcf4a4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:21.877035 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-eed6add3-fa51-48ff-967d-1851e7dcf4a4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:21.877867 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-eed6add3-fa51-48ff-967d-1851e7dcf4a4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:21.878301 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-eed6add3-fa51-48ff-967d-1851e7dcf4a4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:21.964818 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-eed6add3-fa51-48ff-967d-1851e7dcf4a4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28614 microversion: 2.20 time: 0.100767 Aug 25 05:33:21.965802 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 194/372] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:21 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28614 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 25 05:33:21.974407 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-57ddfef7-e0d0-4da9-a0f6-242708c3d8d2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28602 microversion: 2.1 time: 0.118090 Aug 25 05:33:21.975690 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 179/373] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:21 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28602 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:33:22.372906 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d84c6c62-c091-46c4-acd3-b944a8c8f603 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:22.373816 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d84c6c62-c091-46c4-acd3-b944a8c8f603 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:22.382672 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d84c6c62-c091-46c4-acd3-b944a8c8f603 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:22.388315 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d84c6c62-c091-46c4-acd3-b944a8c8f603 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:22.388315 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d84c6c62-c091-46c4-acd3-b944a8c8f603 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:22.388315 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d84c6c62-c091-46c4-acd3-b944a8c8f603 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:22.392793 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-37c30b5f-2982-4225-ad70-2f4dabcc55a2 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:22.393629 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-37c30b5f-2982-4225-ad70-2f4dabcc55a2 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: 3f45744c-63f5-4685-bf64-56a5b1669e7c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:22.400534 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-37c30b5f-2982-4225-ad70-2f4dabcc55a2 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:22.401068 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-37c30b5f-2982-4225-ad70-2f4dabcc55a2 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:22.402461 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-37c30b5f-2982-4225-ad70-2f4dabcc55a2 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:22.402739 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-37c30b5f-2982-4225-ad70-2f4dabcc55a2 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:22.593349 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d84c6c62-c091-46c4-acd3-b944a8c8f603 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:22.596917 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-37c30b5f-2982-4225-ad70-2f4dabcc55a2 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:22.602296 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d84c6c62-c091-46c4-acd3-b944a8c8f603 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1567 microversion: 2.1 time: 0.234696 Aug 25 05:33:22.602921 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 195/374] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:22 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1567 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:22.605192 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-37c30b5f-2982-4225-ad70-2f4dabcc55a2 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c" status: 200 len: 1314 microversion: 2.1 time: 0.217584 Aug 25 05:33:22.605870 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 180/375] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:22 2021] GET /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:33:22.978445 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-44f877d8-f779-4b2d-8441-67b3c7e64292 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:22.979385 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-44f877d8-f779-4b2d-8441-67b3c7e64292 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:22.988229 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3f46e201-1c26-44d9-8862-32f625860db6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:22.989195 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3f46e201-1c26-44d9-8862-32f625860db6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:22.990545 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-44f877d8-f779-4b2d-8441-67b3c7e64292 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:22.991007 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-44f877d8-f779-4b2d-8441-67b3c7e64292 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:22.991839 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-44f877d8-f779-4b2d-8441-67b3c7e64292 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:22.992384 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-44f877d8-f779-4b2d-8441-67b3c7e64292 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:22.996538 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3f46e201-1c26-44d9-8862-32f625860db6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:23.001819 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3f46e201-1c26-44d9-8862-32f625860db6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:23.001819 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3f46e201-1c26-44d9-8862-32f625860db6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:23.001819 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3f46e201-1c26-44d9-8862-32f625860db6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:23.126294 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3f46e201-1c26-44d9-8862-32f625860db6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28602 microversion: 2.1 time: 0.139551 Aug 25 05:33:23.126294 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 181/376] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:22 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28602 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:33:23.126488 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-44f877d8-f779-4b2d-8441-67b3c7e64292 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28614 microversion: 2.20 time: 0.150679 Aug 25 05:33:23.126690 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 196/377] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:22 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28614 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:33:23.621819 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-753bdb19-271f-4f89-9bc7-88d5349a59e3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:23.622586 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-753bdb19-271f-4f89-9bc7-88d5349a59e3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:23.623626 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f4621bac-c184-4719-96bf-1f492b89224c tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:23.624486 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f4621bac-c184-4719-96bf-1f492b89224c tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: 3f45744c-63f5-4685-bf64-56a5b1669e7c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:23.629860 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-753bdb19-271f-4f89-9bc7-88d5349a59e3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:23.630312 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-753bdb19-271f-4f89-9bc7-88d5349a59e3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:23.631178 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-753bdb19-271f-4f89-9bc7-88d5349a59e3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:23.631620 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-753bdb19-271f-4f89-9bc7-88d5349a59e3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:23.632753 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f4621bac-c184-4719-96bf-1f492b89224c tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:23.633492 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f4621bac-c184-4719-96bf-1f492b89224c tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:23.634467 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f4621bac-c184-4719-96bf-1f492b89224c tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:23.635496 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f4621bac-c184-4719-96bf-1f492b89224c tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:23.830710 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-753bdb19-271f-4f89-9bc7-88d5349a59e3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:23.836221 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-f4621bac-c184-4719-96bf-1f492b89224c tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:23.842620 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-753bdb19-271f-4f89-9bc7-88d5349a59e3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1567 microversion: 2.1 time: 0.225254 Aug 25 05:33:23.843281 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 182/378] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:23 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1567 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:23.846262 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f4621bac-c184-4719-96bf-1f492b89224c tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c" status: 200 len: 1314 microversion: 2.1 time: 0.227337 Aug 25 05:33:23.846917 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 197/379] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:23 2021] GET /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:33:24.149765 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5db87911-84f8-4bc4-90dc-e5d7f13237ae tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:24.151369 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-87015b10-c514-4730-9e66-21cc718cd06d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:24.152700 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5db87911-84f8-4bc4-90dc-e5d7f13237ae tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:24.162140 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-87015b10-c514-4730-9e66-21cc718cd06d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:24.167640 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5db87911-84f8-4bc4-90dc-e5d7f13237ae tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:24.168619 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5db87911-84f8-4bc4-90dc-e5d7f13237ae tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:24.170272 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5db87911-84f8-4bc4-90dc-e5d7f13237ae tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:24.171365 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5db87911-84f8-4bc4-90dc-e5d7f13237ae tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:24.174277 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-87015b10-c514-4730-9e66-21cc718cd06d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:24.175024 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-87015b10-c514-4730-9e66-21cc718cd06d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:24.176367 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-87015b10-c514-4730-9e66-21cc718cd06d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:24.177082 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-87015b10-c514-4730-9e66-21cc718cd06d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:24.287684 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5db87911-84f8-4bc4-90dc-e5d7f13237ae tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28602 microversion: 2.1 time: 0.152664 Aug 25 05:33:24.288329 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 198/380] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:24 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:33:24.294775 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-87015b10-c514-4730-9e66-21cc718cd06d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28614 microversion: 2.20 time: 0.159801 Aug 25 05:33:24.295712 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 183/381] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:24 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28614 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:33:24.861366 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5b032c1b-0199-4373-82d3-e368ed2ef458 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:24.862024 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5b032c1b-0199-4373-82d3-e368ed2ef458 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:24.867593 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ba38c5a4-2ca5-46e9-a967-25378ee76b8c tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:24.868286 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ba38c5a4-2ca5-46e9-a967-25378ee76b8c tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: 3f45744c-63f5-4685-bf64-56a5b1669e7c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:24.869480 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5b032c1b-0199-4373-82d3-e368ed2ef458 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:24.870093 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5b032c1b-0199-4373-82d3-e368ed2ef458 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:24.870877 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5b032c1b-0199-4373-82d3-e368ed2ef458 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:24.871316 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5b032c1b-0199-4373-82d3-e368ed2ef458 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:24.874640 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ba38c5a4-2ca5-46e9-a967-25378ee76b8c tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:24.876262 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ba38c5a4-2ca5-46e9-a967-25378ee76b8c tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:24.876262 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ba38c5a4-2ca5-46e9-a967-25378ee76b8c tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:24.876496 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ba38c5a4-2ca5-46e9-a967-25378ee76b8c tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:25.068165 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ba38c5a4-2ca5-46e9-a967-25378ee76b8c tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:25.074472 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-5b032c1b-0199-4373-82d3-e368ed2ef458 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:25.078116 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ba38c5a4-2ca5-46e9-a967-25378ee76b8c tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c" status: 200 len: 1314 microversion: 2.1 time: 0.216172 Aug 25 05:33:25.079720 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 184/382] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:24 2021] GET /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:25.095982 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5b032c1b-0199-4373-82d3-e368ed2ef458 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1567 microversion: 2.1 time: 0.239232 Aug 25 05:33:25.096729 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 199/383] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:24 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1567 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:33:25.311174 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-264c2db3-bb30-4f2d-b4b1-b7003f9cdcf9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:25.311952 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-0c452dcf-d4fa-4a53-9db3-51976c39d1ca tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:25.312042 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-264c2db3-bb30-4f2d-b4b1-b7003f9cdcf9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:25.312130 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-0c452dcf-d4fa-4a53-9db3-51976c39d1ca tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:25.316533 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-264c2db3-bb30-4f2d-b4b1-b7003f9cdcf9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:25.317329 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-264c2db3-bb30-4f2d-b4b1-b7003f9cdcf9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:25.318236 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-264c2db3-bb30-4f2d-b4b1-b7003f9cdcf9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:25.318893 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-264c2db3-bb30-4f2d-b4b1-b7003f9cdcf9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:25.319882 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0c452dcf-d4fa-4a53-9db3-51976c39d1ca tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:25.320393 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0c452dcf-d4fa-4a53-9db3-51976c39d1ca tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:25.325149 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0c452dcf-d4fa-4a53-9db3-51976c39d1ca tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:25.325149 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0c452dcf-d4fa-4a53-9db3-51976c39d1ca tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:25.396344 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-0c452dcf-d4fa-4a53-9db3-51976c39d1ca tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28602 microversion: 2.1 time: 0.095369 Aug 25 05:33:25.401405 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 185/384] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:25 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28602 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:33:25.402438 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-264c2db3-bb30-4f2d-b4b1-b7003f9cdcf9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28614 microversion: 2.20 time: 0.098515 Aug 25 05:33:25.402948 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8ec695ce-8f44-41db-a195-709c782f8bd2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1811714032", "imageRef": "05da2439-78f2-405c-b60a-89671b21a373", "flavorRef": "452", "networks": [{"uuid": "b295481c-f024-44d2-a980-479481e2cd4a"}]}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:25.403193 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 200/385] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:25 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28614 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:33:25.464553 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.network.neutron [None req-8ec695ce-8f44-41db-a195-709c782f8bd2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] validate_networks() for [('b295481c-f024-44d2-a980-479481e2cd4a', None, None, None, None, None)] {{(pid=108884) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 25 05:33:25.874819 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-8ec695ce-8f44-41db-a195-709c782f8bd2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Flavor limits 0:0:0 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 05:33:25.875491 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-8ec695ce-8f44-41db-a195-709c782f8bd2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Image limits 0:0:0 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 05:33:25.875985 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-8ec695ce-8f44-41db-a195-709c782f8bd2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Flavor pref 0:0:0 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 05:33:25.877331 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-8ec695ce-8f44-41db-a195-709c782f8bd2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Image pref 0:0:0 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 05:33:25.877785 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-8ec695ce-8f44-41db-a195-709c782f8bd2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 05:33:25.887927 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8ec695ce-8f44-41db-a195-709c782f8bd2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:25.888371 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8ec695ce-8f44-41db-a195-709c782f8bd2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:25.889255 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8ec695ce-8f44-41db-a195-709c782f8bd2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:25.889739 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8ec695ce-8f44-41db-a195-709c782f8bd2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:25.910410 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.quota [None req-8ec695ce-8f44-41db-a195-709c782f8bd2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Getting quotas for project bbccb403957943839b2b9f0171b88d1e. Resources: {'ram', 'cores', 'instances'} {{(pid=108884) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 05:33:25.914835 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.quota [None req-8ec695ce-8f44-41db-a195-709c782f8bd2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Getting quotas for user 1248e051ab404b4faeb147e4d373166c and project bbccb403957943839b2b9f0171b88d1e. Resources: {'ram', 'cores', 'instances'} {{(pid=108884) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 05:33:25.927868 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8ec695ce-8f44-41db-a195-709c782f8bd2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Going to run 1 instances... {{(pid=108884) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 25 05:33:25.932334 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8ec695ce-8f44-41db-a195-709c782f8bd2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 92dd15ea-adff-40f8-86b3-3333f26586d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05da2439-78f2-405c-b60a-89671b21a373',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 25 05:33:26.056794 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8ec695ce-8f44-41db-a195-709c782f8bd2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.658274 Aug 25 05:33:26.057630 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 186/386] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 25 05:33:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 05:33:26.072490 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1dde18aa-c78a-4f96-869e-dcb9ca024478 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:26.078696 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1dde18aa-c78a-4f96-869e-dcb9ca024478 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 92dd15ea-adff-40f8-86b3-3333f26586d5] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:26.098638 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7d87100b-9d84-4de6-b2e6-12e4a39dcefb tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:26.099453 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7d87100b-9d84-4de6-b2e6-12e4a39dcefb tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: 3f45744c-63f5-4685-bf64-56a5b1669e7c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:26.108282 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7d87100b-9d84-4de6-b2e6-12e4a39dcefb tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:26.108991 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7d87100b-9d84-4de6-b2e6-12e4a39dcefb tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:26.110685 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7d87100b-9d84-4de6-b2e6-12e4a39dcefb tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:26.111602 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7d87100b-9d84-4de6-b2e6-12e4a39dcefb tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:26.175782 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-1dde18aa-c78a-4f96-869e-dcb9ca024478 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:26.188121 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1dde18aa-c78a-4f96-869e-dcb9ca024478 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5" status: 200 len: 1219 microversion: 2.1 time: 0.120858 Aug 25 05:33:26.189703 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 201/387] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:26 2021] GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5 => generated 1219 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:26.198376 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2f9b14fc-7a25-41be-a71b-17c4f1b03f47 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:26.198914 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2f9b14fc-7a25-41be-a71b-17c4f1b03f47 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:26.208010 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2f9b14fc-7a25-41be-a71b-17c4f1b03f47 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:26.208965 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2f9b14fc-7a25-41be-a71b-17c4f1b03f47 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:26.210378 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2f9b14fc-7a25-41be-a71b-17c4f1b03f47 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:26.210960 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2f9b14fc-7a25-41be-a71b-17c4f1b03f47 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:26.525852 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-7d87100b-9d84-4de6-b2e6-12e4a39dcefb tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:26.534766 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7d87100b-9d84-4de6-b2e6-12e4a39dcefb tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c" status: 200 len: 1314 microversion: 2.1 time: 0.441778 Aug 25 05:33:26.535439 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 187/388] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:26 2021] GET /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c => generated 1314 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:26.542528 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-4c893058-6530-4453-8acd-de3992385428 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:26.543965 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-4c893058-6530-4453-8acd-de3992385428 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:26.557854 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4c893058-6530-4453-8acd-de3992385428 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:26.558432 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4c893058-6530-4453-8acd-de3992385428 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:26.559316 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4c893058-6530-4453-8acd-de3992385428 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:26.559915 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4c893058-6530-4453-8acd-de3992385428 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:26.598864 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-2f9b14fc-7a25-41be-a71b-17c4f1b03f47 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:26.607476 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2f9b14fc-7a25-41be-a71b-17c4f1b03f47 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1567 microversion: 2.1 time: 0.416185 Aug 25 05:33:26.608038 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 202/389] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:26 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1567 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:26.612573 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-3d0dafc7-c9f1-4fd1-8cc0-09f1539138cf tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:26.613464 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-3d0dafc7-c9f1-4fd1-8cc0-09f1539138cf tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:26.620139 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3d0dafc7-c9f1-4fd1-8cc0-09f1539138cf tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:26.620599 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3d0dafc7-c9f1-4fd1-8cc0-09f1539138cf tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:26.621396 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3d0dafc7-c9f1-4fd1-8cc0-09f1539138cf tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:26.621870 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3d0dafc7-c9f1-4fd1-8cc0-09f1539138cf tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:26.624471 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-4c893058-6530-4453-8acd-de3992385428 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28602 microversion: 2.1 time: 0.086986 Aug 25 05:33:26.625222 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 188/390] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:26 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28602 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:33:26.689257 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-3d0dafc7-c9f1-4fd1-8cc0-09f1539138cf tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28614 microversion: 2.20 time: 0.079016 Aug 25 05:33:26.689257 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 203/391] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:26 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28614 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:33:27.207754 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ec743869-9544-490e-90cc-e5393151f137 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:27.208485 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ec743869-9544-490e-90cc-e5393151f137 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 92dd15ea-adff-40f8-86b3-3333f26586d5] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:27.215617 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ec743869-9544-490e-90cc-e5393151f137 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:27.216059 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ec743869-9544-490e-90cc-e5393151f137 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:27.216818 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ec743869-9544-490e-90cc-e5393151f137 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:27.217247 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ec743869-9544-490e-90cc-e5393151f137 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:27.283341 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ec743869-9544-490e-90cc-e5393151f137 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:27.296675 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ec743869-9544-490e-90cc-e5393151f137 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5" status: 200 len: 1223 microversion: 2.1 time: 0.093614 Aug 25 05:33:27.301637 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 189/392] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:27 2021] GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5 => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:27.554842 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ae6d9933-d807-4b7f-9169-bd17cb2ed75b tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:27.555525 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ae6d9933-d807-4b7f-9169-bd17cb2ed75b tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: 3f45744c-63f5-4685-bf64-56a5b1669e7c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:27.562186 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ae6d9933-d807-4b7f-9169-bd17cb2ed75b tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:27.562683 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ae6d9933-d807-4b7f-9169-bd17cb2ed75b tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:27.568703 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ae6d9933-d807-4b7f-9169-bd17cb2ed75b tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:27.568703 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ae6d9933-d807-4b7f-9169-bd17cb2ed75b tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:27.625189 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b49ccee4-9ffc-40aa-bbc4-d4748e032fa4 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:27.625862 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b49ccee4-9ffc-40aa-bbc4-d4748e032fa4 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:27.632384 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b49ccee4-9ffc-40aa-bbc4-d4748e032fa4 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:27.632841 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b49ccee4-9ffc-40aa-bbc4-d4748e032fa4 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:27.633694 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b49ccee4-9ffc-40aa-bbc4-d4748e032fa4 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:27.634379 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b49ccee4-9ffc-40aa-bbc4-d4748e032fa4 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:27.730095 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ae6d9933-d807-4b7f-9169-bd17cb2ed75b tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:27.739253 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ae6d9933-d807-4b7f-9169-bd17cb2ed75b tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c" status: 200 len: 1314 microversion: 2.1 time: 0.188505 Aug 25 05:33:27.749323 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 204/393] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:27 2021] GET /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:27.755546 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-504c3d42-72d2-4edb-a9b2-314e3fa7d5b3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:27.756462 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-504c3d42-72d2-4edb-a9b2-314e3fa7d5b3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:27.763498 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-504c3d42-72d2-4edb-a9b2-314e3fa7d5b3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:27.763903 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-504c3d42-72d2-4edb-a9b2-314e3fa7d5b3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:27.776241 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-504c3d42-72d2-4edb-a9b2-314e3fa7d5b3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:27.777150 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-504c3d42-72d2-4edb-a9b2-314e3fa7d5b3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:27.802285 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-b49ccee4-9ffc-40aa-bbc4-d4748e032fa4 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:27.810800 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b49ccee4-9ffc-40aa-bbc4-d4748e032fa4 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1567 microversion: 2.1 time: 0.189530 Aug 25 05:33:27.813695 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 190/394] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:27 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1567 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:27.817330 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8c1fbe6f-e063-4ea4-aac7-43beadd101ad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:27.818471 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8c1fbe6f-e063-4ea4-aac7-43beadd101ad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:27.824839 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8c1fbe6f-e063-4ea4-aac7-43beadd101ad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:27.825388 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8c1fbe6f-e063-4ea4-aac7-43beadd101ad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:27.826268 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8c1fbe6f-e063-4ea4-aac7-43beadd101ad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:27.826711 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8c1fbe6f-e063-4ea4-aac7-43beadd101ad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:27.858798 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-504c3d42-72d2-4edb-a9b2-314e3fa7d5b3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28602 microversion: 2.1 time: 0.107529 Aug 25 05:33:27.864007 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 205/395] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:27 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28602 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:33:27.914902 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8c1fbe6f-e063-4ea4-aac7-43beadd101ad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28614 microversion: 2.20 time: 0.101938 Aug 25 05:33:27.915590 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 191/396] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:27 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28614 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:33:28.316685 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a79fc53c-6c54-4c1a-b84e-376d82b22465 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:28.318184 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a79fc53c-6c54-4c1a-b84e-376d82b22465 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 92dd15ea-adff-40f8-86b3-3333f26586d5] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:28.327545 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a79fc53c-6c54-4c1a-b84e-376d82b22465 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:28.331427 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a79fc53c-6c54-4c1a-b84e-376d82b22465 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:28.331427 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a79fc53c-6c54-4c1a-b84e-376d82b22465 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:28.331427 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a79fc53c-6c54-4c1a-b84e-376d82b22465 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:28.407600 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-a79fc53c-6c54-4c1a-b84e-376d82b22465 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:28.415175 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a79fc53c-6c54-4c1a-b84e-376d82b22465 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5" status: 200 len: 1271 microversion: 2.1 time: 0.103483 Aug 25 05:33:28.416095 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 206/397] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:28 2021] GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5 => generated 1271 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:33:28.461362 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [req-a1f51b91-80e1-425e-9358-1e8f2c8a6c14 req-f837fb06-84db-4036-9397-2ad19e8bd2c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f45744c-63f5-4685-bf64-56a5b1669e7c", "name": "network-vif-plugged", "status": "completed", "tag": "f5fd84a6-3d22-4ddc-aebe-935207ca11d4"}]} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:28.464576 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:33:28.464576 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: warnings.warn(msg) Aug 25 05:33:28.474586 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-a1f51b91-80e1-425e-9358-1e8f2c8a6c14 req-f837fb06-84db-4036-9397-2ad19e8bd2c4 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:28.475202 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-a1f51b91-80e1-425e-9358-1e8f2c8a6c14 req-f837fb06-84db-4036-9397-2ad19e8bd2c4 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:28.492586 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.compute.server_external_events [req-a1f51b91-80e1-425e-9358-1e8f2c8a6c14 req-f837fb06-84db-4036-9397-2ad19e8bd2c4 service nova] Creating event network-vif-plugged:f5fd84a6-3d22-4ddc-aebe-935207ca11d4 for instance 3f45744c-63f5-4685-bf64-56a5b1669e7c on hv-cinder-78662 Aug 25 05:33:28.497458 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [req-a1f51b91-80e1-425e-9358-1e8f2c8a6c14 req-f837fb06-84db-4036-9397-2ad19e8bd2c4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041947 Aug 25 05:33:28.498487 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 192/398] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:33:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:33:28.756650 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-819db70c-7c15-4401-ad28-44c177dc15eb tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:28.758101 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-819db70c-7c15-4401-ad28-44c177dc15eb tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: 3f45744c-63f5-4685-bf64-56a5b1669e7c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:28.764960 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-819db70c-7c15-4401-ad28-44c177dc15eb tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:28.765724 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-819db70c-7c15-4401-ad28-44c177dc15eb tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:28.766705 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-819db70c-7c15-4401-ad28-44c177dc15eb tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:28.767302 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-819db70c-7c15-4401-ad28-44c177dc15eb tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:28.828875 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-94e550e8-0290-4c07-b777-dc1118188cfc tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:28.829494 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-94e550e8-0290-4c07-b777-dc1118188cfc tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:28.837330 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-94e550e8-0290-4c07-b777-dc1118188cfc tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:28.837822 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-94e550e8-0290-4c07-b777-dc1118188cfc tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:28.838607 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-94e550e8-0290-4c07-b777-dc1118188cfc tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:28.839156 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-94e550e8-0290-4c07-b777-dc1118188cfc tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:29.003673 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-819db70c-7c15-4401-ad28-44c177dc15eb tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:29.025151 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-819db70c-7c15-4401-ad28-44c177dc15eb tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c" status: 200 len: 1314 microversion: 2.1 time: 0.270325 Aug 25 05:33:29.037496 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 207/399] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:28 2021] GET /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:29.041167 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-94e550e8-0290-4c07-b777-dc1118188cfc tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:29.052744 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-94e550e8-0290-4c07-b777-dc1118188cfc tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1567 microversion: 2.1 time: 0.228204 Aug 25 05:33:29.053794 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 193/400] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:28 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1567 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:29.056326 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a403a723-7630-4293-855e-30ffa064f3cb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:29.058626 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a63ea368-fdd6-4254-99a7-d8a2830d5a36 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:29.058852 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a403a723-7630-4293-855e-30ffa064f3cb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:29.059705 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a63ea368-fdd6-4254-99a7-d8a2830d5a36 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:29.067546 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a63ea368-fdd6-4254-99a7-d8a2830d5a36 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:29.068094 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a63ea368-fdd6-4254-99a7-d8a2830d5a36 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:29.068276 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a403a723-7630-4293-855e-30ffa064f3cb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:29.068991 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a63ea368-fdd6-4254-99a7-d8a2830d5a36 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:29.069872 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a403a723-7630-4293-855e-30ffa064f3cb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:29.070005 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a63ea368-fdd6-4254-99a7-d8a2830d5a36 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:29.071197 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a403a723-7630-4293-855e-30ffa064f3cb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:29.071644 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a403a723-7630-4293-855e-30ffa064f3cb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:29.316083 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a63ea368-fdd6-4254-99a7-d8a2830d5a36 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28614 microversion: 2.20 time: 0.260828 Aug 25 05:33:29.321033 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 194/401] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:29 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28614 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:33:29.321227 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a403a723-7630-4293-855e-30ffa064f3cb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28602 microversion: 2.1 time: 0.280205 Aug 25 05:33:29.321227 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 208/402] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:29 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28602 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:33:29.435841 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-fd58a80a-68cf-40e6-a518-660568553dd2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:29.436683 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-fd58a80a-68cf-40e6-a518-660568553dd2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 92dd15ea-adff-40f8-86b3-3333f26586d5] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:29.444217 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fd58a80a-68cf-40e6-a518-660568553dd2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:29.444697 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fd58a80a-68cf-40e6-a518-660568553dd2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:29.445479 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fd58a80a-68cf-40e6-a518-660568553dd2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:29.445959 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fd58a80a-68cf-40e6-a518-660568553dd2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:29.527209 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-fd58a80a-68cf-40e6-a518-660568553dd2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:29.541668 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-fd58a80a-68cf-40e6-a518-660568553dd2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5" status: 200 len: 1277 microversion: 2.1 time: 0.110882 Aug 25 05:33:29.546649 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 195/403] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:29 2021] GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5 => generated 1277 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:30.047562 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9e3c8384-2753-4f86-95ab-6913c9ac52d6 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:30.048321 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9e3c8384-2753-4f86-95ab-6913c9ac52d6 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: 3f45744c-63f5-4685-bf64-56a5b1669e7c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:30.056658 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9e3c8384-2753-4f86-95ab-6913c9ac52d6 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:30.057635 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9e3c8384-2753-4f86-95ab-6913c9ac52d6 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:30.058612 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9e3c8384-2753-4f86-95ab-6913c9ac52d6 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:30.059193 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9e3c8384-2753-4f86-95ab-6913c9ac52d6 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:30.071977 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-cd6498bf-d63a-4cbb-a0d5-b529e58e7d2f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:30.072918 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-cd6498bf-d63a-4cbb-a0d5-b529e58e7d2f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:30.092790 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cd6498bf-d63a-4cbb-a0d5-b529e58e7d2f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:30.093393 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cd6498bf-d63a-4cbb-a0d5-b529e58e7d2f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:30.094610 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cd6498bf-d63a-4cbb-a0d5-b529e58e7d2f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:30.095344 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cd6498bf-d63a-4cbb-a0d5-b529e58e7d2f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:30.374086 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-9e3c8384-2753-4f86-95ab-6913c9ac52d6 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:30.382103 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9e3c8384-2753-4f86-95ab-6913c9ac52d6 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c" status: 200 len: 1314 microversion: 2.1 time: 0.341133 Aug 25 05:33:30.382865 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 209/404] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:30 2021] GET /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:30.388877 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-15b2160c-afe7-4e60-aecf-a2e6520bdae3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:30.390700 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-15b2160c-afe7-4e60-aecf-a2e6520bdae3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:30.399420 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-15b2160c-afe7-4e60-aecf-a2e6520bdae3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:30.400200 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-15b2160c-afe7-4e60-aecf-a2e6520bdae3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:30.401337 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-15b2160c-afe7-4e60-aecf-a2e6520bdae3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:30.401805 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-15b2160c-afe7-4e60-aecf-a2e6520bdae3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:30.414049 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-cd6498bf-d63a-4cbb-a0d5-b529e58e7d2f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:30.422182 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-cd6498bf-d63a-4cbb-a0d5-b529e58e7d2f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1567 microversion: 2.1 time: 0.355069 Aug 25 05:33:30.422757 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 196/405] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:30 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1567 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:30.427242 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d27e35ce-2494-45f3-8148-ef8105edd171 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:30.428159 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-d27e35ce-2494-45f3-8148-ef8105edd171 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:30.442561 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d27e35ce-2494-45f3-8148-ef8105edd171 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:30.443014 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d27e35ce-2494-45f3-8148-ef8105edd171 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:30.443797 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d27e35ce-2494-45f3-8148-ef8105edd171 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:30.444438 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d27e35ce-2494-45f3-8148-ef8105edd171 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:30.502208 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-15b2160c-afe7-4e60-aecf-a2e6520bdae3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28614 microversion: 2.20 time: 0.117589 Aug 25 05:33:30.504211 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 210/406] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:30 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28614 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:33:30.522893 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d27e35ce-2494-45f3-8148-ef8105edd171 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28602 microversion: 2.1 time: 0.098855 Aug 25 05:33:30.524248 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 197/407] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:30 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28602 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:33:30.564461 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c119d3a5-2c13-4321-8a04-25379e5240e9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:30.565781 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c119d3a5-2c13-4321-8a04-25379e5240e9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 92dd15ea-adff-40f8-86b3-3333f26586d5] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:30.575210 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c119d3a5-2c13-4321-8a04-25379e5240e9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:30.575915 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c119d3a5-2c13-4321-8a04-25379e5240e9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:30.577259 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c119d3a5-2c13-4321-8a04-25379e5240e9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:30.578023 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c119d3a5-2c13-4321-8a04-25379e5240e9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:30.722829 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-c119d3a5-2c13-4321-8a04-25379e5240e9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:30.730254 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c119d3a5-2c13-4321-8a04-25379e5240e9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5" status: 200 len: 1319 microversion: 2.1 time: 0.169792 Aug 25 05:33:30.730832 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 211/408] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:30 2021] GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:30.905421 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [req-fa3266a8-8f9d-43c0-a4e9-d6647a1ad5ad req-c10d1374-047c-4f82-8e57-71fd4e783b81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92dd15ea-adff-40f8-86b3-3333f26586d5", "tag": "ead2fa26-3920-4558-83c9-db855966516e"}]} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:30.906981 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:33:30.906981 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: warnings.warn(msg) Aug 25 05:33:30.915066 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-fa3266a8-8f9d-43c0-a4e9-d6647a1ad5ad req-c10d1374-047c-4f82-8e57-71fd4e783b81 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:30.915525 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-fa3266a8-8f9d-43c0-a4e9-d6647a1ad5ad req-c10d1374-047c-4f82-8e57-71fd4e783b81 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:30.930113 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.compute.server_external_events [req-fa3266a8-8f9d-43c0-a4e9-d6647a1ad5ad req-c10d1374-047c-4f82-8e57-71fd4e783b81 service nova] Creating event network-changed:ead2fa26-3920-4558-83c9-db855966516e for instance 92dd15ea-adff-40f8-86b3-3333f26586d5 on hv-cinder-78662 Aug 25 05:33:30.935221 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [req-fa3266a8-8f9d-43c0-a4e9-d6647a1ad5ad req-c10d1374-047c-4f82-8e57-71fd4e783b81 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034501 Aug 25 05:33:30.935837 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 198/409] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:33:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:33:31.402025 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-173f3606-f583-49fa-87df-796d416427ee tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:31.402824 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-173f3606-f583-49fa-87df-796d416427ee tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: 3f45744c-63f5-4685-bf64-56a5b1669e7c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:31.410021 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-173f3606-f583-49fa-87df-796d416427ee tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:31.410473 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-173f3606-f583-49fa-87df-796d416427ee tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:31.411261 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-173f3606-f583-49fa-87df-796d416427ee tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:31.411749 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-173f3606-f583-49fa-87df-796d416427ee tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:31.446693 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-583b2446-fc08-4a91-aaee-b11b6a3aefc1 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:31.447633 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-583b2446-fc08-4a91-aaee-b11b6a3aefc1 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:31.459650 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-583b2446-fc08-4a91-aaee-b11b6a3aefc1 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:31.462189 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-583b2446-fc08-4a91-aaee-b11b6a3aefc1 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:31.462189 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-583b2446-fc08-4a91-aaee-b11b6a3aefc1 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:31.462189 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-583b2446-fc08-4a91-aaee-b11b6a3aefc1 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:31.573309 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-173f3606-f583-49fa-87df-796d416427ee tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:31.583907 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-173f3606-f583-49fa-87df-796d416427ee tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c" status: 200 len: 1498 microversion: 2.1 time: 0.186168 Aug 25 05:33:31.588354 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 212/410] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:31 2021] GET /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c => generated 1498 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:31.589963 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c6074559-18ac-47cb-9218-cacb4ff69ed9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:31.593669 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c6074559-18ac-47cb-9218-cacb4ff69ed9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:31.602423 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c6074559-18ac-47cb-9218-cacb4ff69ed9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:31.602582 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c6074559-18ac-47cb-9218-cacb4ff69ed9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:31.603397 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c6074559-18ac-47cb-9218-cacb4ff69ed9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:31.603837 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c6074559-18ac-47cb-9218-cacb4ff69ed9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:31.647812 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-583b2446-fc08-4a91-aaee-b11b6a3aefc1 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:31.655697 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-583b2446-fc08-4a91-aaee-b11b6a3aefc1 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1567 microversion: 2.1 time: 0.213295 Aug 25 05:33:31.656270 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 199/411] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:31 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1567 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:33:31.660810 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-84c507d2-d3f1-4db3-b509-4771f1193021 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:31.661760 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-84c507d2-d3f1-4db3-b509-4771f1193021 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:31.668102 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-84c507d2-d3f1-4db3-b509-4771f1193021 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:31.668551 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-84c507d2-d3f1-4db3-b509-4771f1193021 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:31.669325 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-84c507d2-d3f1-4db3-b509-4771f1193021 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:31.669812 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-84c507d2-d3f1-4db3-b509-4771f1193021 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:31.683360 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c6074559-18ac-47cb-9218-cacb4ff69ed9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28614 microversion: 2.20 time: 0.097408 Aug 25 05:33:31.687845 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 213/412] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:31 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28614 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:33:31.747049 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-84c507d2-d3f1-4db3-b509-4771f1193021 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28602 microversion: 2.1 time: 0.089520 Aug 25 05:33:31.747700 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 200/413] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:31 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28602 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:33:31.749125 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-06f747e8-2264-4961-bf3e-07d3654c37fd tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:31.749946 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-06f747e8-2264-4961-bf3e-07d3654c37fd tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 92dd15ea-adff-40f8-86b3-3333f26586d5] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:31.757722 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-06f747e8-2264-4961-bf3e-07d3654c37fd tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:31.758176 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-06f747e8-2264-4961-bf3e-07d3654c37fd tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:31.759051 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-06f747e8-2264-4961-bf3e-07d3654c37fd tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:31.759530 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-06f747e8-2264-4961-bf3e-07d3654c37fd tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:31.907295 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-06f747e8-2264-4961-bf3e-07d3654c37fd tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:31.914969 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-06f747e8-2264-4961-bf3e-07d3654c37fd tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5" status: 200 len: 1319 microversion: 2.1 time: 0.169883 Aug 25 05:33:31.915533 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 214/414] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:31 2021] GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:33:32.673143 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-79e9050b-981a-444d-9933-7fc0235115e3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:32.674174 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-79e9050b-981a-444d-9933-7fc0235115e3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:32.682661 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-79e9050b-981a-444d-9933-7fc0235115e3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:32.683247 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-79e9050b-981a-444d-9933-7fc0235115e3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:32.684043 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-79e9050b-981a-444d-9933-7fc0235115e3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:32.684487 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-79e9050b-981a-444d-9933-7fc0235115e3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:32.695693 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a35bb6e8-35cf-4d5e-bba5-8c848dc79f07 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:32.696658 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a35bb6e8-35cf-4d5e-bba5-8c848dc79f07 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:32.702752 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a35bb6e8-35cf-4d5e-bba5-8c848dc79f07 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:32.703198 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a35bb6e8-35cf-4d5e-bba5-8c848dc79f07 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:32.703968 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a35bb6e8-35cf-4d5e-bba5-8c848dc79f07 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:32.704421 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a35bb6e8-35cf-4d5e-bba5-8c848dc79f07 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:32.783249 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a35bb6e8-35cf-4d5e-bba5-8c848dc79f07 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28614 microversion: 2.20 time: 0.090944 Aug 25 05:33:32.784498 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 215/415] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:32 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28614 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:33:32.789897 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-263e1af1-b2d4-4058-8a76-27bc1554fcc6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:32.791157 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-263e1af1-b2d4-4058-8a76-27bc1554fcc6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:32.798869 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-263e1af1-b2d4-4058-8a76-27bc1554fcc6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:32.799509 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-263e1af1-b2d4-4058-8a76-27bc1554fcc6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:32.800550 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-263e1af1-b2d4-4058-8a76-27bc1554fcc6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:32.801140 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-263e1af1-b2d4-4058-8a76-27bc1554fcc6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:32.863948 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-79e9050b-981a-444d-9933-7fc0235115e3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:32.869831 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-263e1af1-b2d4-4058-8a76-27bc1554fcc6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28602 microversion: 2.1 time: 0.083749 Aug 25 05:33:32.870482 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 216/416] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:32 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28602 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:33:32.873144 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-79e9050b-981a-444d-9933-7fc0235115e3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1567 microversion: 2.1 time: 0.204204 Aug 25 05:33:32.874146 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 201/417] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:32 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1567 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:32.875887 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b405f22e-31bd-40d2-a60f-107674cb5bc2 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:32.876470 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b405f22e-31bd-40d2-a60f-107674cb5bc2 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: 3f45744c-63f5-4685-bf64-56a5b1669e7c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:32.887104 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b405f22e-31bd-40d2-a60f-107674cb5bc2 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:32.889669 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b405f22e-31bd-40d2-a60f-107674cb5bc2 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:32.890721 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b405f22e-31bd-40d2-a60f-107674cb5bc2 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:32.891164 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b405f22e-31bd-40d2-a60f-107674cb5bc2 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:32.921024 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b405f22e-31bd-40d2-a60f-107674cb5bc2 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: 3f45744c-63f5-4685-bf64-56a5b1669e7c] Going to try to terminate instance {{(pid=108885) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 25 05:33:32.932157 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-774c80b1-5260-4d11-95ba-984d2d54ecf1 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:32.932793 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-774c80b1-5260-4d11-95ba-984d2d54ecf1 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 92dd15ea-adff-40f8-86b3-3333f26586d5] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:32.939247 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-774c80b1-5260-4d11-95ba-984d2d54ecf1 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:32.939693 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-774c80b1-5260-4d11-95ba-984d2d54ecf1 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:32.940480 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-774c80b1-5260-4d11-95ba-984d2d54ecf1 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:32.941609 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-774c80b1-5260-4d11-95ba-984d2d54ecf1 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:33.071937 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-774c80b1-5260-4d11-95ba-984d2d54ecf1 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:33.079807 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-774c80b1-5260-4d11-95ba-984d2d54ecf1 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5" status: 200 len: 1319 microversion: 2.1 time: 0.151470 Aug 25 05:33:33.080393 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 202/418] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:32 2021] GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:33:33.321490 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b405f22e-31bd-40d2-a60f-107674cb5bc2 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c" status: 204 len: 0 microversion: 2.1 time: 0.449385 Aug 25 05:33:33.322270 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 217/419] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 25 05:33:32 2021] DELETE /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 05:33:33.330277 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-4953b72c-c417-40b7-a30c-d8ca84e44381 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:33.330893 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-4953b72c-c417-40b7-a30c-d8ca84e44381 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: 3f45744c-63f5-4685-bf64-56a5b1669e7c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:33.338481 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4953b72c-c417-40b7-a30c-d8ca84e44381 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:33.338995 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4953b72c-c417-40b7-a30c-d8ca84e44381 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:33.339974 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4953b72c-c417-40b7-a30c-d8ca84e44381 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:33.340639 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4953b72c-c417-40b7-a30c-d8ca84e44381 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:33.476404 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-4953b72c-c417-40b7-a30c-d8ca84e44381 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:33.485388 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-4953b72c-c417-40b7-a30c-d8ca84e44381 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c" status: 200 len: 1504 microversion: 2.1 time: 0.158798 Aug 25 05:33:33.486078 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 203/420] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:33 2021] GET /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:33.797882 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-023365f4-861e-47cf-8195-4e4548200441 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:33.798976 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-023365f4-861e-47cf-8195-4e4548200441 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:33.805890 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-023365f4-861e-47cf-8195-4e4548200441 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:33.806337 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-023365f4-861e-47cf-8195-4e4548200441 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:33.811206 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-023365f4-861e-47cf-8195-4e4548200441 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:33.811206 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-023365f4-861e-47cf-8195-4e4548200441 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:33.884073 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-91bcf52f-e209-45ee-8329-5d1718cf54cb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:33.884557 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-023365f4-861e-47cf-8195-4e4548200441 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28614 microversion: 2.20 time: 0.090323 Aug 25 05:33:33.885096 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-91bcf52f-e209-45ee-8329-5d1718cf54cb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:33.890400 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 218/421] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:33 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28614 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:33:33.892533 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-91bcf52f-e209-45ee-8329-5d1718cf54cb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:33.892978 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-91bcf52f-e209-45ee-8329-5d1718cf54cb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:33.893790 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-91bcf52f-e209-45ee-8329-5d1718cf54cb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:33.894226 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-91bcf52f-e209-45ee-8329-5d1718cf54cb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:33.895559 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-27d21e50-f8cf-435f-a65f-f793b181fabf tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:33.896617 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-27d21e50-f8cf-435f-a65f-f793b181fabf tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:33.903472 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-27d21e50-f8cf-435f-a65f-f793b181fabf tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:33.903955 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-27d21e50-f8cf-435f-a65f-f793b181fabf tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:33.904721 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-27d21e50-f8cf-435f-a65f-f793b181fabf tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:33.905163 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-27d21e50-f8cf-435f-a65f-f793b181fabf tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:33.975779 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-91bcf52f-e209-45ee-8329-5d1718cf54cb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28602 microversion: 2.1 time: 0.097112 Aug 25 05:33:33.981443 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 204/422] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:33 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28602 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:33:34.057599 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-27d21e50-f8cf-435f-a65f-f793b181fabf tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:34.065696 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-27d21e50-f8cf-435f-a65f-f793b181fabf tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1567 microversion: 2.1 time: 0.174032 Aug 25 05:33:34.066343 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 219/423] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:33 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:34.097488 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-2f787487-a329-4dc0-b800-e578e98a38ee tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:34.098202 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-2f787487-a329-4dc0-b800-e578e98a38ee tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 92dd15ea-adff-40f8-86b3-3333f26586d5] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:34.104922 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2f787487-a329-4dc0-b800-e578e98a38ee tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:34.105363 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2f787487-a329-4dc0-b800-e578e98a38ee tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:34.106218 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2f787487-a329-4dc0-b800-e578e98a38ee tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:34.106645 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2f787487-a329-4dc0-b800-e578e98a38ee tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:34.244928 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-2f787487-a329-4dc0-b800-e578e98a38ee tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:34.252507 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-2f787487-a329-4dc0-b800-e578e98a38ee tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5" status: 200 len: 1319 microversion: 2.1 time: 0.159162 Aug 25 05:33:34.253082 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 205/424] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:34 2021] GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:34.503473 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ba80f04e-e1c5-47e0-b084-3180326bd4b6 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:34.503991 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ba80f04e-e1c5-47e0-b084-3180326bd4b6 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: 3f45744c-63f5-4685-bf64-56a5b1669e7c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:34.510883 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ba80f04e-e1c5-47e0-b084-3180326bd4b6 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:34.511321 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ba80f04e-e1c5-47e0-b084-3180326bd4b6 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:34.512326 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ba80f04e-e1c5-47e0-b084-3180326bd4b6 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:34.512872 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ba80f04e-e1c5-47e0-b084-3180326bd4b6 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:34.660541 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ba80f04e-e1c5-47e0-b084-3180326bd4b6 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:34.668966 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ba80f04e-e1c5-47e0-b084-3180326bd4b6 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c" status: 200 len: 1504 microversion: 2.1 time: 0.169216 Aug 25 05:33:34.669546 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 220/425] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:34 2021] GET /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:34.904885 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-711d6a3a-84a4-4b0c-9031-fd2029dd56f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:34.905964 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-711d6a3a-84a4-4b0c-9031-fd2029dd56f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:34.912191 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-711d6a3a-84a4-4b0c-9031-fd2029dd56f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:34.912661 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-711d6a3a-84a4-4b0c-9031-fd2029dd56f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:34.913445 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-711d6a3a-84a4-4b0c-9031-fd2029dd56f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:34.913995 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-711d6a3a-84a4-4b0c-9031-fd2029dd56f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:34.989195 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c5f0ac80-a6a8-4343-8bf2-51fca0964fb9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:34.990348 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c5f0ac80-a6a8-4343-8bf2-51fca0964fb9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:34.996632 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c5f0ac80-a6a8-4343-8bf2-51fca0964fb9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:34.997067 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c5f0ac80-a6a8-4343-8bf2-51fca0964fb9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:34.997860 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c5f0ac80-a6a8-4343-8bf2-51fca0964fb9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:34.998285 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c5f0ac80-a6a8-4343-8bf2-51fca0964fb9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:40.161220 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c5f0ac80-a6a8-4343-8bf2-51fca0964fb9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28602 microversion: 2.1 time: 5.175807 Aug 25 05:33:40.161882 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 221/426] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:34 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28602 bytes in 5177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:33:40.166996 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-711d6a3a-84a4-4b0c-9031-fd2029dd56f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28614 microversion: 2.20 time: 5.271673 Aug 25 05:33:40.167503 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-bce08e90-69f2-44cd-b941-594ec4b6a483 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:40.170992 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 206/427] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:34 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28614 bytes in 5275 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:33:40.171138 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-bce08e90-69f2-44cd-b941-594ec4b6a483 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:40.172661 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-15055b45-4c86-480b-9d28-89c5dff2ca6b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:40.173418 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-15055b45-4c86-480b-9d28-89c5dff2ca6b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 92dd15ea-adff-40f8-86b3-3333f26586d5] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:40.174984 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bce08e90-69f2-44cd-b941-594ec4b6a483 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:40.175601 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bce08e90-69f2-44cd-b941-594ec4b6a483 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:40.176767 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bce08e90-69f2-44cd-b941-594ec4b6a483 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:40.176885 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bce08e90-69f2-44cd-b941-594ec4b6a483 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:40.180083 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-15055b45-4c86-480b-9d28-89c5dff2ca6b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:40.180538 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-15055b45-4c86-480b-9d28-89c5dff2ca6b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:40.182004 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-15055b45-4c86-480b-9d28-89c5dff2ca6b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:40.182779 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-15055b45-4c86-480b-9d28-89c5dff2ca6b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:40.362058 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-bce08e90-69f2-44cd-b941-594ec4b6a483 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:40.369719 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-15055b45-4c86-480b-9d28-89c5dff2ca6b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:40.371109 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-bce08e90-69f2-44cd-b941-594ec4b6a483 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1567 microversion: 2.1 time: 0.208019 Aug 25 05:33:40.371938 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 222/428] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:40 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1567 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:40.376339 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-236a8617-a105-455a-97d2-4dc0e02e3428 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:40.376843 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-236a8617-a105-455a-97d2-4dc0e02e3428 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: 3f45744c-63f5-4685-bf64-56a5b1669e7c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:40.379291 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-15055b45-4c86-480b-9d28-89c5dff2ca6b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5" status: 200 len: 1319 microversion: 2.1 time: 0.210253 Aug 25 05:33:40.380327 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 207/429] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:40 2021] GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5 => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:40.384821 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-236a8617-a105-455a-97d2-4dc0e02e3428 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:40.385650 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-236a8617-a105-455a-97d2-4dc0e02e3428 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:40.386525 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-236a8617-a105-455a-97d2-4dc0e02e3428 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:40.387228 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-236a8617-a105-455a-97d2-4dc0e02e3428 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:40.519690 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-236a8617-a105-455a-97d2-4dc0e02e3428 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:40.529327 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-236a8617-a105-455a-97d2-4dc0e02e3428 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c" status: 200 len: 1504 microversion: 2.1 time: 0.155892 Aug 25 05:33:40.530235 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 223/430] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:40 2021] GET /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:41.173094 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-dedb6b7f-83db-4119-a604-e0f49ba8e168 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:41.180549 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-91b2d2ad-8370-4ba3-999d-1ad4a2e4b67d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:41.182353 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-91b2d2ad-8370-4ba3-999d-1ad4a2e4b67d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:41.183656 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-dedb6b7f-83db-4119-a604-e0f49ba8e168 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:41.194065 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-91b2d2ad-8370-4ba3-999d-1ad4a2e4b67d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:41.196798 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dedb6b7f-83db-4119-a604-e0f49ba8e168 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:41.197244 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dedb6b7f-83db-4119-a604-e0f49ba8e168 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:41.198058 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dedb6b7f-83db-4119-a604-e0f49ba8e168 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:41.198493 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dedb6b7f-83db-4119-a604-e0f49ba8e168 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:41.201094 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-91b2d2ad-8370-4ba3-999d-1ad4a2e4b67d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:41.202177 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-91b2d2ad-8370-4ba3-999d-1ad4a2e4b67d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:41.202616 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-91b2d2ad-8370-4ba3-999d-1ad4a2e4b67d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:41.263558 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-dedb6b7f-83db-4119-a604-e0f49ba8e168 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28602 microversion: 2.1 time: 0.093782 Aug 25 05:33:41.264134 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 208/431] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:41 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28602 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:33:41.295799 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-91b2d2ad-8370-4ba3-999d-1ad4a2e4b67d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 28614 microversion: 2.20 time: 0.120517 Aug 25 05:33:41.296575 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 224/432] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:41 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 28614 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:33:41.368656 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [req-ad6bc3b4-50e1-4958-a142-ccff19c4baf0 req-50b71896-e43c-42c1-911f-da35bcdf6463 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f45744c-63f5-4685-bf64-56a5b1669e7c", "name": "network-vif-deleted", "tag": "f5fd84a6-3d22-4ddc-aebe-935207ca11d4"}]} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:41.370119 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:33:41.370119 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: warnings.warn(msg) Aug 25 05:33:41.377641 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-ad6bc3b4-50e1-4958-a142-ccff19c4baf0 req-50b71896-e43c-42c1-911f-da35bcdf6463 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:41.380015 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-ad6bc3b4-50e1-4958-a142-ccff19c4baf0 req-50b71896-e43c-42c1-911f-da35bcdf6463 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:41.390148 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.compute.server_external_events [req-ad6bc3b4-50e1-4958-a142-ccff19c4baf0 req-50b71896-e43c-42c1-911f-da35bcdf6463 service nova] Creating event network-vif-deleted:f5fd84a6-3d22-4ddc-aebe-935207ca11d4 for instance 3f45744c-63f5-4685-bf64-56a5b1669e7c on hv-cinder-78662 Aug 25 05:33:41.391679 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-3130703e-0d16-48e3-9eba-90ef87b7adf2 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:41.392527 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-3130703e-0d16-48e3-9eba-90ef87b7adf2 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:41.395063 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [req-ad6bc3b4-50e1-4958-a142-ccff19c4baf0 req-50b71896-e43c-42c1-911f-da35bcdf6463 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030310 Aug 25 05:33:41.399576 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 209/433] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:33:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:33:41.403704 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3130703e-0d16-48e3-9eba-90ef87b7adf2 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:41.404214 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3130703e-0d16-48e3-9eba-90ef87b7adf2 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:41.405640 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3130703e-0d16-48e3-9eba-90ef87b7adf2 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:41.406129 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3130703e-0d16-48e3-9eba-90ef87b7adf2 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:41.408438 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d49754f1-addc-43be-bfbe-9dcde502fc75 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:41.410461 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-d49754f1-addc-43be-bfbe-9dcde502fc75 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 92dd15ea-adff-40f8-86b3-3333f26586d5] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:41.419676 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d49754f1-addc-43be-bfbe-9dcde502fc75 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:41.420241 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d49754f1-addc-43be-bfbe-9dcde502fc75 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:41.420888 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d49754f1-addc-43be-bfbe-9dcde502fc75 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:41.421358 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d49754f1-addc-43be-bfbe-9dcde502fc75 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:41.621120 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-3130703e-0d16-48e3-9eba-90ef87b7adf2 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:41.628797 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-d49754f1-addc-43be-bfbe-9dcde502fc75 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:41.629117 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-3130703e-0d16-48e3-9eba-90ef87b7adf2 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1567 microversion: 2.1 time: 0.243163 Aug 25 05:33:41.629724 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 225/434] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:41 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1567 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:33:41.634041 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-92c053bb-5774-4a49-bf35-b92153fafbad tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:41.634642 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-92c053bb-5774-4a49-bf35-b92153fafbad tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: 3f45744c-63f5-4685-bf64-56a5b1669e7c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:41.637188 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d49754f1-addc-43be-bfbe-9dcde502fc75 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5" status: 200 len: 1319 microversion: 2.1 time: 0.235806 Aug 25 05:33:41.638203 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 210/435] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:41 2021] GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5 => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:41.642538 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-92c053bb-5774-4a49-bf35-b92153fafbad tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:41.642978 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-92c053bb-5774-4a49-bf35-b92153fafbad tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:41.643758 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-92c053bb-5774-4a49-bf35-b92153fafbad tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:41.644177 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-92c053bb-5774-4a49-bf35-b92153fafbad tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:41.706462 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-92c053bb-5774-4a49-bf35-b92153fafbad tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:41.713906 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-92c053bb-5774-4a49-bf35-b92153fafbad tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c" status: 200 len: 1299 microversion: 2.1 time: 0.083202 Aug 25 05:33:41.714473 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 226/436] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:41 2021] GET /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c => generated 1299 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:42.275287 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-44f3b2e6-352e-4c3c-b899-5f2dbb20489f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:42.276511 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-44f3b2e6-352e-4c3c-b899-5f2dbb20489f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:42.282865 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-44f3b2e6-352e-4c3c-b899-5f2dbb20489f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:42.283326 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-44f3b2e6-352e-4c3c-b899-5f2dbb20489f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:42.284087 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-44f3b2e6-352e-4c3c-b899-5f2dbb20489f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:42.284513 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-44f3b2e6-352e-4c3c-b899-5f2dbb20489f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:42.307741 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-370a4b72-0e74-4a11-80ac-1479d8ab682c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:42.313442 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-370a4b72-0e74-4a11-80ac-1479d8ab682c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:42.315024 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-370a4b72-0e74-4a11-80ac-1479d8ab682c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:42.315492 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-370a4b72-0e74-4a11-80ac-1479d8ab682c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:42.316299 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-370a4b72-0e74-4a11-80ac-1479d8ab682c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:42.316729 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-370a4b72-0e74-4a11-80ac-1479d8ab682c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:42.377716 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-44f3b2e6-352e-4c3c-b899-5f2dbb20489f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 28895 microversion: 2.1 time: 0.105930 Aug 25 05:33:42.378595 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 211/437] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:42 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 28895 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:33:42.416343 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-370a4b72-0e74-4a11-80ac-1479d8ab682c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 29872 microversion: 2.20 time: 0.111874 Aug 25 05:33:42.417899 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 227/438] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:42 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 29872 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:33:42.519478 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [req-94373c10-36e2-49d4-8997-ef8dc9cb995e req-1e880266-9dc1-4e13-a6f8-937dc139962e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92dd15ea-adff-40f8-86b3-3333f26586d5", "name": "network-vif-plugged", "status": "completed", "tag": "ead2fa26-3920-4558-83c9-db855966516e"}]} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:42.520945 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:33:42.520945 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: warnings.warn(msg) Aug 25 05:33:42.529431 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-94373c10-36e2-49d4-8997-ef8dc9cb995e req-1e880266-9dc1-4e13-a6f8-937dc139962e service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:42.529892 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-94373c10-36e2-49d4-8997-ef8dc9cb995e req-1e880266-9dc1-4e13-a6f8-937dc139962e service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:42.542477 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.compute.server_external_events [req-94373c10-36e2-49d4-8997-ef8dc9cb995e req-1e880266-9dc1-4e13-a6f8-937dc139962e service nova] Creating event network-vif-plugged:ead2fa26-3920-4558-83c9-db855966516e for instance 92dd15ea-adff-40f8-86b3-3333f26586d5 on hv-cinder-78662 Aug 25 05:33:42.547464 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [req-94373c10-36e2-49d4-8997-ef8dc9cb995e req-1e880266-9dc1-4e13-a6f8-937dc139962e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031905 Aug 25 05:33:42.548227 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 212/439] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:33:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:33:42.647036 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-3976f1ba-9770-47b4-acaf-9ede4d9d1909 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:42.647719 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-3976f1ba-9770-47b4-acaf-9ede4d9d1909 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:42.654744 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3976f1ba-9770-47b4-acaf-9ede4d9d1909 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:42.655747 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3976f1ba-9770-47b4-acaf-9ede4d9d1909 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:42.656374 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e2b09782-08ef-47b4-8253-2ff59aadde70 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:42.657081 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3976f1ba-9770-47b4-acaf-9ede4d9d1909 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:42.657466 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3976f1ba-9770-47b4-acaf-9ede4d9d1909 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:42.657674 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e2b09782-08ef-47b4-8253-2ff59aadde70 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 92dd15ea-adff-40f8-86b3-3333f26586d5] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:42.664587 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e2b09782-08ef-47b4-8253-2ff59aadde70 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:42.665036 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e2b09782-08ef-47b4-8253-2ff59aadde70 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:42.665846 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e2b09782-08ef-47b4-8253-2ff59aadde70 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:42.666285 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e2b09782-08ef-47b4-8253-2ff59aadde70 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:42.849122 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e2b09782-08ef-47b4-8253-2ff59aadde70 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:42.853304 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-3976f1ba-9770-47b4-acaf-9ede4d9d1909 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:42.860072 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e2b09782-08ef-47b4-8253-2ff59aadde70 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5" status: 200 len: 1319 microversion: 2.1 time: 0.209150 Aug 25 05:33:42.861304 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 213/440] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:42 2021] GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5 => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:33:42.872566 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-3976f1ba-9770-47b4-acaf-9ede4d9d1909 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1567 microversion: 2.1 time: 0.229202 Aug 25 05:33:42.873577 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 228/441] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:42 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1567 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:42.874206 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6656f61a-08c7-45ad-9164-1f0a91a80f34 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:42.874824 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6656f61a-08c7-45ad-9164-1f0a91a80f34 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: 3f45744c-63f5-4685-bf64-56a5b1669e7c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:42.888509 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6656f61a-08c7-45ad-9164-1f0a91a80f34 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:42.889011 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6656f61a-08c7-45ad-9164-1f0a91a80f34 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:42.889853 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6656f61a-08c7-45ad-9164-1f0a91a80f34 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:42.890311 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6656f61a-08c7-45ad-9164-1f0a91a80f34 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:42.905645 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.wsgi [None req-6656f61a-08c7-45ad-9164-1f0a91a80f34 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] HTTP exception thrown: Instance 3f45744c-63f5-4685-bf64-56a5b1669e7c could not be found. Aug 25 05:33:42.906244 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6656f61a-08c7-45ad-9164-1f0a91a80f34 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Returning 404 to user: Instance 3f45744c-63f5-4685-bf64-56a5b1669e7c could not be found. {{(pid=108884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 05:33:42.907075 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6656f61a-08c7-45ad-9164-1f0a91a80f34 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c" status: 404 len: 111 microversion: 2.1 time: 0.044762 Aug 25 05:33:42.907612 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 214/442] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:42 2021] GET /compute/v2.1/servers/3f45744c-63f5-4685-bf64-56a5b1669e7c => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:33:43.009339 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ad15bbbe-2045-4067-acd2-d864c622d367 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1620150423", "imageRef": "05da2439-78f2-405c-b60a-89671b21a373", "flavorRef": "452", "networks": [{"uuid": "f95d7096-591e-4d19-be73-e1e513e5e2b6"}]}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:43.064812 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.network.neutron [None req-ad15bbbe-2045-4067-acd2-d864c622d367 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] validate_networks() for [('f95d7096-591e-4d19-be73-e1e513e5e2b6', None, None, None, None, None)] {{(pid=108885) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 25 05:33:43.390352 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-464d3448-0283-411d-a0a5-0bacfab155fe tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:43.391297 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-464d3448-0283-411d-a0a5-0bacfab155fe tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:43.397349 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-464d3448-0283-411d-a0a5-0bacfab155fe tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:43.397970 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-464d3448-0283-411d-a0a5-0bacfab155fe tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:43.398763 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-464d3448-0283-411d-a0a5-0bacfab155fe tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:43.399201 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-464d3448-0283-411d-a0a5-0bacfab155fe tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:43.429468 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-ad15bbbe-2045-4067-acd2-d864c622d367 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Flavor limits 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 05:33:43.429981 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-ad15bbbe-2045-4067-acd2-d864c622d367 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Image limits 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 05:33:43.430435 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-ad15bbbe-2045-4067-acd2-d864c622d367 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Flavor pref 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 05:33:43.430832 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-ad15bbbe-2045-4067-acd2-d864c622d367 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Image pref 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 05:33:43.431234 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-ad15bbbe-2045-4067-acd2-d864c622d367 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 05:33:43.441359 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ad15bbbe-2045-4067-acd2-d864c622d367 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:43.442059 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ad15bbbe-2045-4067-acd2-d864c622d367 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:43.442854 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ad15bbbe-2045-4067-acd2-d864c622d367 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:43.443292 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ad15bbbe-2045-4067-acd2-d864c622d367 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:43.461164 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.quota [None req-ad15bbbe-2045-4067-acd2-d864c622d367 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Getting quotas for project 376eee360a8940d998c21a88309ac903. Resources: {'ram', 'cores', 'instances'} {{(pid=108885) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 05:33:43.465765 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.quota [None req-ad15bbbe-2045-4067-acd2-d864c622d367 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Getting quotas for user a9ae7c08cdf04609a1ba446d0960a7ff and project 376eee360a8940d998c21a88309ac903. Resources: {'ram', 'cores', 'instances'} {{(pid=108885) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 05:33:43.476526 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ad15bbbe-2045-4067-acd2-d864c622d367 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Going to run 1 instances... {{(pid=108885) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 25 05:33:43.478875 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ad15bbbe-2045-4067-acd2-d864c622d367 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: fd62434d-18f1-4992-8f73-2ebec7b52a8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05da2439-78f2-405c-b60a-89671b21a373',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 25 05:33:43.588663 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-464d3448-0283-411d-a0a5-0bacfab155fe tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 30550 microversion: 2.1 time: 0.202710 Aug 25 05:33:43.589215 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 215/443] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:43 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 30550 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:33:43.594320 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-2ea39c3c-d3e9-4932-9408-96e53fadcf9a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:43.595310 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-2ea39c3c-d3e9-4932-9408-96e53fadcf9a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:43.603055 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2ea39c3c-d3e9-4932-9408-96e53fadcf9a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:43.603544 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2ea39c3c-d3e9-4932-9408-96e53fadcf9a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:43.604330 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2ea39c3c-d3e9-4932-9408-96e53fadcf9a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:43.604822 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2ea39c3c-d3e9-4932-9408-96e53fadcf9a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:43.633994 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ad15bbbe-2045-4067-acd2-d864c622d367 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.628159 Aug 25 05:33:43.640421 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 229/444] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 25 05:33:43 2021] POST /compute/v2.1/servers => generated 380 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 05:33:43.656507 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d54678a4-88cb-4d85-a21f-e5b19a3bcccb tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:43.656507 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d54678a4-88cb-4d85-a21f-e5b19a3bcccb tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: fd62434d-18f1-4992-8f73-2ebec7b52a8f] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:43.700430 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-2ea39c3c-d3e9-4932-9408-96e53fadcf9a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 31567 microversion: 2.20 time: 0.109436 Aug 25 05:33:43.705162 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 216/445] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:43 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 31567 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:33:43.708203 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d54678a4-88cb-4d85-a21f-e5b19a3bcccb tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:43.722372 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d54678a4-88cb-4d85-a21f-e5b19a3bcccb tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f" status: 200 len: 1214 microversion: 2.1 time: 0.080809 Aug 25 05:33:43.722952 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 230/446] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:43 2021] GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:43.878034 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5a3cad4e-9f69-40a3-9a11-f52d10438959 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:43.878644 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5a3cad4e-9f69-40a3-9a11-f52d10438959 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 92dd15ea-adff-40f8-86b3-3333f26586d5] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:43.885211 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5a3cad4e-9f69-40a3-9a11-f52d10438959 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:43.885989 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5a3cad4e-9f69-40a3-9a11-f52d10438959 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:43.887962 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5a3cad4e-9f69-40a3-9a11-f52d10438959 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:43.888729 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5a3cad4e-9f69-40a3-9a11-f52d10438959 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:43.889987 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-cd256d72-2899-43a4-bea2-f5d1797c77dd tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:43.890752 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-cd256d72-2899-43a4-bea2-f5d1797c77dd tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:43.897381 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cd256d72-2899-43a4-bea2-f5d1797c77dd tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:43.897850 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cd256d72-2899-43a4-bea2-f5d1797c77dd tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:43.898644 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cd256d72-2899-43a4-bea2-f5d1797c77dd tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:43.899064 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cd256d72-2899-43a4-bea2-f5d1797c77dd tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:44.073787 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-cd256d72-2899-43a4-bea2-f5d1797c77dd tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:44.080765 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-5a3cad4e-9f69-40a3-9a11-f52d10438959 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:44.082444 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-cd256d72-2899-43a4-bea2-f5d1797c77dd tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1567 microversion: 2.1 time: 0.196813 Aug 25 05:33:44.083007 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 231/447] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:43 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1567 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:33:44.088297 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5a3cad4e-9f69-40a3-9a11-f52d10438959 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5" status: 200 len: 1319 microversion: 2.1 time: 0.214438 Aug 25 05:33:44.089093 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 217/448] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:43 2021] GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5 => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:44.600290 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9c1d9d80-e8df-48d7-a4bb-4d7dc12ddcf7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:44.601365 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9c1d9d80-e8df-48d7-a4bb-4d7dc12ddcf7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:44.609088 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9c1d9d80-e8df-48d7-a4bb-4d7dc12ddcf7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:44.609248 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9c1d9d80-e8df-48d7-a4bb-4d7dc12ddcf7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:44.610594 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9c1d9d80-e8df-48d7-a4bb-4d7dc12ddcf7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:44.611286 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9c1d9d80-e8df-48d7-a4bb-4d7dc12ddcf7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:44.712174 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5ff8362a-6da2-4a10-b887-c10e44c469cb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:44.712979 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5ff8362a-6da2-4a10-b887-c10e44c469cb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:44.716609 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9c1d9d80-e8df-48d7-a4bb-4d7dc12ddcf7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 31923 microversion: 2.1 time: 0.119826 Aug 25 05:33:44.717247 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 232/449] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:44 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 31923 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:33:44.719282 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5ff8362a-6da2-4a10-b887-c10e44c469cb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:44.719748 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5ff8362a-6da2-4a10-b887-c10e44c469cb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:44.720501 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5ff8362a-6da2-4a10-b887-c10e44c469cb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:44.720938 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5ff8362a-6da2-4a10-b887-c10e44c469cb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:44.740066 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d4847ca9-ff6a-4e94-ad54-91a2b6ab8478 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:44.740878 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d4847ca9-ff6a-4e94-ad54-91a2b6ab8478 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: fd62434d-18f1-4992-8f73-2ebec7b52a8f] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:44.803024 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d4847ca9-ff6a-4e94-ad54-91a2b6ab8478 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:44.809763 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d4847ca9-ff6a-4e94-ad54-91a2b6ab8478 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f" status: 200 len: 1214 microversion: 2.1 time: 0.073873 Aug 25 05:33:44.811480 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 233/450] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:44 2021] GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:33:44.850732 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5ff8362a-6da2-4a10-b887-c10e44c469cb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 32387 microversion: 2.20 time: 0.142109 Aug 25 05:33:44.851384 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 218/451] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:44 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 32387 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 25 05:33:45.100321 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-11d853cc-35db-452f-9334-ac5598a0c83f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:45.101159 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-11d853cc-35db-452f-9334-ac5598a0c83f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:45.106181 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-445738d0-a0ea-449f-8ba9-ce7082dcbaac tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:45.107481 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-445738d0-a0ea-449f-8ba9-ce7082dcbaac tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 92dd15ea-adff-40f8-86b3-3333f26586d5] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:45.108681 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-11d853cc-35db-452f-9334-ac5598a0c83f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:45.109134 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-11d853cc-35db-452f-9334-ac5598a0c83f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:45.109952 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-11d853cc-35db-452f-9334-ac5598a0c83f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:45.110383 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-11d853cc-35db-452f-9334-ac5598a0c83f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:45.114379 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-445738d0-a0ea-449f-8ba9-ce7082dcbaac tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:45.114811 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-445738d0-a0ea-449f-8ba9-ce7082dcbaac tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:45.115582 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-445738d0-a0ea-449f-8ba9-ce7082dcbaac tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:45.116008 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-445738d0-a0ea-449f-8ba9-ce7082dcbaac tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:45.322793 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-11d853cc-35db-452f-9334-ac5598a0c83f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:45.331187 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-445738d0-a0ea-449f-8ba9-ce7082dcbaac tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:45.339283 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-11d853cc-35db-452f-9334-ac5598a0c83f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1547 microversion: 2.1 time: 0.242687 Aug 25 05:33:45.339687 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-445738d0-a0ea-449f-8ba9-ce7082dcbaac tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5" status: 200 len: 1319 microversion: 2.1 time: 0.237677 Aug 25 05:33:45.340113 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 234/452] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:45 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1547 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:45.348242 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 219/453] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:45 2021] GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5 => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:33:45.356469 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-eed59ed0-00fd-467a-ac20-9299c165be39 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:45.357594 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-eed59ed0-00fd-467a-ac20-9299c165be39 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:45.364099 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-eed59ed0-00fd-467a-ac20-9299c165be39 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:45.364685 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-eed59ed0-00fd-467a-ac20-9299c165be39 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:45.365469 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-eed59ed0-00fd-467a-ac20-9299c165be39 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:45.366246 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-eed59ed0-00fd-467a-ac20-9299c165be39 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:45.511310 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.wsgi [None req-eed59ed0-00fd-467a-ac20-9299c165be39 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] HTTP exception thrown: Cannot 'detach_volume' instance 2163e566-1832-40df-8925-09e54ae2974c while it is in vm_state rescued Aug 25 05:33:45.512211 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-eed59ed0-00fd-467a-ac20-9299c165be39 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Returning 409 to user: Cannot 'detach_volume' instance 2163e566-1832-40df-8925-09e54ae2974c while it is in vm_state rescued {{(pid=108885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 05:33:45.513595 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-eed59ed0-00fd-467a-ac20-9299c165be39 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c/os-volume_attachments/3b82283f-d3a8-4c15-a4eb-48fc85e7d377" status: 409 len: 152 microversion: 2.1 time: 0.161163 Aug 25 05:33:45.514842 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 235/454] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 25 05:33:45 2021] DELETE /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c/os-volume_attachments/3b82283f-d3a8-4c15-a4eb-48fc85e7d377 => generated 152 bytes in 163 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 25 05:33:45.534037 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6e11a64b-55f3-43ee-8ef9-95331caae57f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:45.534683 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6e11a64b-55f3-43ee-8ef9-95331caae57f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:45.546012 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6e11a64b-55f3-43ee-8ef9-95331caae57f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:45.546715 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6e11a64b-55f3-43ee-8ef9-95331caae57f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:45.547541 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6e11a64b-55f3-43ee-8ef9-95331caae57f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:45.547968 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6e11a64b-55f3-43ee-8ef9-95331caae57f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:45.728362 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-865e609d-ea00-40b8-a26b-1d6860775ade tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:45.729268 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-865e609d-ea00-40b8-a26b-1d6860775ade tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:45.736866 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-865e609d-ea00-40b8-a26b-1d6860775ade tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:45.737313 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-865e609d-ea00-40b8-a26b-1d6860775ade tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:45.738118 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-865e609d-ea00-40b8-a26b-1d6860775ade tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:45.738556 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-865e609d-ea00-40b8-a26b-1d6860775ade tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:45.826829 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-865e609d-ea00-40b8-a26b-1d6860775ade tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 35791 microversion: 2.1 time: 0.101646 Aug 25 05:33:45.827569 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 236/455] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:45 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 35791 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:33:45.832608 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c76176b8-2849-4b52-830b-9aa3c48fb73b tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:45.833221 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c76176b8-2849-4b52-830b-9aa3c48fb73b tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: fd62434d-18f1-4992-8f73-2ebec7b52a8f] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:45.839953 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c76176b8-2849-4b52-830b-9aa3c48fb73b tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:45.840420 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c76176b8-2849-4b52-830b-9aa3c48fb73b tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:45.841773 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c76176b8-2849-4b52-830b-9aa3c48fb73b tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:45.842446 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c76176b8-2849-4b52-830b-9aa3c48fb73b tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:45.852142 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6e11a64b-55f3-43ee-8ef9-95331caae57f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "POST /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c/action" status: 202 len: 0 microversion: 2.1 time: 0.325845 Aug 25 05:33:45.855697 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 220/456] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:45 2021] POST /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:33:45.867134 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-57a75197-24f3-47c8-9120-0d646179837e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:45.867883 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-57a75197-24f3-47c8-9120-0d646179837e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:45.874582 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-57a75197-24f3-47c8-9120-0d646179837e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:45.875082 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-57a75197-24f3-47c8-9120-0d646179837e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:45.875888 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-57a75197-24f3-47c8-9120-0d646179837e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:45.876316 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-57a75197-24f3-47c8-9120-0d646179837e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:45.923979 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-c76176b8-2849-4b52-830b-9aa3c48fb73b tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:45.933971 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c76176b8-2849-4b52-830b-9aa3c48fb73b tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f" status: 200 len: 1266 microversion: 2.1 time: 0.105213 Aug 25 05:33:45.934569 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 237/457] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:45 2021] GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f => generated 1266 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:45.939331 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-13cbe882-5790-4eac-bfab-c00eb6336269 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:45.940230 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-13cbe882-5790-4eac-bfab-c00eb6336269 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:45.946742 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-13cbe882-5790-4eac-bfab-c00eb6336269 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:45.947184 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-13cbe882-5790-4eac-bfab-c00eb6336269 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:45.948318 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-13cbe882-5790-4eac-bfab-c00eb6336269 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:45.948426 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-13cbe882-5790-4eac-bfab-c00eb6336269 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:46.025539 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-57a75197-24f3-47c8-9120-0d646179837e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:46.034197 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-57a75197-24f3-47c8-9120-0d646179837e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1555 microversion: 2.1 time: 0.176992 Aug 25 05:33:46.034757 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 221/458] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:45 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1555 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:33:46.043925 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-13cbe882-5790-4eac-bfab-c00eb6336269 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 33177 microversion: 2.20 time: 0.107964 Aug 25 05:33:46.044583 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 238/459] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:45 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 33177 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:33:46.370046 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8f83b14f-8839-4215-aba3-39419ba86bde tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:46.370660 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8f83b14f-8839-4215-aba3-39419ba86bde tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 92dd15ea-adff-40f8-86b3-3333f26586d5] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:46.377901 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8f83b14f-8839-4215-aba3-39419ba86bde tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:46.378344 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8f83b14f-8839-4215-aba3-39419ba86bde tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:46.379116 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8f83b14f-8839-4215-aba3-39419ba86bde tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:46.379543 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8f83b14f-8839-4215-aba3-39419ba86bde tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:46.532007 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-8f83b14f-8839-4215-aba3-39419ba86bde tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:46.543773 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8f83b14f-8839-4215-aba3-39419ba86bde tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5" status: 200 len: 1508 microversion: 2.1 time: 0.177457 Aug 25 05:33:46.565583 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 222/460] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:46 2021] GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5 => generated 1508 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:46.840816 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-eaecd86a-0d8b-4f00-bbca-86012e00385d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:46.842260 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-eaecd86a-0d8b-4f00-bbca-86012e00385d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:46.852588 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-eaecd86a-0d8b-4f00-bbca-86012e00385d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:46.853746 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-eaecd86a-0d8b-4f00-bbca-86012e00385d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:46.855374 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-eaecd86a-0d8b-4f00-bbca-86012e00385d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:46.856067 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-eaecd86a-0d8b-4f00-bbca-86012e00385d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:46.965367 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-bebb8283-0ed1-4b75-928b-bde04675a2ee tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:46.966008 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-bebb8283-0ed1-4b75-928b-bde04675a2ee tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: fd62434d-18f1-4992-8f73-2ebec7b52a8f] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:46.980247 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-eaecd86a-0d8b-4f00-bbca-86012e00385d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 36674 microversion: 2.1 time: 0.144111 Aug 25 05:33:46.987030 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 239/461] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:46 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 36674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:33:47.009878 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bebb8283-0ed1-4b75-928b-bde04675a2ee tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:47.009878 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bebb8283-0ed1-4b75-928b-bde04675a2ee tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:47.009878 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bebb8283-0ed1-4b75-928b-bde04675a2ee tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:47.009878 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bebb8283-0ed1-4b75-928b-bde04675a2ee tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:47.054906 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-80b1b37c-5b41-4d33-98c1-0dd889d10946 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:47.055877 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-80b1b37c-5b41-4d33-98c1-0dd889d10946 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:47.066680 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-80b1b37c-5b41-4d33-98c1-0dd889d10946 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:47.067444 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-80b1b37c-5b41-4d33-98c1-0dd889d10946 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:47.068639 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-80b1b37c-5b41-4d33-98c1-0dd889d10946 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:47.069615 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-80b1b37c-5b41-4d33-98c1-0dd889d10946 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:47.096608 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-bebb8283-0ed1-4b75-928b-bde04675a2ee tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:47.104251 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-bebb8283-0ed1-4b75-928b-bde04675a2ee tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f" status: 200 len: 1272 microversion: 2.1 time: 0.147836 Aug 25 05:33:47.104824 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 223/462] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:46 2021] GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f => generated 1272 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:47.111075 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a341706d-7ce4-45b2-a15e-8d4887f7ac5e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:47.112380 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a341706d-7ce4-45b2-a15e-8d4887f7ac5e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:47.118944 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a341706d-7ce4-45b2-a15e-8d4887f7ac5e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:47.119620 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a341706d-7ce4-45b2-a15e-8d4887f7ac5e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:47.120653 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a341706d-7ce4-45b2-a15e-8d4887f7ac5e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:47.121102 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a341706d-7ce4-45b2-a15e-8d4887f7ac5e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:47.215486 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a341706d-7ce4-45b2-a15e-8d4887f7ac5e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 33813 microversion: 2.20 time: 0.109255 Aug 25 05:33:47.217253 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 224/463] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:47 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 33813 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:33:47.245980 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-80b1b37c-5b41-4d33-98c1-0dd889d10946 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:47.264961 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-80b1b37c-5b41-4d33-98c1-0dd889d10946 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1555 microversion: 2.1 time: 0.216690 Aug 25 05:33:47.265865 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 240/464] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:47 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1555 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:47.998059 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-93f2dd6a-7c46-4353-ab04-9e20be61355b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:47.999478 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-93f2dd6a-7c46-4353-ab04-9e20be61355b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:48.006465 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-93f2dd6a-7c46-4353-ab04-9e20be61355b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:48.009904 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-93f2dd6a-7c46-4353-ab04-9e20be61355b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:48.009904 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-93f2dd6a-7c46-4353-ab04-9e20be61355b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:48.009904 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-93f2dd6a-7c46-4353-ab04-9e20be61355b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:48.122356 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-52fe3767-4544-432f-9b8b-d66c756606fc tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:48.123605 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-52fe3767-4544-432f-9b8b-d66c756606fc tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: fd62434d-18f1-4992-8f73-2ebec7b52a8f] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:48.130218 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-52fe3767-4544-432f-9b8b-d66c756606fc tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:48.137498 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-52fe3767-4544-432f-9b8b-d66c756606fc tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:48.137498 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-52fe3767-4544-432f-9b8b-d66c756606fc tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:48.137498 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-52fe3767-4544-432f-9b8b-d66c756606fc tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:48.212141 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-93f2dd6a-7c46-4353-ab04-9e20be61355b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 37179 microversion: 2.1 time: 0.220858 Aug 25 05:33:48.212805 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 225/465] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:47 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 37179 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:33:48.228731 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b51d3594-a624-4889-a8ae-f26fa130ffce tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:48.229861 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b51d3594-a624-4889-a8ae-f26fa130ffce tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:48.237162 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b51d3594-a624-4889-a8ae-f26fa130ffce tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:48.237645 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b51d3594-a624-4889-a8ae-f26fa130ffce tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:48.238423 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b51d3594-a624-4889-a8ae-f26fa130ffce tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:48.239042 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b51d3594-a624-4889-a8ae-f26fa130ffce tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:48.285560 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-52fe3767-4544-432f-9b8b-d66c756606fc tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:48.285560 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-52fe3767-4544-432f-9b8b-d66c756606fc tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f" status: 200 len: 1314 microversion: 2.1 time: 0.162454 Aug 25 05:33:48.285560 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 241/466] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:48 2021] GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:33:48.295909 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6f995082-ff7b-4b8d-bf06-0a680d2006f3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:48.296522 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6f995082-ff7b-4b8d-bf06-0a680d2006f3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:48.302473 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6f995082-ff7b-4b8d-bf06-0a680d2006f3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:48.302913 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6f995082-ff7b-4b8d-bf06-0a680d2006f3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:48.303688 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6f995082-ff7b-4b8d-bf06-0a680d2006f3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:48.304125 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6f995082-ff7b-4b8d-bf06-0a680d2006f3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:48.350097 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b51d3594-a624-4889-a8ae-f26fa130ffce tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 34930 microversion: 2.20 time: 0.125091 Aug 25 05:33:48.351181 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 226/467] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:48 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 34930 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 25 05:33:48.447074 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-6f995082-ff7b-4b8d-bf06-0a680d2006f3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:48.456505 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6f995082-ff7b-4b8d-bf06-0a680d2006f3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1555 microversion: 2.1 time: 0.165252 Aug 25 05:33:48.457100 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 242/468] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:48 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:49.225783 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5052288a-86ef-4b9a-8841-2b241c728974 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:49.227321 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5052288a-86ef-4b9a-8841-2b241c728974 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:49.236817 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5052288a-86ef-4b9a-8841-2b241c728974 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:49.236817 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5052288a-86ef-4b9a-8841-2b241c728974 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:49.236817 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5052288a-86ef-4b9a-8841-2b241c728974 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:49.236817 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5052288a-86ef-4b9a-8841-2b241c728974 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:49.298600 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6b43a640-2ef4-4b15-b769-bb6bbddc1bed tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:49.300499 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6b43a640-2ef4-4b15-b769-bb6bbddc1bed tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: fd62434d-18f1-4992-8f73-2ebec7b52a8f] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:49.306645 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6b43a640-2ef4-4b15-b769-bb6bbddc1bed tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:49.307344 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6b43a640-2ef4-4b15-b769-bb6bbddc1bed tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:49.308222 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6b43a640-2ef4-4b15-b769-bb6bbddc1bed tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:49.308808 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6b43a640-2ef4-4b15-b769-bb6bbddc1bed tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:49.464971 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5052288a-86ef-4b9a-8841-2b241c728974 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 38041 microversion: 2.1 time: 0.243018 Aug 25 05:33:49.471982 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 227/469] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:49 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 38041 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:33:49.480173 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-33562b52-712d-4ab3-90e3-99990bf27167 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:49.494445 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-33562b52-712d-4ab3-90e3-99990bf27167 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:49.495354 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-33562b52-712d-4ab3-90e3-99990bf27167 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:49.496329 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-33562b52-712d-4ab3-90e3-99990bf27167 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:49.497707 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-33562b52-712d-4ab3-90e3-99990bf27167 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:49.497707 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-33562b52-712d-4ab3-90e3-99990bf27167 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:49.548938 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-6b43a640-2ef4-4b15-b769-bb6bbddc1bed tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:49.558898 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6b43a640-2ef4-4b15-b769-bb6bbddc1bed tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f" status: 200 len: 1314 microversion: 2.1 time: 0.263879 Aug 25 05:33:49.560485 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 243/470] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:49 2021] GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:33:49.572814 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [req-d247a7ba-648c-40e1-b508-e28bdedee8c2 req-2a89701c-f83e-4151-924f-e9491249ca43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd62434d-18f1-4992-8f73-2ebec7b52a8f", "tag": "541463f5-5003-4960-982e-f2b218548a88"}]} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:49.574896 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:33:49.574896 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: warnings.warn(msg) Aug 25 05:33:49.583576 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-d247a7ba-648c-40e1-b508-e28bdedee8c2 req-2a89701c-f83e-4151-924f-e9491249ca43 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:49.584296 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-d247a7ba-648c-40e1-b508-e28bdedee8c2 req-2a89701c-f83e-4151-924f-e9491249ca43 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:49.611985 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.compute.server_external_events [req-d247a7ba-648c-40e1-b508-e28bdedee8c2 req-2a89701c-f83e-4151-924f-e9491249ca43 service nova] Creating event network-changed:541463f5-5003-4960-982e-f2b218548a88 for instance fd62434d-18f1-4992-8f73-2ebec7b52a8f on hv-cinder-78662 Aug 25 05:33:49.611985 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [req-d247a7ba-648c-40e1-b508-e28bdedee8c2 req-2a89701c-f83e-4151-924f-e9491249ca43 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041392 Aug 25 05:33:49.611985 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 244/471] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:33:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:33:49.616795 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5b8d2fc1-8dbd-48f2-bc32-74e8f4d296ff tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:49.618016 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5b8d2fc1-8dbd-48f2-bc32-74e8f4d296ff tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:49.619698 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-33562b52-712d-4ab3-90e3-99990bf27167 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 35735 microversion: 2.20 time: 0.145151 Aug 25 05:33:49.621657 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 228/472] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:49 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 35735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:33:49.626676 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5b8d2fc1-8dbd-48f2-bc32-74e8f4d296ff tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:49.626942 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5b8d2fc1-8dbd-48f2-bc32-74e8f4d296ff tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:49.627807 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5b8d2fc1-8dbd-48f2-bc32-74e8f4d296ff tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:49.628237 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5b8d2fc1-8dbd-48f2-bc32-74e8f4d296ff tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:49.898949 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-5b8d2fc1-8dbd-48f2-bc32-74e8f4d296ff tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:49.910349 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5b8d2fc1-8dbd-48f2-bc32-74e8f4d296ff tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1555 microversion: 2.1 time: 0.303329 Aug 25 05:33:49.921572 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 245/473] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:49 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1555 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:50.483024 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-01daf1cb-0011-44bc-bace-a69e8b54a393 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:50.484055 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-01daf1cb-0011-44bc-bace-a69e8b54a393 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:50.490565 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-01daf1cb-0011-44bc-bace-a69e8b54a393 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:50.496129 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-01daf1cb-0011-44bc-bace-a69e8b54a393 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:50.496129 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-01daf1cb-0011-44bc-bace-a69e8b54a393 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:50.496129 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-01daf1cb-0011-44bc-bace-a69e8b54a393 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:50.577708 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d511756d-9625-4521-9f8d-86441cefe470 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:50.578305 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d511756d-9625-4521-9f8d-86441cefe470 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: fd62434d-18f1-4992-8f73-2ebec7b52a8f] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:50.584639 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d511756d-9625-4521-9f8d-86441cefe470 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:50.585070 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d511756d-9625-4521-9f8d-86441cefe470 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:50.586057 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d511756d-9625-4521-9f8d-86441cefe470 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:50.586494 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d511756d-9625-4521-9f8d-86441cefe470 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:50.720183 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d511756d-9625-4521-9f8d-86441cefe470 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:50.734471 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d511756d-9625-4521-9f8d-86441cefe470 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f" status: 200 len: 1314 microversion: 2.1 time: 0.161834 Aug 25 05:33:50.735040 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 246/474] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:50 2021] GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:50.740882 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-28c9246a-efae-4efd-b910-108f44db30f2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:50.742375 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-28c9246a-efae-4efd-b910-108f44db30f2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:50.751039 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-28c9246a-efae-4efd-b910-108f44db30f2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:50.751646 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-28c9246a-efae-4efd-b910-108f44db30f2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:50.752469 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-28c9246a-efae-4efd-b910-108f44db30f2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:50.752974 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-28c9246a-efae-4efd-b910-108f44db30f2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:51.065599 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-28c9246a-efae-4efd-b910-108f44db30f2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 37276 microversion: 2.20 time: 0.328876 Aug 25 05:33:51.067151 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 247/475] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:50 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 37276 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:33:51.076072 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-3ea586c8-7895-4c0f-a35b-143aae797a1c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:51.076759 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-3ea586c8-7895-4c0f-a35b-143aae797a1c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:51.083507 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3ea586c8-7895-4c0f-a35b-143aae797a1c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:51.084178 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3ea586c8-7895-4c0f-a35b-143aae797a1c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:51.084947 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3ea586c8-7895-4c0f-a35b-143aae797a1c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:51.085568 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3ea586c8-7895-4c0f-a35b-143aae797a1c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:51.126416 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-01daf1cb-0011-44bc-bace-a69e8b54a393 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 38111 microversion: 2.1 time: 0.650851 Aug 25 05:33:51.127498 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 229/476] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:50 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 38111 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:33:51.237413 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-3ea586c8-7895-4c0f-a35b-143aae797a1c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:51.245679 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-3ea586c8-7895-4c0f-a35b-143aae797a1c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1555 microversion: 2.1 time: 0.177160 Aug 25 05:33:51.246120 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 248/477] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:51 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1555 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:51.751596 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-eb2704ef-f122-4b22-ae8b-3766048df7af tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:51.752300 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-eb2704ef-f122-4b22-ae8b-3766048df7af tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: fd62434d-18f1-4992-8f73-2ebec7b52a8f] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:51.759130 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-eb2704ef-f122-4b22-ae8b-3766048df7af tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:51.759505 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-eb2704ef-f122-4b22-ae8b-3766048df7af tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:51.760288 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-eb2704ef-f122-4b22-ae8b-3766048df7af tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:51.760724 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-eb2704ef-f122-4b22-ae8b-3766048df7af tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:51.912850 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-eb2704ef-f122-4b22-ae8b-3766048df7af tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:51.920558 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-eb2704ef-f122-4b22-ae8b-3766048df7af tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f" status: 200 len: 1314 microversion: 2.1 time: 0.173484 Aug 25 05:33:51.921119 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 230/478] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:51 2021] GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:52.084835 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-0b877b25-ebaa-479d-8cdf-d3fd6edd126d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:52.085768 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-0b877b25-ebaa-479d-8cdf-d3fd6edd126d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:52.092029 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0b877b25-ebaa-479d-8cdf-d3fd6edd126d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:52.092652 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0b877b25-ebaa-479d-8cdf-d3fd6edd126d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:52.097259 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0b877b25-ebaa-479d-8cdf-d3fd6edd126d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:52.097259 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0b877b25-ebaa-479d-8cdf-d3fd6edd126d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:52.140361 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-0c657b9b-6151-4f29-93d4-d95595b86149 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:52.141551 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-0c657b9b-6151-4f29-93d4-d95595b86149 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:52.147868 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0c657b9b-6151-4f29-93d4-d95595b86149 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:52.148306 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0c657b9b-6151-4f29-93d4-d95595b86149 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:52.149158 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0c657b9b-6151-4f29-93d4-d95595b86149 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:52.149606 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0c657b9b-6151-4f29-93d4-d95595b86149 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:52.296041 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-0b877b25-ebaa-479d-8cdf-d3fd6edd126d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 38159 microversion: 2.20 time: 0.214662 Aug 25 05:33:52.296687 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 249/479] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:52 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 38159 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:33:52.301408 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6758afda-4ab4-4782-8e00-6c45b534b03d tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:52.302112 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6758afda-4ab4-4782-8e00-6c45b534b03d tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:52.309213 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6758afda-4ab4-4782-8e00-6c45b534b03d tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:52.309682 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6758afda-4ab4-4782-8e00-6c45b534b03d tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:52.311200 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6758afda-4ab4-4782-8e00-6c45b534b03d tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:52.311798 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6758afda-4ab4-4782-8e00-6c45b534b03d tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:52.327489 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-0c657b9b-6151-4f29-93d4-d95595b86149 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 38111 microversion: 2.1 time: 0.189283 Aug 25 05:33:52.327489 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 231/480] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:52 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 38111 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:33:52.447072 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-6758afda-4ab4-4782-8e00-6c45b534b03d tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:52.456084 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6758afda-4ab4-4782-8e00-6c45b534b03d tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1555 microversion: 2.1 time: 0.158241 Aug 25 05:33:52.456647 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 250/481] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:52 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:52.938159 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-05ed673f-5e62-4558-a62f-9c387528d2ec tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:52.938909 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-05ed673f-5e62-4558-a62f-9c387528d2ec tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: fd62434d-18f1-4992-8f73-2ebec7b52a8f] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:52.945424 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-05ed673f-5e62-4558-a62f-9c387528d2ec tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:52.945905 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-05ed673f-5e62-4558-a62f-9c387528d2ec tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:52.946684 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-05ed673f-5e62-4558-a62f-9c387528d2ec tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:52.947114 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-05ed673f-5e62-4558-a62f-9c387528d2ec tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:53.088342 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-05ed673f-5e62-4558-a62f-9c387528d2ec tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:53.101549 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-05ed673f-5e62-4558-a62f-9c387528d2ec tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f" status: 200 len: 1314 microversion: 2.1 time: 0.167634 Aug 25 05:33:53.103002 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 232/482] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:52 2021] GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:53.312679 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-0a260695-213b-4242-9f51-93d41d486b76 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:53.314327 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-0a260695-213b-4242-9f51-93d41d486b76 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:53.324330 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0a260695-213b-4242-9f51-93d41d486b76 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:53.333519 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0a260695-213b-4242-9f51-93d41d486b76 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:53.333519 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0a260695-213b-4242-9f51-93d41d486b76 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:53.333519 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0a260695-213b-4242-9f51-93d41d486b76 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:53.341471 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-717a4fe0-978e-42fb-bbe9-9264f79b9228 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:53.343730 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-717a4fe0-978e-42fb-bbe9-9264f79b9228 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:53.354544 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-717a4fe0-978e-42fb-bbe9-9264f79b9228 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:53.355001 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-717a4fe0-978e-42fb-bbe9-9264f79b9228 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:53.355800 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-717a4fe0-978e-42fb-bbe9-9264f79b9228 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:53.356257 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-717a4fe0-978e-42fb-bbe9-9264f79b9228 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:53.428874 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-0a260695-213b-4242-9f51-93d41d486b76 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 38159 microversion: 2.20 time: 0.124032 Aug 25 05:33:53.429868 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 251/483] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:53 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 38159 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 25 05:33:53.453608 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-717a4fe0-978e-42fb-bbe9-9264f79b9228 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 38111 microversion: 2.1 time: 0.118843 Aug 25 05:33:53.454280 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 233/484] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:53 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 38111 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:33:53.476071 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5f435cdc-bca7-4ec8-8bc4-54508a7683b3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:53.476772 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5f435cdc-bca7-4ec8-8bc4-54508a7683b3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:53.484820 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5f435cdc-bca7-4ec8-8bc4-54508a7683b3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:53.485196 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5f435cdc-bca7-4ec8-8bc4-54508a7683b3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:53.487381 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5f435cdc-bca7-4ec8-8bc4-54508a7683b3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:53.487381 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5f435cdc-bca7-4ec8-8bc4-54508a7683b3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:53.624343 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-5f435cdc-bca7-4ec8-8bc4-54508a7683b3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:53.632470 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5f435cdc-bca7-4ec8-8bc4-54508a7683b3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1561 microversion: 2.1 time: 0.162220 Aug 25 05:33:53.633046 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 252/485] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:53 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:53.709848 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b59f70ab-d117-409b-a04e-1c249753c2e8 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:53.710661 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b59f70ab-d117-409b-a04e-1c249753c2e8 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:53.719533 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b59f70ab-d117-409b-a04e-1c249753c2e8 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:53.722343 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b59f70ab-d117-409b-a04e-1c249753c2e8 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:53.722343 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b59f70ab-d117-409b-a04e-1c249753c2e8 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:53.722343 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b59f70ab-d117-409b-a04e-1c249753c2e8 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:53.885027 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.objects.instance [None req-b59f70ab-d117-409b-a04e-1c249753c2e8 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lazy-loading 'services' on Instance uuid 2163e566-1832-40df-8925-09e54ae2974c {{(pid=108884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 05:33:54.119245 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-8b475e03-2128-46b6-a41c-5734bf7b27cd tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:54.119803 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-8b475e03-2128-46b6-a41c-5734bf7b27cd tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: fd62434d-18f1-4992-8f73-2ebec7b52a8f] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:54.126712 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8b475e03-2128-46b6-a41c-5734bf7b27cd tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:54.127158 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8b475e03-2128-46b6-a41c-5734bf7b27cd tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:54.127951 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8b475e03-2128-46b6-a41c-5734bf7b27cd tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:54.128360 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8b475e03-2128-46b6-a41c-5734bf7b27cd tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:54.168131 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b59f70ab-d117-409b-a04e-1c249753c2e8 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c/os-volume_attachments/3b82283f-d3a8-4c15-a4eb-48fc85e7d377" status: 202 len: 0 microversion: 2.1 time: 0.462201 Aug 25 05:33:54.189722 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 234/486] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 25 05:33:53 2021] DELETE /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c/os-volume_attachments/3b82283f-d3a8-4c15-a4eb-48fc85e7d377 => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:33:54.206543 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ed81f42d-7c04-4ffb-b97c-36124e72a8d4 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:54.209283 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ed81f42d-7c04-4ffb-b97c-36124e72a8d4 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:54.226041 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ed81f42d-7c04-4ffb-b97c-36124e72a8d4 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:54.227840 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ed81f42d-7c04-4ffb-b97c-36124e72a8d4 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:54.229975 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ed81f42d-7c04-4ffb-b97c-36124e72a8d4 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:54.243191 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ed81f42d-7c04-4ffb-b97c-36124e72a8d4 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:54.293459 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ed81f42d-7c04-4ffb-b97c-36124e72a8d4 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097647 Aug 25 05:33:54.297715 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 235/487] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:33:54 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:33:54.335599 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-8b475e03-2128-46b6-a41c-5734bf7b27cd tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:54.339194 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-8b475e03-2128-46b6-a41c-5734bf7b27cd tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f" status: 200 len: 1314 microversion: 2.1 time: 0.223175 Aug 25 05:33:54.340214 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 253/488] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:54 2021] GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:33:54.441780 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-03e99165-cd1c-4e9d-8744-ebf286fc5b25 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:54.442696 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-03e99165-cd1c-4e9d-8744-ebf286fc5b25 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:54.448754 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-03e99165-cd1c-4e9d-8744-ebf286fc5b25 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:54.449192 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-03e99165-cd1c-4e9d-8744-ebf286fc5b25 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:54.449987 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-03e99165-cd1c-4e9d-8744-ebf286fc5b25 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:54.451574 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-03e99165-cd1c-4e9d-8744-ebf286fc5b25 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:54.476614 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b27e2169-150e-46e9-8694-096cc6d21dcf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:54.478991 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b27e2169-150e-46e9-8694-096cc6d21dcf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:54.493789 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b27e2169-150e-46e9-8694-096cc6d21dcf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:54.494546 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b27e2169-150e-46e9-8694-096cc6d21dcf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:54.505152 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b27e2169-150e-46e9-8694-096cc6d21dcf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:54.506384 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b27e2169-150e-46e9-8694-096cc6d21dcf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:54.524184 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-03e99165-cd1c-4e9d-8744-ebf286fc5b25 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 38159 microversion: 2.20 time: 0.085945 Aug 25 05:33:54.524949 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 236/489] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:54 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 38159 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:33:54.663988 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b27e2169-150e-46e9-8694-096cc6d21dcf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 38111 microversion: 2.1 time: 0.197301 Aug 25 05:33:54.664660 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 254/490] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:54 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 38111 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:33:55.305688 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-f29c90aa-d495-4afd-923e-8f2a13d8f944 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:55.307080 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-f29c90aa-d495-4afd-923e-8f2a13d8f944 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:55.314521 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f29c90aa-d495-4afd-923e-8f2a13d8f944 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:55.315016 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f29c90aa-d495-4afd-923e-8f2a13d8f944 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:55.315856 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f29c90aa-d495-4afd-923e-8f2a13d8f944 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:55.316392 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f29c90aa-d495-4afd-923e-8f2a13d8f944 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:55.358985 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-f29c90aa-d495-4afd-923e-8f2a13d8f944 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057289 Aug 25 05:33:55.359752 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 237/491] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:33:55 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:33:55.360721 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c6423cc8-d7a9-491a-b57f-ad42e6defadf tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:55.361823 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c6423cc8-d7a9-491a-b57f-ad42e6defadf tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: fd62434d-18f1-4992-8f73-2ebec7b52a8f] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:55.369984 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c6423cc8-d7a9-491a-b57f-ad42e6defadf tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:55.370600 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c6423cc8-d7a9-491a-b57f-ad42e6defadf tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:55.371745 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c6423cc8-d7a9-491a-b57f-ad42e6defadf tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:55.372397 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c6423cc8-d7a9-491a-b57f-ad42e6defadf tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:55.532573 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-c6423cc8-d7a9-491a-b57f-ad42e6defadf tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:55.538110 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e9dfe253-3ead-47c3-8acf-90d5084ef346 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:55.539147 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e9dfe253-3ead-47c3-8acf-90d5084ef346 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:55.542982 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c6423cc8-d7a9-491a-b57f-ad42e6defadf tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f" status: 200 len: 1314 microversion: 2.1 time: 0.187811 Aug 25 05:33:55.546206 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 255/492] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:55 2021] GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:33:55.547393 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e9dfe253-3ead-47c3-8acf-90d5084ef346 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:55.547584 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e9dfe253-3ead-47c3-8acf-90d5084ef346 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:55.548265 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e9dfe253-3ead-47c3-8acf-90d5084ef346 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:55.548864 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e9dfe253-3ead-47c3-8acf-90d5084ef346 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:55.630718 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e9dfe253-3ead-47c3-8acf-90d5084ef346 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 38302 microversion: 2.20 time: 0.096048 Aug 25 05:33:55.631405 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 238/493] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:33:55 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 38302 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 25 05:33:55.642137 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-cffedb72-3f1b-4cfe-b4f5-4e1caa2b4066 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:55.642855 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-cffedb72-3f1b-4cfe-b4f5-4e1caa2b4066 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:55.648394 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cffedb72-3f1b-4cfe-b4f5-4e1caa2b4066 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:55.648830 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cffedb72-3f1b-4cfe-b4f5-4e1caa2b4066 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:55.649614 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cffedb72-3f1b-4cfe-b4f5-4e1caa2b4066 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:55.650037 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cffedb72-3f1b-4cfe-b4f5-4e1caa2b4066 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:55.678066 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3f586975-49ea-49c8-85b6-8360f1265098 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:55.678587 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-cffedb72-3f1b-4cfe-b4f5-4e1caa2b4066 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/ips" status: 200 len: 152 microversion: 2.20 time: 0.040760 Aug 25 05:33:55.679348 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3f586975-49ea-49c8-85b6-8360f1265098 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:55.679461 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 256/494] 10.222.0.42 () {60 vars in 1289 bytes} [Wed Aug 25 05:33:55 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:33:55.695766 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3f586975-49ea-49c8-85b6-8360f1265098 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:55.696214 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3f586975-49ea-49c8-85b6-8360f1265098 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:55.697085 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3f586975-49ea-49c8-85b6-8360f1265098 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:55.697555 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3f586975-49ea-49c8-85b6-8360f1265098 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:55.786645 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3f586975-49ea-49c8-85b6-8360f1265098 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 38178 microversion: 2.1 time: 0.112752 Aug 25 05:33:55.788380 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 239/495] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:55 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 38178 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:33:56.371982 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7cc8b30b-9ac9-4654-9eeb-a197f6b3742d tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:56.374805 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-7cc8b30b-9ac9-4654-9eeb-a197f6b3742d tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:56.382597 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7cc8b30b-9ac9-4654-9eeb-a197f6b3742d tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:56.383192 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7cc8b30b-9ac9-4654-9eeb-a197f6b3742d tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:56.384321 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7cc8b30b-9ac9-4654-9eeb-a197f6b3742d tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:56.384900 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7cc8b30b-9ac9-4654-9eeb-a197f6b3742d tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:56.440834 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-7cc8b30b-9ac9-4654-9eeb-a197f6b3742d tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073767 Aug 25 05:33:56.444361 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 257/496] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:33:56 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 05:33:56.562550 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-017875a1-904c-4a4d-994f-4e1369756cb7 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:56.563374 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-017875a1-904c-4a4d-994f-4e1369756cb7 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: fd62434d-18f1-4992-8f73-2ebec7b52a8f] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:56.570624 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-017875a1-904c-4a4d-994f-4e1369756cb7 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:56.571063 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-017875a1-904c-4a4d-994f-4e1369756cb7 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:56.571826 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-017875a1-904c-4a4d-994f-4e1369756cb7 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:56.572423 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-017875a1-904c-4a4d-994f-4e1369756cb7 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:56.744434 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-017875a1-904c-4a4d-994f-4e1369756cb7 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:56.756661 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-017875a1-904c-4a4d-994f-4e1369756cb7 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f" status: 200 len: 1314 microversion: 2.1 time: 0.198085 Aug 25 05:33:56.758064 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 240/497] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:56 2021] GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:33:56.798871 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-3ad0f848-f8eb-4e87-b01e-fa784447f991 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:56.799784 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-3ad0f848-f8eb-4e87-b01e-fa784447f991 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:56.805820 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3ad0f848-f8eb-4e87-b01e-fa784447f991 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:56.806290 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3ad0f848-f8eb-4e87-b01e-fa784447f991 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:56.807061 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3ad0f848-f8eb-4e87-b01e-fa784447f991 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:56.807496 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3ad0f848-f8eb-4e87-b01e-fa784447f991 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:57.785706 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-01634dd0-4f1a-48ec-a839-c89b8116fe84 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:57.786343 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-01634dd0-4f1a-48ec-a839-c89b8116fe84 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: fd62434d-18f1-4992-8f73-2ebec7b52a8f] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:57.792968 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-01634dd0-4f1a-48ec-a839-c89b8116fe84 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:57.793411 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-01634dd0-4f1a-48ec-a839-c89b8116fe84 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:57.794213 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-01634dd0-4f1a-48ec-a839-c89b8116fe84 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:57.795126 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-01634dd0-4f1a-48ec-a839-c89b8116fe84 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:57.927674 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-01634dd0-4f1a-48ec-a839-c89b8116fe84 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:57.934931 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-01634dd0-4f1a-48ec-a839-c89b8116fe84 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f" status: 200 len: 1314 microversion: 2.1 time: 0.152952 Aug 25 05:33:57.936082 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 241/498] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:57 2021] GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:58.953238 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-9c0f9506-4e84-47ae-8b31-b544c9636f72 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:58.953996 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-9c0f9506-4e84-47ae-8b31-b544c9636f72 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: fd62434d-18f1-4992-8f73-2ebec7b52a8f] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:33:58.959779 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9c0f9506-4e84-47ae-8b31-b544c9636f72 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:58.960214 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9c0f9506-4e84-47ae-8b31-b544c9636f72 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:58.960987 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9c0f9506-4e84-47ae-8b31-b544c9636f72 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:33:58.961420 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9c0f9506-4e84-47ae-8b31-b544c9636f72 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:33:59.090881 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-9c0f9506-4e84-47ae-8b31-b544c9636f72 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:59.099775 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-9c0f9506-4e84-47ae-8b31-b544c9636f72 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f" status: 200 len: 1314 microversion: 2.1 time: 0.149677 Aug 25 05:33:59.099775 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 242/499] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:33:58 2021] GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:34:00.115594 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-532a191d-9491-4ea1-8e79-010d508a0641 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:00.116320 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-532a191d-9491-4ea1-8e79-010d508a0641 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: fd62434d-18f1-4992-8f73-2ebec7b52a8f] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:00.122518 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-532a191d-9491-4ea1-8e79-010d508a0641 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:00.123595 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-532a191d-9491-4ea1-8e79-010d508a0641 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:00.124358 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-532a191d-9491-4ea1-8e79-010d508a0641 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:00.124788 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-532a191d-9491-4ea1-8e79-010d508a0641 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:00.247003 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-532a191d-9491-4ea1-8e79-010d508a0641 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:00.255166 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-532a191d-9491-4ea1-8e79-010d508a0641 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f" status: 200 len: 1314 microversion: 2.1 time: 0.143300 Aug 25 05:34:00.255831 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 243/500] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:00 2021] GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:34:01.272455 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3d7d8a5f-d648-41fd-82e7-95c1f2f8c33c tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:01.273139 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3d7d8a5f-d648-41fd-82e7-95c1f2f8c33c tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: fd62434d-18f1-4992-8f73-2ebec7b52a8f] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:01.279547 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3d7d8a5f-d648-41fd-82e7-95c1f2f8c33c tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:01.279991 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3d7d8a5f-d648-41fd-82e7-95c1f2f8c33c tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:01.280750 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3d7d8a5f-d648-41fd-82e7-95c1f2f8c33c tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:01.281176 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3d7d8a5f-d648-41fd-82e7-95c1f2f8c33c tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:01.407011 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-3d7d8a5f-d648-41fd-82e7-95c1f2f8c33c tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:01.414251 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3d7d8a5f-d648-41fd-82e7-95c1f2f8c33c tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f" status: 200 len: 1314 microversion: 2.1 time: 0.145448 Aug 25 05:34:01.414811 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 244/501] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:01 2021] GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:34:01.824196 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-3ad0f848-f8eb-4e87-b01e-fa784447f991 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 38240 microversion: 2.1 time: 5.028853 Aug 25 05:34:01.825479 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 258/502] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:33:56 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 38240 bytes in 5030 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:34:01.834920 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1508859f-b8fc-444e-9912-a95d6ae1f2ab tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:01.835404 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1508859f-b8fc-444e-9912-a95d6ae1f2ab tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:01.841555 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1508859f-b8fc-444e-9912-a95d6ae1f2ab tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:01.842302 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1508859f-b8fc-444e-9912-a95d6ae1f2ab tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:01.842865 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1508859f-b8fc-444e-9912-a95d6ae1f2ab tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:01.843297 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1508859f-b8fc-444e-9912-a95d6ae1f2ab tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:01.874774 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1508859f-b8fc-444e-9912-a95d6ae1f2ab tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/ips" status: 200 len: 144 microversion: 2.1 time: 0.043401 Aug 25 05:34:01.875346 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 245/503] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Aug 25 05:34:01 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/ips => generated 144 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:34:02.430977 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1fd4de4f-8ce9-4bb0-9e2c-9820fbf82d38 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:02.431662 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1fd4de4f-8ce9-4bb0-9e2c-9820fbf82d38 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: fd62434d-18f1-4992-8f73-2ebec7b52a8f] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:02.439346 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1fd4de4f-8ce9-4bb0-9e2c-9820fbf82d38 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:02.439797 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1fd4de4f-8ce9-4bb0-9e2c-9820fbf82d38 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:02.440560 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1fd4de4f-8ce9-4bb0-9e2c-9820fbf82d38 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:02.441050 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1fd4de4f-8ce9-4bb0-9e2c-9820fbf82d38 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:02.571428 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-1fd4de4f-8ce9-4bb0-9e2c-9820fbf82d38 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:02.581439 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1fd4de4f-8ce9-4bb0-9e2c-9820fbf82d38 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f" status: 200 len: 1314 microversion: 2.1 time: 0.152991 Aug 25 05:34:02.582190 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 259/504] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:02 2021] GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:03.598745 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7933fb6c-5b01-480e-90c6-56e824d3f91b tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:03.599449 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7933fb6c-5b01-480e-90c6-56e824d3f91b tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: fd62434d-18f1-4992-8f73-2ebec7b52a8f] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:03.606075 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7933fb6c-5b01-480e-90c6-56e824d3f91b tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:03.606518 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7933fb6c-5b01-480e-90c6-56e824d3f91b tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:03.607279 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7933fb6c-5b01-480e-90c6-56e824d3f91b tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:03.607924 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7933fb6c-5b01-480e-90c6-56e824d3f91b tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:03.739097 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-7933fb6c-5b01-480e-90c6-56e824d3f91b tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:03.747079 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7933fb6c-5b01-480e-90c6-56e824d3f91b tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f" status: 200 len: 1314 microversion: 2.1 time: 0.152277 Aug 25 05:34:03.748146 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 246/505] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:03 2021] GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:34:04.773229 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-0f8a7136-69b4-4f59-ae99-4374647efdad tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:04.773875 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-0f8a7136-69b4-4f59-ae99-4374647efdad tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: fd62434d-18f1-4992-8f73-2ebec7b52a8f] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:04.781115 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0f8a7136-69b4-4f59-ae99-4374647efdad tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:04.782248 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0f8a7136-69b4-4f59-ae99-4374647efdad tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:04.782521 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0f8a7136-69b4-4f59-ae99-4374647efdad tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:04.782955 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0f8a7136-69b4-4f59-ae99-4374647efdad tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:04.915227 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-0f8a7136-69b4-4f59-ae99-4374647efdad tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:04.924676 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-0f8a7136-69b4-4f59-ae99-4374647efdad tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f" status: 200 len: 1314 microversion: 2.1 time: 0.155299 Aug 25 05:34:04.925695 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 260/506] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:04 2021] GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:34:05.944553 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-12aa6037-e15b-4bc7-ab94-0d3925412993 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:05.945485 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-12aa6037-e15b-4bc7-ab94-0d3925412993 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: fd62434d-18f1-4992-8f73-2ebec7b52a8f] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:05.956488 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-12aa6037-e15b-4bc7-ab94-0d3925412993 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:05.956488 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-12aa6037-e15b-4bc7-ab94-0d3925412993 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:05.956488 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-12aa6037-e15b-4bc7-ab94-0d3925412993 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:05.956488 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-12aa6037-e15b-4bc7-ab94-0d3925412993 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:06.098112 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [req-fb457185-cae6-481d-a1c5-7886c82de196 req-19248594-5a3c-4ed9-9dad-5e47c96a7408 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd62434d-18f1-4992-8f73-2ebec7b52a8f", "name": "network-vif-plugged", "status": "completed", "tag": "541463f5-5003-4960-982e-f2b218548a88"}]} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:34:06.100504 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:34:06.100504 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: warnings.warn(msg) Aug 25 05:34:06.109382 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-fb457185-cae6-481d-a1c5-7886c82de196 req-19248594-5a3c-4ed9-9dad-5e47c96a7408 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:06.109853 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-fb457185-cae6-481d-a1c5-7886c82de196 req-19248594-5a3c-4ed9-9dad-5e47c96a7408 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:06.123146 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.compute.server_external_events [req-fb457185-cae6-481d-a1c5-7886c82de196 req-19248594-5a3c-4ed9-9dad-5e47c96a7408 service nova] Creating event network-vif-plugged:541463f5-5003-4960-982e-f2b218548a88 for instance fd62434d-18f1-4992-8f73-2ebec7b52a8f on hv-cinder-78662 Aug 25 05:34:06.124339 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-12aa6037-e15b-4bc7-ab94-0d3925412993 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:06.128116 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [req-fb457185-cae6-481d-a1c5-7886c82de196 req-19248594-5a3c-4ed9-9dad-5e47c96a7408 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033604 Aug 25 05:34:06.128694 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 261/507] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:34:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:34:06.137261 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-12aa6037-e15b-4bc7-ab94-0d3925412993 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f" status: 200 len: 1314 microversion: 2.1 time: 0.196085 Aug 25 05:34:06.140137 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 247/508] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:05 2021] GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:07.162700 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7b9ed3c7-54d1-4ec0-9af3-8defd005231f tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:07.164536 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-7b9ed3c7-54d1-4ec0-9af3-8defd005231f tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: fd62434d-18f1-4992-8f73-2ebec7b52a8f] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:07.175386 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7b9ed3c7-54d1-4ec0-9af3-8defd005231f tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:07.176060 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7b9ed3c7-54d1-4ec0-9af3-8defd005231f tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:07.177484 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7b9ed3c7-54d1-4ec0-9af3-8defd005231f tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:07.178209 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7b9ed3c7-54d1-4ec0-9af3-8defd005231f tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:07.318949 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-7b9ed3c7-54d1-4ec0-9af3-8defd005231f tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:07.327046 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-7b9ed3c7-54d1-4ec0-9af3-8defd005231f tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f" status: 200 len: 1314 microversion: 2.1 time: 0.172986 Aug 25 05:34:07.327760 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 262/509] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:07 2021] GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:08.344221 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1160001e-a4f5-4660-8764-07eb406b741f tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:08.344969 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1160001e-a4f5-4660-8764-07eb406b741f tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: fd62434d-18f1-4992-8f73-2ebec7b52a8f] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:08.352214 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1160001e-a4f5-4660-8764-07eb406b741f tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:08.352653 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1160001e-a4f5-4660-8764-07eb406b741f tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:08.353425 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1160001e-a4f5-4660-8764-07eb406b741f tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:08.353884 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1160001e-a4f5-4660-8764-07eb406b741f tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:08.511051 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-1160001e-a4f5-4660-8764-07eb406b741f tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:08.521937 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1160001e-a4f5-4660-8764-07eb406b741f tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f" status: 200 len: 1314 microversion: 2.1 time: 0.181253 Aug 25 05:34:08.522527 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 248/510] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:08 2021] GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:09.178859 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-53d98694-2415-4e0b-8c7e-1cfe90262873 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:34:09.182704 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-53d98694-2415-4e0b-8c7e-1cfe90262873 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:09.194742 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-53d98694-2415-4e0b-8c7e-1cfe90262873 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:09.195327 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-53d98694-2415-4e0b-8c7e-1cfe90262873 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:09.196104 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-53d98694-2415-4e0b-8c7e-1cfe90262873 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:09.196533 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-53d98694-2415-4e0b-8c7e-1cfe90262873 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:09.222997 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.objects.instance [None req-53d98694-2415-4e0b-8c7e-1cfe90262873 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lazy-loading 'flavor' on Instance uuid 4cb635d4-76ba-4143-8f4d-a64c720966da {{(pid=108885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 05:34:09.542755 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-2b8f098d-5c61-492e-965d-8df137ac5867 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:09.543369 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-2b8f098d-5c61-492e-965d-8df137ac5867 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: fd62434d-18f1-4992-8f73-2ebec7b52a8f] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:09.549731 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2b8f098d-5c61-492e-965d-8df137ac5867 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:09.550175 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2b8f098d-5c61-492e-965d-8df137ac5867 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:09.550942 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2b8f098d-5c61-492e-965d-8df137ac5867 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:09.551393 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2b8f098d-5c61-492e-965d-8df137ac5867 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:09.711951 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-2b8f098d-5c61-492e-965d-8df137ac5867 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:09.711951 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-2b8f098d-5c61-492e-965d-8df137ac5867 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f" status: 200 len: 1499 microversion: 2.1 time: 0.169004 Aug 25 05:34:09.711951 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 249/511] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:09 2021] GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f => generated 1499 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:34:09.870219 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-53d98694-2415-4e0b-8c7e-1cfe90262873 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 202 len: 0 microversion: 2.20 time: 0.713261 Aug 25 05:34:09.870853 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 263/512] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:34:09 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 0 bytes in 715 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 05:34:09.879838 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3d270b88-fb75-4a5a-9eed-8901cb84247e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:09.880457 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3d270b88-fb75-4a5a-9eed-8901cb84247e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:09.886732 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3d270b88-fb75-4a5a-9eed-8901cb84247e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:09.887180 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3d270b88-fb75-4a5a-9eed-8901cb84247e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:09.888073 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3d270b88-fb75-4a5a-9eed-8901cb84247e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:09.888508 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3d270b88-fb75-4a5a-9eed-8901cb84247e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:10.023045 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-3d270b88-fb75-4a5a-9eed-8901cb84247e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:10.040571 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-3d270b88-fb75-4a5a-9eed-8901cb84247e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:10.040571 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-3d270b88-fb75-4a5a-9eed-8901cb84247e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:10.040571 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3d270b88-fb75-4a5a-9eed-8901cb84247e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1724 microversion: 2.20 time: 0.158771 Aug 25 05:34:10.043261 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 250/513] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:34:09 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:34:10.929079 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ed6b6117-e6f9-4494-a8c0-7f0a6bcadc2a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0e72902-9f29-47b6-a3f4-dc9d4ddabdc6"}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:34:10.930259 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ed6b6117-e6f9-4494-a8c0-7f0a6bcadc2a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:10.937592 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ed6b6117-e6f9-4494-a8c0-7f0a6bcadc2a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:10.942490 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ed6b6117-e6f9-4494-a8c0-7f0a6bcadc2a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:10.942490 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ed6b6117-e6f9-4494-a8c0-7f0a6bcadc2a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:10.942490 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ed6b6117-e6f9-4494-a8c0-7f0a6bcadc2a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:11.063581 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7c6606e7-2dd5-4767-a48c-1683b95c7480 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:11.064308 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7c6606e7-2dd5-4767-a48c-1683b95c7480 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:11.070405 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7c6606e7-2dd5-4767-a48c-1683b95c7480 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:11.070847 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7c6606e7-2dd5-4767-a48c-1683b95c7480 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:11.071665 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7c6606e7-2dd5-4767-a48c-1683b95c7480 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:11.072383 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7c6606e7-2dd5-4767-a48c-1683b95c7480 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:11.259281 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-7c6606e7-2dd5-4767-a48c-1683b95c7480 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:11.269371 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-7c6606e7-2dd5-4767-a48c-1683b95c7480 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:11.271156 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-7c6606e7-2dd5-4767-a48c-1683b95c7480 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:11.272951 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7c6606e7-2dd5-4767-a48c-1683b95c7480 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1724 microversion: 2.20 time: 0.213360 Aug 25 05:34:11.273512 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 251/514] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:34:11 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:34:11.893291 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1ff2d6f7-e644-4191-9ce7-2a5776d045d8 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:11.893892 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1ff2d6f7-e644-4191-9ce7-2a5776d045d8 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: fd62434d-18f1-4992-8f73-2ebec7b52a8f] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:11.907961 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1ff2d6f7-e644-4191-9ce7-2a5776d045d8 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:11.909038 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1ff2d6f7-e644-4191-9ce7-2a5776d045d8 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:11.910442 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1ff2d6f7-e644-4191-9ce7-2a5776d045d8 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:11.911103 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1ff2d6f7-e644-4191-9ce7-2a5776d045d8 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:11.948669 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1ff2d6f7-e644-4191-9ce7-2a5776d045d8 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: fd62434d-18f1-4992-8f73-2ebec7b52a8f] Going to try to terminate instance {{(pid=108884) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 25 05:34:12.339962 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1ff2d6f7-e644-4191-9ce7-2a5776d045d8 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "DELETE /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f" status: 204 len: 0 microversion: 2.1 time: 0.450453 Aug 25 05:34:12.346813 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 252/515] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 25 05:34:11 2021] DELETE /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 05:34:12.346813 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-797209f3-4908-45c4-a000-45b05822aa96 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:12.347607 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-797209f3-4908-45c4-a000-45b05822aa96 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:12.353800 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-797209f3-4908-45c4-a000-45b05822aa96 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:12.354251 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-797209f3-4908-45c4-a000-45b05822aa96 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:12.355029 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-797209f3-4908-45c4-a000-45b05822aa96 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:12.355467 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-797209f3-4908-45c4-a000-45b05822aa96 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:12.492456 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-797209f3-4908-45c4-a000-45b05822aa96 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:12.500388 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-797209f3-4908-45c4-a000-45b05822aa96 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:12.501879 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-797209f3-4908-45c4-a000-45b05822aa96 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:12.503012 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-797209f3-4908-45c4-a000-45b05822aa96 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1724 microversion: 2.20 time: 0.160989 Aug 25 05:34:12.503558 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 253/516] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:34:12 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:34:12.508135 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e6f19026-8b3d-481c-be11-3b9bdc755d76 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:12.508551 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e6f19026-8b3d-481c-be11-3b9bdc755d76 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: fd62434d-18f1-4992-8f73-2ebec7b52a8f] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:12.516784 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e6f19026-8b3d-481c-be11-3b9bdc755d76 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:12.517415 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e6f19026-8b3d-481c-be11-3b9bdc755d76 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:12.518833 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e6f19026-8b3d-481c-be11-3b9bdc755d76 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:12.519552 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e6f19026-8b3d-481c-be11-3b9bdc755d76 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:12.581190 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ed6b6117-e6f9-4494-a8c0-7f0a6bcadc2a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.655427 Aug 25 05:34:12.581766 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 264/517] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 25 05:34:10 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 194 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:34:12.657197 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e6f19026-8b3d-481c-be11-3b9bdc755d76 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:12.665216 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e6f19026-8b3d-481c-be11-3b9bdc755d76 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f" status: 200 len: 1505 microversion: 2.1 time: 0.160631 Aug 25 05:34:12.665829 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 254/518] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:12 2021] GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:13.527153 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f276cdeb-bf53-408c-b668-f8b334479ff2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:13.527831 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f276cdeb-bf53-408c-b668-f8b334479ff2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:13.535330 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f276cdeb-bf53-408c-b668-f8b334479ff2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:13.535813 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f276cdeb-bf53-408c-b668-f8b334479ff2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:13.536583 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f276cdeb-bf53-408c-b668-f8b334479ff2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:13.537089 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f276cdeb-bf53-408c-b668-f8b334479ff2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:13.685077 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-f276cdeb-bf53-408c-b668-f8b334479ff2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:13.686617 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e1cc402b-7b8f-4f60-a9cd-ce4551c0e650 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:13.687267 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e1cc402b-7b8f-4f60-a9cd-ce4551c0e650 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: fd62434d-18f1-4992-8f73-2ebec7b52a8f] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:13.694946 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e1cc402b-7b8f-4f60-a9cd-ce4551c0e650 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:13.694946 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e1cc402b-7b8f-4f60-a9cd-ce4551c0e650 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:13.695659 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e1cc402b-7b8f-4f60-a9cd-ce4551c0e650 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:13.696307 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e1cc402b-7b8f-4f60-a9cd-ce4551c0e650 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:13.700801 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-f276cdeb-bf53-408c-b668-f8b334479ff2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:13.703342 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-f276cdeb-bf53-408c-b668-f8b334479ff2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:13.705399 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f276cdeb-bf53-408c-b668-f8b334479ff2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1724 microversion: 2.20 time: 0.183168 Aug 25 05:34:13.717713 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 265/519] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:34:13 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:34:13.850081 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e1cc402b-7b8f-4f60-a9cd-ce4551c0e650 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:13.858432 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e1cc402b-7b8f-4f60-a9cd-ce4551c0e650 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f" status: 200 len: 1505 microversion: 2.1 time: 0.176573 Aug 25 05:34:13.859184 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 255/520] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:13 2021] GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f => generated 1505 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:34:14.106231 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-174437b6-0221-4b53-8532-3a8c832d0904 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:14.106715 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-174437b6-0221-4b53-8532-3a8c832d0904 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:14.113836 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-174437b6-0221-4b53-8532-3a8c832d0904 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:14.114294 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-174437b6-0221-4b53-8532-3a8c832d0904 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:14.115542 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-174437b6-0221-4b53-8532-3a8c832d0904 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:14.115542 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-174437b6-0221-4b53-8532-3a8c832d0904 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:14.142016 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-174437b6-0221-4b53-8532-3a8c832d0904 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Going to try to terminate instance {{(pid=108885) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 25 05:34:14.549925 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-174437b6-0221-4b53-8532-3a8c832d0904 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 204 len: 0 microversion: 2.1 time: 0.447205 Aug 25 05:34:14.550532 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 266/521] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 25 05:34:14 2021] DELETE /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 05:34:14.559351 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-daeef673-f99c-4ea9-a76c-f0b16fc2ca0e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:14.559959 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-daeef673-f99c-4ea9-a76c-f0b16fc2ca0e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:14.567109 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-daeef673-f99c-4ea9-a76c-f0b16fc2ca0e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:14.567587 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-daeef673-f99c-4ea9-a76c-f0b16fc2ca0e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:14.568356 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-daeef673-f99c-4ea9-a76c-f0b16fc2ca0e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:14.568789 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-daeef673-f99c-4ea9-a76c-f0b16fc2ca0e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:14.697931 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-daeef673-f99c-4ea9-a76c-f0b16fc2ca0e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:14.706448 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-daeef673-f99c-4ea9-a76c-f0b16fc2ca0e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1506 microversion: 2.1 time: 0.151469 Aug 25 05:34:14.707017 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 256/522] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:14 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:14.725479 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-81edafb1-4f85-4443-8d66-eca5bf110897 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:14.730528 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-81edafb1-4f85-4443-8d66-eca5bf110897 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:14.732451 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-81edafb1-4f85-4443-8d66-eca5bf110897 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:14.732888 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-81edafb1-4f85-4443-8d66-eca5bf110897 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:14.733674 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-81edafb1-4f85-4443-8d66-eca5bf110897 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:14.734100 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-81edafb1-4f85-4443-8d66-eca5bf110897 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:14.877050 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b6658a3a-1cc0-4c41-a15f-0d169d791c55 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:14.878164 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b6658a3a-1cc0-4c41-a15f-0d169d791c55 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: fd62434d-18f1-4992-8f73-2ebec7b52a8f] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:14.885013 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b6658a3a-1cc0-4c41-a15f-0d169d791c55 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:14.885457 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b6658a3a-1cc0-4c41-a15f-0d169d791c55 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:14.886266 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b6658a3a-1cc0-4c41-a15f-0d169d791c55 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:14.886857 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b6658a3a-1cc0-4c41-a15f-0d169d791c55 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:14.887141 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-81edafb1-4f85-4443-8d66-eca5bf110897 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:14.897326 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-81edafb1-4f85-4443-8d66-eca5bf110897 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:14.899147 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-81edafb1-4f85-4443-8d66-eca5bf110897 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:14.900411 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-81edafb1-4f85-4443-8d66-eca5bf110897 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1724 microversion: 2.20 time: 0.179385 Aug 25 05:34:14.901315 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 267/523] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:34:14 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:34:15.017191 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-b6658a3a-1cc0-4c41-a15f-0d169d791c55 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:15.025882 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b6658a3a-1cc0-4c41-a15f-0d169d791c55 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f" status: 200 len: 1505 microversion: 2.1 time: 0.153596 Aug 25 05:34:15.026565 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 257/524] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:14 2021] GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:34:15.389073 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [req-eede3d82-d1e4-4607-8265-216fe56a06f7 req-b40f96cb-4359-412d-b78f-a3d974d41017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd62434d-18f1-4992-8f73-2ebec7b52a8f", "name": "network-vif-deleted", "tag": "541463f5-5003-4960-982e-f2b218548a88"}]} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:34:15.390755 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:34:15.390755 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: warnings.warn(msg) Aug 25 05:34:15.397434 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-eede3d82-d1e4-4607-8265-216fe56a06f7 req-b40f96cb-4359-412d-b78f-a3d974d41017 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:15.408463 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-eede3d82-d1e4-4607-8265-216fe56a06f7 req-b40f96cb-4359-412d-b78f-a3d974d41017 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:15.408738 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.compute.server_external_events [req-eede3d82-d1e4-4607-8265-216fe56a06f7 req-b40f96cb-4359-412d-b78f-a3d974d41017 service nova] Creating event network-vif-deleted:541463f5-5003-4960-982e-f2b218548a88 for instance fd62434d-18f1-4992-8f73-2ebec7b52a8f on hv-cinder-78662 Aug 25 05:34:15.413549 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [req-eede3d82-d1e4-4607-8265-216fe56a06f7 req-b40f96cb-4359-412d-b78f-a3d974d41017 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028145 Aug 25 05:34:15.414126 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 268/525] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:34:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:34:15.723627 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-21f2eddd-eac4-40bf-9e22-bdd79eba03e4 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:15.724344 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-21f2eddd-eac4-40bf-9e22-bdd79eba03e4 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:15.730167 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-21f2eddd-eac4-40bf-9e22-bdd79eba03e4 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:15.730614 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-21f2eddd-eac4-40bf-9e22-bdd79eba03e4 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:15.731382 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-21f2eddd-eac4-40bf-9e22-bdd79eba03e4 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:15.731817 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-21f2eddd-eac4-40bf-9e22-bdd79eba03e4 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:15.774483 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 05:34:15.774762 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: Wed Aug 25 05:34:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 (ip 10.222.0.42) !!! Aug 25 05:34:15.865667 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-21f2eddd-eac4-40bf-9e22-bdd79eba03e4 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:15.875005 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-21f2eddd-eac4-40bf-9e22-bdd79eba03e4 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1506 microversion: 2.1 time: 0.155029 Aug 25 05:34:15.875936 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 258/526] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:15 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:15.921801 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-065f12bb-bddd-415a-a278-e8e5252cba3c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:15.922494 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-065f12bb-bddd-415a-a278-e8e5252cba3c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:15.928803 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-065f12bb-bddd-415a-a278-e8e5252cba3c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:15.929245 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-065f12bb-bddd-415a-a278-e8e5252cba3c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:15.930053 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-065f12bb-bddd-415a-a278-e8e5252cba3c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:15.930488 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-065f12bb-bddd-415a-a278-e8e5252cba3c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:16.043166 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d88c00e5-c560-48e5-8dd2-7a8b934d741c tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:16.043776 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-d88c00e5-c560-48e5-8dd2-7a8b934d741c tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: fd62434d-18f1-4992-8f73-2ebec7b52a8f] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:16.049747 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d88c00e5-c560-48e5-8dd2-7a8b934d741c tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:16.050194 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d88c00e5-c560-48e5-8dd2-7a8b934d741c tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:16.050973 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d88c00e5-c560-48e5-8dd2-7a8b934d741c tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:16.051396 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d88c00e5-c560-48e5-8dd2-7a8b934d741c tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:16.067710 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-065f12bb-bddd-415a-a278-e8e5252cba3c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:16.077328 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-065f12bb-bddd-415a-a278-e8e5252cba3c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:16.078047 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-065f12bb-bddd-415a-a278-e8e5252cba3c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:16.079226 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-065f12bb-bddd-415a-a278-e8e5252cba3c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1724 microversion: 2.20 time: 0.162626 Aug 25 05:34:16.079799 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 269/527] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:34:15 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:34:16.118018 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-d88c00e5-c560-48e5-8dd2-7a8b934d741c tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:16.125713 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d88c00e5-c560-48e5-8dd2-7a8b934d741c tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f" status: 200 len: 1299 microversion: 2.1 time: 0.086572 Aug 25 05:34:16.126298 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 259/528] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:16 2021] GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f => generated 1299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:16.899137 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5977eb43-1af0-4b18-b6b8-2ea515e21a7c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:16.899790 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5977eb43-1af0-4b18-b6b8-2ea515e21a7c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:16.906436 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5977eb43-1af0-4b18-b6b8-2ea515e21a7c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:16.906872 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5977eb43-1af0-4b18-b6b8-2ea515e21a7c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:16.907645 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5977eb43-1af0-4b18-b6b8-2ea515e21a7c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:16.908067 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5977eb43-1af0-4b18-b6b8-2ea515e21a7c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:17.039005 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-5977eb43-1af0-4b18-b6b8-2ea515e21a7c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:17.047205 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5977eb43-1af0-4b18-b6b8-2ea515e21a7c tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1506 microversion: 2.1 time: 0.152037 Aug 25 05:34:17.047773 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 270/529] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:16 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:17.098428 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-185f083c-9a4e-4b1a-8fb2-1a0c503afe27 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:17.099055 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-185f083c-9a4e-4b1a-8fb2-1a0c503afe27 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:17.105019 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-185f083c-9a4e-4b1a-8fb2-1a0c503afe27 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:17.105458 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-185f083c-9a4e-4b1a-8fb2-1a0c503afe27 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:17.106252 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-185f083c-9a4e-4b1a-8fb2-1a0c503afe27 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:17.106674 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-185f083c-9a4e-4b1a-8fb2-1a0c503afe27 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:17.142712 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-51ac6158-0ffe-4231-9c52-fefc400a28fe tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:17.143308 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-51ac6158-0ffe-4231-9c52-fefc400a28fe tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: fd62434d-18f1-4992-8f73-2ebec7b52a8f] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:17.151042 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-51ac6158-0ffe-4231-9c52-fefc400a28fe tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:17.151042 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-51ac6158-0ffe-4231-9c52-fefc400a28fe tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:17.151042 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-51ac6158-0ffe-4231-9c52-fefc400a28fe tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:17.151492 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-51ac6158-0ffe-4231-9c52-fefc400a28fe tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:17.238855 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-51ac6158-0ffe-4231-9c52-fefc400a28fe tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:17.246655 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-51ac6158-0ffe-4231-9c52-fefc400a28fe tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f" status: 200 len: 1299 microversion: 2.1 time: 0.107702 Aug 25 05:34:17.247231 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 271/530] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:17 2021] GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f => generated 1299 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:34:17.283217 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-185f083c-9a4e-4b1a-8fb2-1a0c503afe27 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:17.292127 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-185f083c-9a4e-4b1a-8fb2-1a0c503afe27 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:17.293660 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-185f083c-9a4e-4b1a-8fb2-1a0c503afe27 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:17.295465 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-185f083c-9a4e-4b1a-8fb2-1a0c503afe27 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1724 microversion: 2.20 time: 0.200822 Aug 25 05:34:17.296023 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 260/531] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:34:17 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:34:18.065109 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-3da425ae-9ab6-4e7f-bf17-e26bfcdd9277 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:18.065981 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-3da425ae-9ab6-4e7f-bf17-e26bfcdd9277 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:18.072084 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3da425ae-9ab6-4e7f-bf17-e26bfcdd9277 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:18.072539 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3da425ae-9ab6-4e7f-bf17-e26bfcdd9277 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:18.073310 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3da425ae-9ab6-4e7f-bf17-e26bfcdd9277 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:18.073776 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3da425ae-9ab6-4e7f-bf17-e26bfcdd9277 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:18.214234 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-3da425ae-9ab6-4e7f-bf17-e26bfcdd9277 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:18.223347 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-3da425ae-9ab6-4e7f-bf17-e26bfcdd9277 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1506 microversion: 2.1 time: 0.162117 Aug 25 05:34:18.224160 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 272/532] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:18 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:18.266730 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-29b3c7cd-3827-472f-967b-7e8fd6444c6b tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:18.267348 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-29b3c7cd-3827-472f-967b-7e8fd6444c6b tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: fd62434d-18f1-4992-8f73-2ebec7b52a8f] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:18.274268 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-29b3c7cd-3827-472f-967b-7e8fd6444c6b tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:18.275005 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-29b3c7cd-3827-472f-967b-7e8fd6444c6b tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:18.276111 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-29b3c7cd-3827-472f-967b-7e8fd6444c6b tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:18.276553 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-29b3c7cd-3827-472f-967b-7e8fd6444c6b tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:18.311753 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-29b3c7cd-3827-472f-967b-7e8fd6444c6b tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:18.312202 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-29b3c7cd-3827-472f-967b-7e8fd6444c6b tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:18.312806 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.objects.instance [None req-29b3c7cd-3827-472f-967b-7e8fd6444c6b tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lazy-loading 'fault' on Instance uuid fd62434d-18f1-4992-8f73-2ebec7b52a8f {{(pid=108884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 05:34:18.353196 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-50cf52fd-4c84-4343-9b77-3bac3901f9c1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:18.354140 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-50cf52fd-4c84-4343-9b77-3bac3901f9c1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:18.360014 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-29b3c7cd-3827-472f-967b-7e8fd6444c6b tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:18.361701 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-50cf52fd-4c84-4343-9b77-3bac3901f9c1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:18.362155 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-50cf52fd-4c84-4343-9b77-3bac3901f9c1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:18.362945 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-50cf52fd-4c84-4343-9b77-3bac3901f9c1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:18.363373 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-50cf52fd-4c84-4343-9b77-3bac3901f9c1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:18.367924 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-29b3c7cd-3827-472f-967b-7e8fd6444c6b tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f" status: 200 len: 1304 microversion: 2.1 time: 0.106861 Aug 25 05:34:18.368535 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 261/533] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:18 2021] GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:18.494275 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-50cf52fd-4c84-4343-9b77-3bac3901f9c1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:18.503476 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-50cf52fd-4c84-4343-9b77-3bac3901f9c1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:18.504954 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-50cf52fd-4c84-4343-9b77-3bac3901f9c1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:18.506155 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-50cf52fd-4c84-4343-9b77-3bac3901f9c1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1724 microversion: 2.20 time: 0.156695 Aug 25 05:34:18.506710 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 273/534] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:34:18 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:34:19.243759 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d101c50c-3182-45ba-b826-fc17fb2af830 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:19.244412 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-d101c50c-3182-45ba-b826-fc17fb2af830 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:19.251013 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d101c50c-3182-45ba-b826-fc17fb2af830 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:19.251459 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d101c50c-3182-45ba-b826-fc17fb2af830 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:19.252520 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d101c50c-3182-45ba-b826-fc17fb2af830 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:19.252956 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d101c50c-3182-45ba-b826-fc17fb2af830 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:19.386557 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-362d4116-cb00-4aad-b8cf-f62f9bd7a25d tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:19.387274 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-362d4116-cb00-4aad-b8cf-f62f9bd7a25d tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: fd62434d-18f1-4992-8f73-2ebec7b52a8f] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:19.391401 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-d101c50c-3182-45ba-b826-fc17fb2af830 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:19.395278 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-362d4116-cb00-4aad-b8cf-f62f9bd7a25d tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:19.395780 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-362d4116-cb00-4aad-b8cf-f62f9bd7a25d tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:19.396719 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-362d4116-cb00-4aad-b8cf-f62f9bd7a25d tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:19.397547 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-362d4116-cb00-4aad-b8cf-f62f9bd7a25d tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:19.398965 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d101c50c-3182-45ba-b826-fc17fb2af830 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1506 microversion: 2.1 time: 0.158825 Aug 25 05:34:19.399548 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 262/535] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:19 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:19.429335 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-362d4116-cb00-4aad-b8cf-f62f9bd7a25d tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:19.429829 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-362d4116-cb00-4aad-b8cf-f62f9bd7a25d tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:19.430268 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.objects.instance [None req-362d4116-cb00-4aad-b8cf-f62f9bd7a25d tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lazy-loading 'fault' on Instance uuid fd62434d-18f1-4992-8f73-2ebec7b52a8f {{(pid=108885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 05:34:19.471002 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-362d4116-cb00-4aad-b8cf-f62f9bd7a25d tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:19.478431 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-362d4116-cb00-4aad-b8cf-f62f9bd7a25d tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f" status: 200 len: 1304 microversion: 2.1 time: 0.095929 Aug 25 05:34:19.479032 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 274/536] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:19 2021] GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:19.524938 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-016c52f0-6b5c-4637-bcc3-d36e6385ed16 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:19.525575 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-016c52f0-6b5c-4637-bcc3-d36e6385ed16 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:19.532802 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-016c52f0-6b5c-4637-bcc3-d36e6385ed16 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:19.533409 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-016c52f0-6b5c-4637-bcc3-d36e6385ed16 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:19.534280 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-016c52f0-6b5c-4637-bcc3-d36e6385ed16 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:19.534810 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-016c52f0-6b5c-4637-bcc3-d36e6385ed16 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:19.668924 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-016c52f0-6b5c-4637-bcc3-d36e6385ed16 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:19.677855 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-016c52f0-6b5c-4637-bcc3-d36e6385ed16 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:19.679350 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-016c52f0-6b5c-4637-bcc3-d36e6385ed16 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:19.680525 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-016c52f0-6b5c-4637-bcc3-d36e6385ed16 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1724 microversion: 2.20 time: 0.159362 Aug 25 05:34:19.681079 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 263/537] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:34:19 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:34:20.417655 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-143ab96a-e0e9-4cfe-95e6-b0e8f01eb38a tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:20.418260 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-143ab96a-e0e9-4cfe-95e6-b0e8f01eb38a tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:20.424607 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-143ab96a-e0e9-4cfe-95e6-b0e8f01eb38a tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:20.425047 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-143ab96a-e0e9-4cfe-95e6-b0e8f01eb38a tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:20.425848 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-143ab96a-e0e9-4cfe-95e6-b0e8f01eb38a tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:20.426283 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-143ab96a-e0e9-4cfe-95e6-b0e8f01eb38a tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:20.495469 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-de460536-00b7-48f4-a682-277533c691f1 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:20.496894 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-de460536-00b7-48f4-a682-277533c691f1 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: fd62434d-18f1-4992-8f73-2ebec7b52a8f] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:20.504228 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-de460536-00b7-48f4-a682-277533c691f1 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:20.504677 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-de460536-00b7-48f4-a682-277533c691f1 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:20.505448 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-de460536-00b7-48f4-a682-277533c691f1 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:20.505901 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-de460536-00b7-48f4-a682-277533c691f1 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:20.538230 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-de460536-00b7-48f4-a682-277533c691f1 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:20.538676 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-de460536-00b7-48f4-a682-277533c691f1 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:20.539123 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.objects.instance [None req-de460536-00b7-48f4-a682-277533c691f1 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lazy-loading 'fault' on Instance uuid fd62434d-18f1-4992-8f73-2ebec7b52a8f {{(pid=108884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 05:34:20.569471 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-143ab96a-e0e9-4cfe-95e6-b0e8f01eb38a tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:20.577063 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-143ab96a-e0e9-4cfe-95e6-b0e8f01eb38a tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1506 microversion: 2.1 time: 0.163291 Aug 25 05:34:20.577642 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 275/538] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:20 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:20.584674 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-de460536-00b7-48f4-a682-277533c691f1 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:20.592206 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-de460536-00b7-48f4-a682-277533c691f1 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f" status: 200 len: 1304 microversion: 2.1 time: 0.100381 Aug 25 05:34:20.592768 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 264/539] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:20 2021] GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:34:20.698281 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-8a340f17-61c0-4e0d-9eec-37e99860d56c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:20.698891 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-8a340f17-61c0-4e0d-9eec-37e99860d56c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:20.704788 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8a340f17-61c0-4e0d-9eec-37e99860d56c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:20.705229 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8a340f17-61c0-4e0d-9eec-37e99860d56c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:20.706030 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8a340f17-61c0-4e0d-9eec-37e99860d56c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:20.706459 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8a340f17-61c0-4e0d-9eec-37e99860d56c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:21.036638 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-8a340f17-61c0-4e0d-9eec-37e99860d56c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:21.045772 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-8a340f17-61c0-4e0d-9eec-37e99860d56c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:21.047395 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-8a340f17-61c0-4e0d-9eec-37e99860d56c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:21.048544 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-8a340f17-61c0-4e0d-9eec-37e99860d56c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1724 microversion: 2.20 time: 0.353936 Aug 25 05:34:21.049100 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 276/540] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:34:20 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1724 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:34:21.594081 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a63fa919-58da-4eea-a679-b0e429517731 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:21.594687 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a63fa919-58da-4eea-a679-b0e429517731 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:21.600520 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a63fa919-58da-4eea-a679-b0e429517731 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:21.601173 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a63fa919-58da-4eea-a679-b0e429517731 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:21.601973 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a63fa919-58da-4eea-a679-b0e429517731 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:21.603684 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a63fa919-58da-4eea-a679-b0e429517731 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:21.608494 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-23342d12-565e-4737-b4ec-b4d572fd7b4f tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:21.609104 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-23342d12-565e-4737-b4ec-b4d572fd7b4f tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: fd62434d-18f1-4992-8f73-2ebec7b52a8f] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:21.615643 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-23342d12-565e-4737-b4ec-b4d572fd7b4f tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:21.616338 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-23342d12-565e-4737-b4ec-b4d572fd7b4f tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:21.617284 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-23342d12-565e-4737-b4ec-b4d572fd7b4f tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:21.617758 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-23342d12-565e-4737-b4ec-b4d572fd7b4f tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:21.650431 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-23342d12-565e-4737-b4ec-b4d572fd7b4f tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:21.650830 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-23342d12-565e-4737-b4ec-b4d572fd7b4f tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:21.651175 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.objects.instance [None req-23342d12-565e-4737-b4ec-b4d572fd7b4f tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lazy-loading 'fault' on Instance uuid fd62434d-18f1-4992-8f73-2ebec7b52a8f {{(pid=108885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 05:34:21.694684 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-23342d12-565e-4737-b4ec-b4d572fd7b4f tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ae7c08cdf04609a1ba446d0960a7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376eee360a8940d998c21a88309ac903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:21.702610 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-23342d12-565e-4737-b4ec-b4d572fd7b4f tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f" status: 200 len: 1304 microversion: 2.1 time: 0.097667 Aug 25 05:34:21.703185 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 277/541] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:21 2021] GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:34:21.753472 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-a63fa919-58da-4eea-a679-b0e429517731 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:21.760867 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a63fa919-58da-4eea-a679-b0e429517731 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1506 microversion: 2.1 time: 0.170766 Aug 25 05:34:21.761423 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 265/542] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:21 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:22.068080 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b153a21f-77c5-4cef-bf7d-ec415c0cdc11 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:22.068714 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b153a21f-77c5-4cef-bf7d-ec415c0cdc11 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:22.074674 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b153a21f-77c5-4cef-bf7d-ec415c0cdc11 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:22.075114 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b153a21f-77c5-4cef-bf7d-ec415c0cdc11 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:22.075884 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b153a21f-77c5-4cef-bf7d-ec415c0cdc11 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:22.076743 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b153a21f-77c5-4cef-bf7d-ec415c0cdc11 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:22.211679 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-b153a21f-77c5-4cef-bf7d-ec415c0cdc11 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:22.219791 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-b153a21f-77c5-4cef-bf7d-ec415c0cdc11 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:22.221347 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-b153a21f-77c5-4cef-bf7d-ec415c0cdc11 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:22.222502 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b153a21f-77c5-4cef-bf7d-ec415c0cdc11 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1724 microversion: 2.20 time: 0.158271 Aug 25 05:34:22.223043 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 278/543] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:34:22 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:34:22.719370 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-0abc6272-bafd-4fa2-aaf8-3fbd1432e348 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:22.719930 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-0abc6272-bafd-4fa2-aaf8-3fbd1432e348 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] [instance: fd62434d-18f1-4992-8f73-2ebec7b52a8f] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:22.725944 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0abc6272-bafd-4fa2-aaf8-3fbd1432e348 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:22.726391 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0abc6272-bafd-4fa2-aaf8-3fbd1432e348 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:22.727225 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0abc6272-bafd-4fa2-aaf8-3fbd1432e348 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:22.727642 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0abc6272-bafd-4fa2-aaf8-3fbd1432e348 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:22.741207 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.wsgi [None req-0abc6272-bafd-4fa2-aaf8-3fbd1432e348 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] HTTP exception thrown: Instance fd62434d-18f1-4992-8f73-2ebec7b52a8f could not be found. Aug 25 05:34:22.741881 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-0abc6272-bafd-4fa2-aaf8-3fbd1432e348 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] Returning 404 to user: Instance fd62434d-18f1-4992-8f73-2ebec7b52a8f could not be found. {{(pid=108884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 05:34:22.742636 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-0abc6272-bafd-4fa2-aaf8-3fbd1432e348 tempest-VolumesActionsTest-1740158095 tempest-VolumesActionsTest-1740158095-project] 10.222.0.42 "GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f" status: 404 len: 111 microversion: 2.1 time: 0.027835 Aug 25 05:34:22.743166 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 266/544] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:22 2021] GET /compute/v2.1/servers/fd62434d-18f1-4992-8f73-2ebec7b52a8f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 05:34:22.780216 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-4fae414e-afbd-4ab7-824a-d091a3183c45 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:22.781509 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-4fae414e-afbd-4ab7-824a-d091a3183c45 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:22.787694 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4fae414e-afbd-4ab7-824a-d091a3183c45 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:22.788145 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4fae414e-afbd-4ab7-824a-d091a3183c45 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:22.788915 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4fae414e-afbd-4ab7-824a-d091a3183c45 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:22.789347 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4fae414e-afbd-4ab7-824a-d091a3183c45 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:22.919310 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-4fae414e-afbd-4ab7-824a-d091a3183c45 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:22.925036 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-4fae414e-afbd-4ab7-824a-d091a3183c45 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1506 microversion: 2.1 time: 0.148366 Aug 25 05:34:22.932107 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 279/545] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:22 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:23.123555 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 05:34:23.124141 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: Wed Aug 25 05:34:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 05:34:23.241460 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8bdb71df-46e8-4e5a-8a2e-7e867a438e40 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:23.242097 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8bdb71df-46e8-4e5a-8a2e-7e867a438e40 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:23.248111 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8bdb71df-46e8-4e5a-8a2e-7e867a438e40 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:23.248484 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8bdb71df-46e8-4e5a-8a2e-7e867a438e40 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:23.249255 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8bdb71df-46e8-4e5a-8a2e-7e867a438e40 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:23.250536 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8bdb71df-46e8-4e5a-8a2e-7e867a438e40 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:23.451393 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-8bdb71df-46e8-4e5a-8a2e-7e867a438e40 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:23.451393 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-8bdb71df-46e8-4e5a-8a2e-7e867a438e40 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:23.451791 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-8bdb71df-46e8-4e5a-8a2e-7e867a438e40 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:23.451791 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8bdb71df-46e8-4e5a-8a2e-7e867a438e40 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1724 microversion: 2.20 time: 0.202220 Aug 25 05:34:23.451791 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 267/546] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:34:23 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:34:23.740136 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-21ba147f-1374-42eb-96ea-cd6ae88aba8c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:34:23.746036 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-21ba147f-1374-42eb-96ea-cd6ae88aba8c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:23.746632 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-21ba147f-1374-42eb-96ea-cd6ae88aba8c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:23.812930 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-21ba147f-1374-42eb-96ea-cd6ae88aba8c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Going to try to stop instance {{(pid=108885) force_stop /opt/stack/nova/nova/compute/api.py:2614}} Aug 25 05:34:23.922056 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [req-d292a287-a116-40d9-bb14-fc79abb99973 req-c3256b29-b263-40b3-88b6-d1883dee71dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3e165c6-aa9b-4300-b7b9-7b820e894508", "name": "network-vif-deleted", "tag": "02e3f58d-2ea4-4c56-82da-d9700062ae4a"}]} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:34:23.924294 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:34:23.924294 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: warnings.warn(msg) Aug 25 05:34:23.931281 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-d292a287-a116-40d9-bb14-fc79abb99973 req-c3256b29-b263-40b3-88b6-d1883dee71dc service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:23.935380 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-d292a287-a116-40d9-bb14-fc79abb99973 req-c3256b29-b263-40b3-88b6-d1883dee71dc service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:23.944570 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.compute.server_external_events [req-d292a287-a116-40d9-bb14-fc79abb99973 req-c3256b29-b263-40b3-88b6-d1883dee71dc service nova] Creating event network-vif-deleted:02e3f58d-2ea4-4c56-82da-d9700062ae4a for instance f3e165c6-aa9b-4300-b7b9-7b820e894508 on hv-cinder-78662 Aug 25 05:34:23.949817 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [req-d292a287-a116-40d9-bb14-fc79abb99973 req-c3256b29-b263-40b3-88b6-d1883dee71dc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031538 Aug 25 05:34:23.950407 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 268/547] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:34:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:34:23.956852 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3c4183a3-5ce0-44d7-95a8-2b47c72a340a tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:23.958545 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3c4183a3-5ce0-44d7-95a8-2b47c72a340a tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:23.966064 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3c4183a3-5ce0-44d7-95a8-2b47c72a340a tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:23.966791 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3c4183a3-5ce0-44d7-95a8-2b47c72a340a tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:23.967750 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3c4183a3-5ce0-44d7-95a8-2b47c72a340a tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:23.968678 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3c4183a3-5ce0-44d7-95a8-2b47c72a340a tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:24.033035 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-3c4183a3-5ce0-44d7-95a8-2b47c72a340a tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:24.040229 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3c4183a3-5ce0-44d7-95a8-2b47c72a340a tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1464 microversion: 2.1 time: 0.088682 Aug 25 05:34:24.041672 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 269/548] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:23 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1464 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:24.113078 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-21ba147f-1374-42eb-96ea-cd6ae88aba8c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 202 len: 0 microversion: 2.1 time: 0.376536 Aug 25 05:34:24.113749 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 280/549] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:34:23 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:34:24.132228 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8b7f5fe5-4e29-458d-8b8e-9e2f3da0c6de tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:24.133347 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8b7f5fe5-4e29-458d-8b8e-9e2f3da0c6de tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:24.142600 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8b7f5fe5-4e29-458d-8b8e-9e2f3da0c6de tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:24.143156 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8b7f5fe5-4e29-458d-8b8e-9e2f3da0c6de tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:24.144189 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8b7f5fe5-4e29-458d-8b8e-9e2f3da0c6de tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:24.144842 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8b7f5fe5-4e29-458d-8b8e-9e2f3da0c6de tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:24.314626 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-8b7f5fe5-4e29-458d-8b8e-9e2f3da0c6de tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:24.322919 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8b7f5fe5-4e29-458d-8b8e-9e2f3da0c6de tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1722 microversion: 2.1 time: 0.203727 Aug 25 05:34:24.323534 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 270/550] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:24 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1722 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:24.464799 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-8e14d130-f250-4771-8b57-991ebad26d49 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:24.466001 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-8e14d130-f250-4771-8b57-991ebad26d49 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:24.472517 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8e14d130-f250-4771-8b57-991ebad26d49 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:24.473317 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8e14d130-f250-4771-8b57-991ebad26d49 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:24.474390 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8e14d130-f250-4771-8b57-991ebad26d49 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:24.474975 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8e14d130-f250-4771-8b57-991ebad26d49 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:24.618790 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-8e14d130-f250-4771-8b57-991ebad26d49 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:24.626982 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-8e14d130-f250-4771-8b57-991ebad26d49 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:24.628309 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-8e14d130-f250-4771-8b57-991ebad26d49 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:24.629466 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-8e14d130-f250-4771-8b57-991ebad26d49 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1724 microversion: 2.20 time: 0.168911 Aug 25 05:34:24.630170 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 281/551] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:34:24 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:34:25.057565 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1aafc940-cc87-49de-9063-5451c57e3d92 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:25.058182 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1aafc940-cc87-49de-9063-5451c57e3d92 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:25.063960 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1aafc940-cc87-49de-9063-5451c57e3d92 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:25.064397 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1aafc940-cc87-49de-9063-5451c57e3d92 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:25.065171 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1aafc940-cc87-49de-9063-5451c57e3d92 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:25.065659 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1aafc940-cc87-49de-9063-5451c57e3d92 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:25.102547 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1aafc940-cc87-49de-9063-5451c57e3d92 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:25.102993 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1aafc940-cc87-49de-9063-5451c57e3d92 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:25.103436 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.objects.instance [None req-1aafc940-cc87-49de-9063-5451c57e3d92 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lazy-loading 'fault' on Instance uuid f3e165c6-aa9b-4300-b7b9-7b820e894508 {{(pid=108884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 05:34:25.148901 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-1aafc940-cc87-49de-9063-5451c57e3d92 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:25.157268 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1aafc940-cc87-49de-9063-5451c57e3d92 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 200 len: 1311 microversion: 2.1 time: 0.103387 Aug 25 05:34:25.157956 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 271/552] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:25 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 1311 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:34:25.340389 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b054029e-8086-4348-9579-ffa2c0394eaf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:25.340999 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b054029e-8086-4348-9579-ffa2c0394eaf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:25.348875 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b054029e-8086-4348-9579-ffa2c0394eaf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:25.349312 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b054029e-8086-4348-9579-ffa2c0394eaf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:25.350117 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b054029e-8086-4348-9579-ffa2c0394eaf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:25.350537 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b054029e-8086-4348-9579-ffa2c0394eaf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:25.480532 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-b054029e-8086-4348-9579-ffa2c0394eaf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:25.489801 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b054029e-8086-4348-9579-ffa2c0394eaf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1722 microversion: 2.1 time: 0.153044 Aug 25 05:34:25.490708 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 282/553] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:25 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:25.647730 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e4cbd55b-2d30-4c52-923a-0080309af060 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:25.648245 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e4cbd55b-2d30-4c52-923a-0080309af060 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:25.654442 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e4cbd55b-2d30-4c52-923a-0080309af060 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:25.654886 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e4cbd55b-2d30-4c52-923a-0080309af060 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:25.656230 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e4cbd55b-2d30-4c52-923a-0080309af060 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:25.656662 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e4cbd55b-2d30-4c52-923a-0080309af060 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:25.778762 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e4cbd55b-2d30-4c52-923a-0080309af060 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:25.787455 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e4cbd55b-2d30-4c52-923a-0080309af060 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:25.788942 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e4cbd55b-2d30-4c52-923a-0080309af060 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:25.790115 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e4cbd55b-2d30-4c52-923a-0080309af060 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1724 microversion: 2.20 time: 0.146250 Aug 25 05:34:25.790670 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 272/554] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:34:25 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:34:26.175429 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1b928fef-8837-4da0-989a-335f3f0e5de9 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:26.176036 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1b928fef-8837-4da0-989a-335f3f0e5de9 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: f3e165c6-aa9b-4300-b7b9-7b820e894508] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:26.181989 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1b928fef-8837-4da0-989a-335f3f0e5de9 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:26.182437 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1b928fef-8837-4da0-989a-335f3f0e5de9 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:26.183200 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1b928fef-8837-4da0-989a-335f3f0e5de9 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:26.183629 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1b928fef-8837-4da0-989a-335f3f0e5de9 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:26.198240 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.wsgi [None req-1b928fef-8837-4da0-989a-335f3f0e5de9 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] HTTP exception thrown: Instance f3e165c6-aa9b-4300-b7b9-7b820e894508 could not be found. Aug 25 05:34:26.198825 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1b928fef-8837-4da0-989a-335f3f0e5de9 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Returning 404 to user: Instance f3e165c6-aa9b-4300-b7b9-7b820e894508 could not be found. {{(pid=108885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 05:34:26.199646 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1b928fef-8837-4da0-989a-335f3f0e5de9 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508" status: 404 len: 111 microversion: 2.1 time: 0.029231 Aug 25 05:34:26.200175 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 283/555] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:26 2021] GET /compute/v2.1/servers/f3e165c6-aa9b-4300-b7b9-7b820e894508 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:34:26.209709 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-15ee3f2e-3585-4947-bb3e-5b605cf268e0 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:26.214816 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-15ee3f2e-3585-4947-bb3e-5b605cf268e0 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:26.216158 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-15ee3f2e-3585-4947-bb3e-5b605cf268e0 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:26.216603 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-15ee3f2e-3585-4947-bb3e-5b605cf268e0 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:26.217357 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-15ee3f2e-3585-4947-bb3e-5b605cf268e0 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:26.217823 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-15ee3f2e-3585-4947-bb3e-5b605cf268e0 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:26.242393 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-15ee3f2e-3585-4947-bb3e-5b605cf268e0 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Going to try to terminate instance {{(pid=108884) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 25 05:34:26.507869 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7db55ab4-4bf7-41bc-839e-663aa9a4f001 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:26.508596 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-7db55ab4-4bf7-41bc-839e-663aa9a4f001 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:26.515198 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7db55ab4-4bf7-41bc-839e-663aa9a4f001 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:26.518059 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7db55ab4-4bf7-41bc-839e-663aa9a4f001 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:26.518059 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7db55ab4-4bf7-41bc-839e-663aa9a4f001 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:26.518059 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7db55ab4-4bf7-41bc-839e-663aa9a4f001 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:26.619035 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-15ee3f2e-3585-4947-bb3e-5b605cf268e0 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 204 len: 0 microversion: 2.1 time: 0.412900 Aug 25 05:34:26.620279 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 273/556] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 25 05:34:26 2021] DELETE /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 05:34:26.629839 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-58f791ad-4bdd-434e-8def-93774612a657 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:26.630882 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-58f791ad-4bdd-434e-8def-93774612a657 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:26.637594 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-58f791ad-4bdd-434e-8def-93774612a657 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:26.638048 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-58f791ad-4bdd-434e-8def-93774612a657 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:26.638874 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-58f791ad-4bdd-434e-8def-93774612a657 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:26.639536 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-58f791ad-4bdd-434e-8def-93774612a657 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:26.659848 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-7db55ab4-4bf7-41bc-839e-663aa9a4f001 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:26.670730 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-7db55ab4-4bf7-41bc-839e-663aa9a4f001 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1722 microversion: 2.1 time: 0.167004 Aug 25 05:34:26.673359 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 284/557] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:26 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:34:26.777557 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-58f791ad-4bdd-434e-8def-93774612a657 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:26.785325 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-58f791ad-4bdd-434e-8def-93774612a657 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1521 microversion: 2.1 time: 0.161073 Aug 25 05:34:26.785915 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 274/558] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:26 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:34:26.809002 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-897e4372-3ae3-4865-94c1-6204fb6f3c52 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:26.809794 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-897e4372-3ae3-4865-94c1-6204fb6f3c52 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:26.815687 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-897e4372-3ae3-4865-94c1-6204fb6f3c52 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:26.816141 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-897e4372-3ae3-4865-94c1-6204fb6f3c52 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:26.816899 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-897e4372-3ae3-4865-94c1-6204fb6f3c52 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:26.817355 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-897e4372-3ae3-4865-94c1-6204fb6f3c52 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:26.947901 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-897e4372-3ae3-4865-94c1-6204fb6f3c52 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:26.956532 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-897e4372-3ae3-4865-94c1-6204fb6f3c52 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:26.958083 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-897e4372-3ae3-4865-94c1-6204fb6f3c52 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:26.959225 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-897e4372-3ae3-4865-94c1-6204fb6f3c52 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1724 microversion: 2.20 time: 0.154065 Aug 25 05:34:26.959770 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 285/559] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:34:26 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:34:26.960654 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-87c5a7b9-e342-41ae-8b87-3fa57b889329 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0546dc97-6ead-4f59-a674-0382fb85f5bf", "device": "/dev/sdb"}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:34:26.962306 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-87c5a7b9-e342-41ae-8b87-3fa57b889329 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 92dd15ea-adff-40f8-86b3-3333f26586d5] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:26.968729 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-87c5a7b9-e342-41ae-8b87-3fa57b889329 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:26.969233 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-87c5a7b9-e342-41ae-8b87-3fa57b889329 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:26.970027 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-87c5a7b9-e342-41ae-8b87-3fa57b889329 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:26.970451 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-87c5a7b9-e342-41ae-8b87-3fa57b889329 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:27.695180 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-83a46acf-b85d-4745-986e-7e8e32951995 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:27.695768 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-83a46acf-b85d-4745-986e-7e8e32951995 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:27.701626 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-83a46acf-b85d-4745-986e-7e8e32951995 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:27.702068 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-83a46acf-b85d-4745-986e-7e8e32951995 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:27.703443 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-83a46acf-b85d-4745-986e-7e8e32951995 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:27.703865 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-83a46acf-b85d-4745-986e-7e8e32951995 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:27.838868 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-83a46acf-b85d-4745-986e-7e8e32951995 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:27.847385 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-83a46acf-b85d-4745-986e-7e8e32951995 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1722 microversion: 2.1 time: 0.158476 Aug 25 05:34:27.848115 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 286/560] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:27 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:34:27.852978 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-bbc9c9db-bb3d-449b-a07c-48f948939a06 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:27.854132 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-bbc9c9db-bb3d-449b-a07c-48f948939a06 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:27.861152 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bbc9c9db-bb3d-449b-a07c-48f948939a06 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:27.861623 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bbc9c9db-bb3d-449b-a07c-48f948939a06 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:27.862400 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bbc9c9db-bb3d-449b-a07c-48f948939a06 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:27.862828 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bbc9c9db-bb3d-449b-a07c-48f948939a06 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:28.000210 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-bbc9c9db-bb3d-449b-a07c-48f948939a06 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:28.008027 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-bbc9c9db-bb3d-449b-a07c-48f948939a06 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1521 microversion: 2.1 time: 0.158714 Aug 25 05:34:28.008589 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 287/561] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:27 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:28.013150 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-438fab11-355f-4e32-a40a-3d63ecb53e8b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:28.013779 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-438fab11-355f-4e32-a40a-3d63ecb53e8b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:28.021428 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-438fab11-355f-4e32-a40a-3d63ecb53e8b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:28.021901 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-438fab11-355f-4e32-a40a-3d63ecb53e8b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:28.022680 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-438fab11-355f-4e32-a40a-3d63ecb53e8b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:28.023109 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-438fab11-355f-4e32-a40a-3d63ecb53e8b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:28.167084 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-438fab11-355f-4e32-a40a-3d63ecb53e8b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:28.178454 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-438fab11-355f-4e32-a40a-3d63ecb53e8b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:28.181261 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-438fab11-355f-4e32-a40a-3d63ecb53e8b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:28.182450 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-438fab11-355f-4e32-a40a-3d63ecb53e8b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1724 microversion: 2.20 time: 0.172850 Aug 25 05:34:28.183378 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 288/562] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:34:28 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:34:28.865804 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-76babf5e-2de6-4fce-8e9b-86961d335b15 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:28.866423 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-76babf5e-2de6-4fce-8e9b-86961d335b15 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:28.872260 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-76babf5e-2de6-4fce-8e9b-86961d335b15 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:28.872712 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-76babf5e-2de6-4fce-8e9b-86961d335b15 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:28.873574 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-76babf5e-2de6-4fce-8e9b-86961d335b15 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:28.874010 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-76babf5e-2de6-4fce-8e9b-86961d335b15 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:28.998590 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-76babf5e-2de6-4fce-8e9b-86961d335b15 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:29.007265 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-76babf5e-2de6-4fce-8e9b-86961d335b15 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1722 microversion: 2.1 time: 0.145315 Aug 25 05:34:29.007855 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 289/563] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:28 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1722 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:34:29.026365 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a32de97a-6e52-4171-8faa-116c475268e3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:29.026963 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a32de97a-6e52-4171-8faa-116c475268e3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:29.033103 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a32de97a-6e52-4171-8faa-116c475268e3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:29.033571 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a32de97a-6e52-4171-8faa-116c475268e3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:29.034341 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a32de97a-6e52-4171-8faa-116c475268e3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:29.034773 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a32de97a-6e52-4171-8faa-116c475268e3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:29.163204 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-a32de97a-6e52-4171-8faa-116c475268e3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:29.171787 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a32de97a-6e52-4171-8faa-116c475268e3 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1521 microversion: 2.1 time: 0.148252 Aug 25 05:34:29.172421 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 290/564] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:29 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:34:29.208630 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ea7c5072-efda-4209-a4c2-11f5fd6e3293 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:29.209234 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ea7c5072-efda-4209-a4c2-11f5fd6e3293 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:29.215050 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ea7c5072-efda-4209-a4c2-11f5fd6e3293 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:29.215496 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ea7c5072-efda-4209-a4c2-11f5fd6e3293 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:29.216258 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ea7c5072-efda-4209-a4c2-11f5fd6e3293 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:29.216696 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ea7c5072-efda-4209-a4c2-11f5fd6e3293 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:29.345814 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ea7c5072-efda-4209-a4c2-11f5fd6e3293 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:29.356858 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ea7c5072-efda-4209-a4c2-11f5fd6e3293 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:29.360134 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ea7c5072-efda-4209-a4c2-11f5fd6e3293 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:29.362011 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ea7c5072-efda-4209-a4c2-11f5fd6e3293 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1724 microversion: 2.20 time: 0.156861 Aug 25 05:34:29.362778 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 291/565] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:34:29 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:34:30.027164 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9ac43b42-3482-420e-8101-17a7ae2db3c6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:30.027920 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9ac43b42-3482-420e-8101-17a7ae2db3c6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:30.033818 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9ac43b42-3482-420e-8101-17a7ae2db3c6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:30.036765 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9ac43b42-3482-420e-8101-17a7ae2db3c6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:30.036765 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9ac43b42-3482-420e-8101-17a7ae2db3c6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:30.036765 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9ac43b42-3482-420e-8101-17a7ae2db3c6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:30.159395 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-9ac43b42-3482-420e-8101-17a7ae2db3c6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:30.167891 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9ac43b42-3482-420e-8101-17a7ae2db3c6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1722 microversion: 2.1 time: 0.145429 Aug 25 05:34:30.168480 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 292/566] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:30 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1722 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:34:30.188394 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-15ce8f6c-311e-4f78-b518-8c1693cd8673 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:30.188992 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-15ce8f6c-311e-4f78-b518-8c1693cd8673 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:30.194877 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-15ce8f6c-311e-4f78-b518-8c1693cd8673 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:30.200486 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-15ce8f6c-311e-4f78-b518-8c1693cd8673 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:30.200486 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-15ce8f6c-311e-4f78-b518-8c1693cd8673 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:30.200486 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-15ce8f6c-311e-4f78-b518-8c1693cd8673 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:30.339544 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-15ce8f6c-311e-4f78-b518-8c1693cd8673 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:30.349712 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-15ce8f6c-311e-4f78-b518-8c1693cd8673 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1521 microversion: 2.1 time: 0.165502 Aug 25 05:34:30.350642 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 293/567] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:30 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:34:30.381019 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d7335b11-7864-4f14-a3c5-cc1aa2a9e131 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:30.381804 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d7335b11-7864-4f14-a3c5-cc1aa2a9e131 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:30.387921 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d7335b11-7864-4f14-a3c5-cc1aa2a9e131 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:30.388371 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d7335b11-7864-4f14-a3c5-cc1aa2a9e131 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:30.389148 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d7335b11-7864-4f14-a3c5-cc1aa2a9e131 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:30.389614 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d7335b11-7864-4f14-a3c5-cc1aa2a9e131 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:30.528711 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d7335b11-7864-4f14-a3c5-cc1aa2a9e131 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:30.538139 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d7335b11-7864-4f14-a3c5-cc1aa2a9e131 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:30.539679 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d7335b11-7864-4f14-a3c5-cc1aa2a9e131 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:30.541075 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d7335b11-7864-4f14-a3c5-cc1aa2a9e131 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1724 microversion: 2.20 time: 0.163630 Aug 25 05:34:30.541637 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 294/568] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:34:30 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:34:30.866715 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-87c5a7b9-e342-41ae-8b87-3fa57b889329 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "POST /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.909642 Aug 25 05:34:30.868055 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 275/569] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 25 05:34:26 2021] POST /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5/os-volume_attachments => generated 194 bytes in 3911 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:34:31.189771 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-db35f700-6f3d-4401-91d8-5bdfc7b344cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:31.190660 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-db35f700-6f3d-4401-91d8-5bdfc7b344cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:31.199378 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-db35f700-6f3d-4401-91d8-5bdfc7b344cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:31.205648 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-db35f700-6f3d-4401-91d8-5bdfc7b344cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:31.205648 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-db35f700-6f3d-4401-91d8-5bdfc7b344cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:31.205648 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-db35f700-6f3d-4401-91d8-5bdfc7b344cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:31.353625 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-db35f700-6f3d-4401-91d8-5bdfc7b344cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:31.367389 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-db35f700-6f3d-4401-91d8-5bdfc7b344cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1722 microversion: 2.1 time: 0.184160 Aug 25 05:34:31.378457 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-0641d8e2-2836-4d99-9317-2d558411739f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:31.379888 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-0641d8e2-2836-4d99-9317-2d558411739f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:31.380258 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 295/570] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:31 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:34:31.387650 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0641d8e2-2836-4d99-9317-2d558411739f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:31.388249 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0641d8e2-2836-4d99-9317-2d558411739f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:31.389218 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0641d8e2-2836-4d99-9317-2d558411739f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:31.390327 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0641d8e2-2836-4d99-9317-2d558411739f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:31.524852 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-0641d8e2-2836-4d99-9317-2d558411739f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:31.540344 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-0641d8e2-2836-4d99-9317-2d558411739f tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1521 microversion: 2.1 time: 0.175405 Aug 25 05:34:31.540607 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 276/571] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:31 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:31.562975 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-8151bb66-c379-40d4-b380-e7a01b0751af tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:31.564800 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-8151bb66-c379-40d4-b380-e7a01b0751af tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:31.572590 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8151bb66-c379-40d4-b380-e7a01b0751af tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:31.573149 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8151bb66-c379-40d4-b380-e7a01b0751af tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:31.573976 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8151bb66-c379-40d4-b380-e7a01b0751af tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:31.574368 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8151bb66-c379-40d4-b380-e7a01b0751af tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:31.735360 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-8151bb66-c379-40d4-b380-e7a01b0751af tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:31.743490 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-8151bb66-c379-40d4-b380-e7a01b0751af tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:31.745024 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-8151bb66-c379-40d4-b380-e7a01b0751af tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:31.746505 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-8151bb66-c379-40d4-b380-e7a01b0751af tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1724 microversion: 2.20 time: 0.190208 Aug 25 05:34:31.759473 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 296/572] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:34:31 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:34:32.388652 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b8c08906-7059-4195-9a86-5858fc6fe33e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:32.390528 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b8c08906-7059-4195-9a86-5858fc6fe33e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:32.397776 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b8c08906-7059-4195-9a86-5858fc6fe33e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:32.397776 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b8c08906-7059-4195-9a86-5858fc6fe33e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:32.399035 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b8c08906-7059-4195-9a86-5858fc6fe33e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:32.399533 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b8c08906-7059-4195-9a86-5858fc6fe33e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:32.552232 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-b8c08906-7059-4195-9a86-5858fc6fe33e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:32.563260 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2e9fb498-0a41-4e30-8c29-56a3eae13fee tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:32.564006 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2e9fb498-0a41-4e30-8c29-56a3eae13fee tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:32.570420 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2e9fb498-0a41-4e30-8c29-56a3eae13fee tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:32.571372 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2e9fb498-0a41-4e30-8c29-56a3eae13fee tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:32.571830 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b8c08906-7059-4195-9a86-5858fc6fe33e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1722 microversion: 2.1 time: 0.187103 Aug 25 05:34:32.572492 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2e9fb498-0a41-4e30-8c29-56a3eae13fee tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:32.573092 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2e9fb498-0a41-4e30-8c29-56a3eae13fee tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:32.573334 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 277/573] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:32 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:32.723881 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-2e9fb498-0a41-4e30-8c29-56a3eae13fee tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:32.732624 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2e9fb498-0a41-4e30-8c29-56a3eae13fee tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1521 microversion: 2.1 time: 0.173940 Aug 25 05:34:32.744234 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 297/574] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:32 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:32.770212 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a61053cf-a3cd-4132-a200-4f8928df3975 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:32.771511 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a61053cf-a3cd-4132-a200-4f8928df3975 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:32.779685 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a61053cf-a3cd-4132-a200-4f8928df3975 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:32.781030 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a61053cf-a3cd-4132-a200-4f8928df3975 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:32.782339 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a61053cf-a3cd-4132-a200-4f8928df3975 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:32.783160 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a61053cf-a3cd-4132-a200-4f8928df3975 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:32.948388 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-a61053cf-a3cd-4132-a200-4f8928df3975 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:32.965028 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-a61053cf-a3cd-4132-a200-4f8928df3975 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:32.966955 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-a61053cf-a3cd-4132-a200-4f8928df3975 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:32.968722 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a61053cf-a3cd-4132-a200-4f8928df3975 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1724 microversion: 2.20 time: 0.203925 Aug 25 05:34:32.980609 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 278/575] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:34:32 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:34:33.591218 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-31471e1d-c2f3-4976-a330-828c38894b6b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:33.592212 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-31471e1d-c2f3-4976-a330-828c38894b6b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:33.602925 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-31471e1d-c2f3-4976-a330-828c38894b6b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:33.603691 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-31471e1d-c2f3-4976-a330-828c38894b6b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:33.604527 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-31471e1d-c2f3-4976-a330-828c38894b6b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:33.604964 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-31471e1d-c2f3-4976-a330-828c38894b6b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:33.757042 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b61857ef-8b42-4fe1-b2fc-0cc971eacdb9 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:33.758499 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b61857ef-8b42-4fe1-b2fc-0cc971eacdb9 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:33.769421 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b61857ef-8b42-4fe1-b2fc-0cc971eacdb9 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:33.770491 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b61857ef-8b42-4fe1-b2fc-0cc971eacdb9 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:33.772030 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b61857ef-8b42-4fe1-b2fc-0cc971eacdb9 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:33.772881 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b61857ef-8b42-4fe1-b2fc-0cc971eacdb9 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:33.792879 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-31471e1d-c2f3-4976-a330-828c38894b6b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:33.817831 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-31471e1d-c2f3-4976-a330-828c38894b6b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1722 microversion: 2.1 time: 0.230259 Aug 25 05:34:33.818404 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 298/576] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:33 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:33.985628 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-b61857ef-8b42-4fe1-b2fc-0cc971eacdb9 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:33.989979 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-fb352524-791c-405c-9a05-e6d33d0be027 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:33.990570 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-fb352524-791c-405c-9a05-e6d33d0be027 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:33.994660 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b61857ef-8b42-4fe1-b2fc-0cc971eacdb9 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1521 microversion: 2.1 time: 0.247122 Aug 25 05:34:34.001603 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fb352524-791c-405c-9a05-e6d33d0be027 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:34.002368 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fb352524-791c-405c-9a05-e6d33d0be027 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:34.003381 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fb352524-791c-405c-9a05-e6d33d0be027 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:34.004097 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fb352524-791c-405c-9a05-e6d33d0be027 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:34.006102 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 279/577] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:33 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:34:34.212631 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-fb352524-791c-405c-9a05-e6d33d0be027 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:34.224144 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-fb352524-791c-405c-9a05-e6d33d0be027 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:34.225857 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-fb352524-791c-405c-9a05-e6d33d0be027 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:34.227880 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-fb352524-791c-405c-9a05-e6d33d0be027 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1724 microversion: 2.20 time: 0.243350 Aug 25 05:34:34.228567 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 299/578] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:34:33 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1724 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:34:34.840076 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-f94259cd-b2df-4119-83af-5e01b7badd91 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:34.841334 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-f94259cd-b2df-4119-83af-5e01b7badd91 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:34.852771 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f94259cd-b2df-4119-83af-5e01b7badd91 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:34.853425 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f94259cd-b2df-4119-83af-5e01b7badd91 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:34.854824 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f94259cd-b2df-4119-83af-5e01b7badd91 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:34.855442 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f94259cd-b2df-4119-83af-5e01b7badd91 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:35.012769 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-91f15b1c-3945-40fb-9a08-e289a61e34ae tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:35.013421 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-91f15b1c-3945-40fb-9a08-e289a61e34ae tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:35.020745 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-91f15b1c-3945-40fb-9a08-e289a61e34ae tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:35.021461 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-91f15b1c-3945-40fb-9a08-e289a61e34ae tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:35.022450 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-91f15b1c-3945-40fb-9a08-e289a61e34ae tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:35.023054 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-91f15b1c-3945-40fb-9a08-e289a61e34ae tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:35.038107 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-f94259cd-b2df-4119-83af-5e01b7badd91 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:35.061166 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-f94259cd-b2df-4119-83af-5e01b7badd91 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1722 microversion: 2.1 time: 0.225007 Aug 25 05:34:35.071738 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 280/579] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:34 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:34:35.220497 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-91f15b1c-3945-40fb-9a08-e289a61e34ae tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:35.236545 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-91f15b1c-3945-40fb-9a08-e289a61e34ae tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1521 microversion: 2.1 time: 0.226798 Aug 25 05:34:35.237417 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 300/580] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:35 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:35.252893 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6f9a083c-e674-4758-8d87-35980d7b3a3c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:35.253730 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6f9a083c-e674-4758-8d87-35980d7b3a3c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:35.261965 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6f9a083c-e674-4758-8d87-35980d7b3a3c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:35.263728 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6f9a083c-e674-4758-8d87-35980d7b3a3c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:35.266137 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6f9a083c-e674-4758-8d87-35980d7b3a3c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:35.266963 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6f9a083c-e674-4758-8d87-35980d7b3a3c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:35.439773 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6f9a083c-e674-4758-8d87-35980d7b3a3c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:35.447600 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6f9a083c-e674-4758-8d87-35980d7b3a3c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:35.449089 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6f9a083c-e674-4758-8d87-35980d7b3a3c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:35.450269 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6f9a083c-e674-4758-8d87-35980d7b3a3c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1724 microversion: 2.20 time: 0.201804 Aug 25 05:34:35.450826 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 281/581] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:34:35 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:34:36.079759 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-cad91160-031f-4edb-9749-780cbbb78384 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:36.080690 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-cad91160-031f-4edb-9749-780cbbb78384 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:36.087353 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cad91160-031f-4edb-9749-780cbbb78384 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:36.088152 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cad91160-031f-4edb-9749-780cbbb78384 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:36.089308 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cad91160-031f-4edb-9749-780cbbb78384 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:36.089972 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cad91160-031f-4edb-9749-780cbbb78384 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:36.270747 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-58dc46a6-ea9d-4056-a88f-42590341a379 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:36.282339 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-cad91160-031f-4edb-9749-780cbbb78384 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:36.289783 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-58dc46a6-ea9d-4056-a88f-42590341a379 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:36.304918 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-58dc46a6-ea9d-4056-a88f-42590341a379 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:36.305810 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-58dc46a6-ea9d-4056-a88f-42590341a379 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:36.307505 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-58dc46a6-ea9d-4056-a88f-42590341a379 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:36.309131 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-58dc46a6-ea9d-4056-a88f-42590341a379 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:36.310810 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-cad91160-031f-4edb-9749-780cbbb78384 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1722 microversion: 2.1 time: 0.223868 Aug 25 05:34:36.319750 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 301/582] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:36 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:36.475750 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-4da4795a-3d99-4f7b-92fa-5a5cbffa3d36 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:36.476449 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-4da4795a-3d99-4f7b-92fa-5a5cbffa3d36 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:36.486667 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4da4795a-3d99-4f7b-92fa-5a5cbffa3d36 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:36.488633 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4da4795a-3d99-4f7b-92fa-5a5cbffa3d36 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:36.490950 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4da4795a-3d99-4f7b-92fa-5a5cbffa3d36 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:36.491611 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4da4795a-3d99-4f7b-92fa-5a5cbffa3d36 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:36.570094 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-58dc46a6-ea9d-4056-a88f-42590341a379 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:36.583335 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-58dc46a6-ea9d-4056-a88f-42590341a379 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1521 microversion: 2.1 time: 0.331940 Aug 25 05:34:36.594171 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 282/583] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:36 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1521 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:36.705947 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-4da4795a-3d99-4f7b-92fa-5a5cbffa3d36 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:36.716455 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-4da4795a-3d99-4f7b-92fa-5a5cbffa3d36 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:36.725387 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-4da4795a-3d99-4f7b-92fa-5a5cbffa3d36 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:36.731441 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-4da4795a-3d99-4f7b-92fa-5a5cbffa3d36 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1724 microversion: 2.20 time: 0.258793 Aug 25 05:34:36.735237 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 302/584] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:34:36 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1724 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:34:37.337163 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3cac6702-abe2-41e6-8bae-0b034955542f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:37.337832 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3cac6702-abe2-41e6-8bae-0b034955542f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:37.350282 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3cac6702-abe2-41e6-8bae-0b034955542f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:37.352070 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3cac6702-abe2-41e6-8bae-0b034955542f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:37.354802 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3cac6702-abe2-41e6-8bae-0b034955542f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:37.356423 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3cac6702-abe2-41e6-8bae-0b034955542f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:37.616403 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-cffbbe5b-19dc-4162-8b40-887d2880e648 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:37.617689 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-cffbbe5b-19dc-4162-8b40-887d2880e648 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:37.627943 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cffbbe5b-19dc-4162-8b40-887d2880e648 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:37.636942 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cffbbe5b-19dc-4162-8b40-887d2880e648 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:37.637934 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cffbbe5b-19dc-4162-8b40-887d2880e648 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:37.638565 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cffbbe5b-19dc-4162-8b40-887d2880e648 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:37.767607 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-3cac6702-abe2-41e6-8bae-0b034955542f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:37.806943 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3cac6702-abe2-41e6-8bae-0b034955542f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1722 microversion: 2.1 time: 0.476005 Aug 25 05:34:37.816480 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 283/585] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:37 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1722 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:37.831963 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8b906097-d097-413e-8c73-69dfa15e9dd2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:37.832609 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8b906097-d097-413e-8c73-69dfa15e9dd2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:37.849461 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8b906097-d097-413e-8c73-69dfa15e9dd2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:37.849933 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8b906097-d097-413e-8c73-69dfa15e9dd2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:37.850732 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8b906097-d097-413e-8c73-69dfa15e9dd2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:37.851296 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8b906097-d097-413e-8c73-69dfa15e9dd2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:38.069205 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-cffbbe5b-19dc-4162-8b40-887d2880e648 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:38.082820 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-cffbbe5b-19dc-4162-8b40-887d2880e648 tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1521 microversion: 2.1 time: 0.475873 Aug 25 05:34:38.085600 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 303/586] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:37 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1521 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:38.165148 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-8b906097-d097-413e-8c73-69dfa15e9dd2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:38.184273 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-8b906097-d097-413e-8c73-69dfa15e9dd2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:38.187999 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-8b906097-d097-413e-8c73-69dfa15e9dd2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:38.190955 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8b906097-d097-413e-8c73-69dfa15e9dd2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1745 microversion: 2.20 time: 0.372069 Aug 25 05:34:38.190955 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 284/587] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:34:37 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1745 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:34:38.239060 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [req-dae90df6-a2eb-473f-a0b4-3b95e6fbba0e req-34f26c53-c954-491e-a844-b6cb3cb7878e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2163e566-1832-40df-8925-09e54ae2974c", "name": "network-vif-deleted", "tag": "23c47dd6-b4d5-452b-8959-9becb9c14cae"}]} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:34:38.242588 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:34:38.242588 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: warnings.warn(msg) Aug 25 05:34:38.250454 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-dae90df6-a2eb-473f-a0b4-3b95e6fbba0e req-34f26c53-c954-491e-a844-b6cb3cb7878e service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:38.251252 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-dae90df6-a2eb-473f-a0b4-3b95e6fbba0e req-34f26c53-c954-491e-a844-b6cb3cb7878e service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:38.263756 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.compute.server_external_events [req-dae90df6-a2eb-473f-a0b4-3b95e6fbba0e req-34f26c53-c954-491e-a844-b6cb3cb7878e service nova] Creating event network-vif-deleted:23c47dd6-b4d5-452b-8959-9becb9c14cae for instance 2163e566-1832-40df-8925-09e54ae2974c on hv-cinder-78662 Aug 25 05:34:38.269769 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [req-dae90df6-a2eb-473f-a0b4-3b95e6fbba0e req-34f26c53-c954-491e-a844-b6cb3cb7878e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034217 Aug 25 05:34:38.274228 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 304/588] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:34:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:34:38.879975 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e039ad2a-86cf-4569-b8d5-d54aa8a1ae77 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:38.879975 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e039ad2a-86cf-4569-b8d5-d54aa8a1ae77 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:38.879975 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e039ad2a-86cf-4569-b8d5-d54aa8a1ae77 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:38.879975 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e039ad2a-86cf-4569-b8d5-d54aa8a1ae77 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:38.880926 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e039ad2a-86cf-4569-b8d5-d54aa8a1ae77 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:38.880926 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e039ad2a-86cf-4569-b8d5-d54aa8a1ae77 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:39.068664 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e039ad2a-86cf-4569-b8d5-d54aa8a1ae77 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:39.080297 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e039ad2a-86cf-4569-b8d5-d54aa8a1ae77 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1722 microversion: 2.1 time: 0.249080 Aug 25 05:34:39.089609 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 285/589] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:38 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:39.114236 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-4a8ee0e5-9b86-41a9-839f-a4a674f4834e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:39.114236 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-4a8ee0e5-9b86-41a9-839f-a4a674f4834e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:39.131572 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4a8ee0e5-9b86-41a9-839f-a4a674f4834e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:39.131978 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4a8ee0e5-9b86-41a9-839f-a4a674f4834e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:39.133278 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4a8ee0e5-9b86-41a9-839f-a4a674f4834e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:39.133429 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4a8ee0e5-9b86-41a9-839f-a4a674f4834e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:39.192865 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4a8ee0e5-9b86-41a9-839f-a4a674f4834e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:39.193316 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4a8ee0e5-9b86-41a9-839f-a4a674f4834e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:39.193797 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.objects.instance [None req-4a8ee0e5-9b86-41a9-839f-a4a674f4834e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lazy-loading 'fault' on Instance uuid 2163e566-1832-40df-8925-09e54ae2974c {{(pid=108885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 05:34:39.210840 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-98baf8a9-6c27-4438-aa3d-73af8ccccf7f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:39.211671 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-98baf8a9-6c27-4438-aa3d-73af8ccccf7f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:39.225164 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-98baf8a9-6c27-4438-aa3d-73af8ccccf7f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:39.226124 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-98baf8a9-6c27-4438-aa3d-73af8ccccf7f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:39.230039 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-98baf8a9-6c27-4438-aa3d-73af8ccccf7f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:39.230039 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-98baf8a9-6c27-4438-aa3d-73af8ccccf7f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:39.270729 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-4a8ee0e5-9b86-41a9-839f-a4a674f4834e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a37854279a342c7a02737a506cb3305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16c6c79a221475cab1663aa9d6dd54a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:39.282461 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-4a8ee0e5-9b86-41a9-839f-a4a674f4834e tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 200 len: 1311 microversion: 2.1 time: 0.178840 Aug 25 05:34:39.282461 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 305/590] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:39 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 1311 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:39.402860 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-98baf8a9-6c27-4438-aa3d-73af8ccccf7f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:39.411498 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-98baf8a9-6c27-4438-aa3d-73af8ccccf7f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:39.413926 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-98baf8a9-6c27-4438-aa3d-73af8ccccf7f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:39.415081 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-98baf8a9-6c27-4438-aa3d-73af8ccccf7f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1745 microversion: 2.20 time: 0.208178 Aug 25 05:34:39.415891 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 286/591] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:34:39 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1745 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:34:40.101657 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-32415f55-7bb7-4760-9e54-66e4b096503c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:40.103399 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-32415f55-7bb7-4760-9e54-66e4b096503c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:40.114187 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-32415f55-7bb7-4760-9e54-66e4b096503c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:40.115258 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-32415f55-7bb7-4760-9e54-66e4b096503c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:40.117187 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-32415f55-7bb7-4760-9e54-66e4b096503c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:40.118588 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-32415f55-7bb7-4760-9e54-66e4b096503c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:40.301802 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-2744044e-6a77-408b-bd95-ed141d882dee tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:40.303885 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-2744044e-6a77-408b-bd95-ed141d882dee tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] [instance: 2163e566-1832-40df-8925-09e54ae2974c] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:40.321345 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2744044e-6a77-408b-bd95-ed141d882dee tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:40.326433 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2744044e-6a77-408b-bd95-ed141d882dee tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:40.329111 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2744044e-6a77-408b-bd95-ed141d882dee tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:40.329889 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2744044e-6a77-408b-bd95-ed141d882dee tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:40.352128 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.wsgi [None req-2744044e-6a77-408b-bd95-ed141d882dee tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] HTTP exception thrown: Instance 2163e566-1832-40df-8925-09e54ae2974c could not be found. Aug 25 05:34:40.353183 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-2744044e-6a77-408b-bd95-ed141d882dee tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] Returning 404 to user: Instance 2163e566-1832-40df-8925-09e54ae2974c could not be found. {{(pid=108884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 05:34:40.357692 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-32415f55-7bb7-4760-9e54-66e4b096503c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:40.363942 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-2744044e-6a77-408b-bd95-ed141d882dee tempest-ServerRescueNegativeTestJSON-1082903166 tempest-ServerRescueNegativeTestJSON-1082903166-project] 10.222.0.42 "GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c" status: 404 len: 111 microversion: 2.1 time: 0.069387 Aug 25 05:34:40.373631 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 287/592] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:40 2021] GET /compute/v2.1/servers/2163e566-1832-40df-8925-09e54ae2974c => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:34:40.384888 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-32415f55-7bb7-4760-9e54-66e4b096503c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1722 microversion: 2.1 time: 0.281199 Aug 25 05:34:40.385848 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 306/593] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:40 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1722 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:40.434548 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-359dec19-3bea-413d-a9d1-7a92c11046b6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:40.435451 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-359dec19-3bea-413d-a9d1-7a92c11046b6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:40.446051 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-359dec19-3bea-413d-a9d1-7a92c11046b6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:40.447090 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-359dec19-3bea-413d-a9d1-7a92c11046b6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:40.448240 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-359dec19-3bea-413d-a9d1-7a92c11046b6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:40.448853 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-359dec19-3bea-413d-a9d1-7a92c11046b6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:40.801518 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-359dec19-3bea-413d-a9d1-7a92c11046b6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:40.813908 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-359dec19-3bea-413d-a9d1-7a92c11046b6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:40.817840 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-359dec19-3bea-413d-a9d1-7a92c11046b6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:40.819356 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-359dec19-3bea-413d-a9d1-7a92c11046b6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1745 microversion: 2.20 time: 0.388659 Aug 25 05:34:40.838459 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 288/594] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:34:40 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1745 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:34:41.405922 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-39002d89-c46e-4880-9242-49a68954de52 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:41.408220 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-39002d89-c46e-4880-9242-49a68954de52 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:41.418171 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-39002d89-c46e-4880-9242-49a68954de52 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:41.419618 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-39002d89-c46e-4880-9242-49a68954de52 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:41.421412 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-39002d89-c46e-4880-9242-49a68954de52 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:41.422174 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-39002d89-c46e-4880-9242-49a68954de52 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:41.844984 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-34927431-320b-4249-a778-9306f454b740 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:41.846383 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-34927431-320b-4249-a778-9306f454b740 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:41.858816 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-34927431-320b-4249-a778-9306f454b740 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:41.861768 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-34927431-320b-4249-a778-9306f454b740 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:41.862830 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-34927431-320b-4249-a778-9306f454b740 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:41.863417 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-34927431-320b-4249-a778-9306f454b740 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:41.894180 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-39002d89-c46e-4880-9242-49a68954de52 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:41.908250 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-39002d89-c46e-4880-9242-49a68954de52 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1722 microversion: 2.1 time: 0.507892 Aug 25 05:34:41.923340 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 307/595] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:41 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1722 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:42.131803 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-34927431-320b-4249-a778-9306f454b740 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:42.147306 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-34927431-320b-4249-a778-9306f454b740 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:42.149780 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-34927431-320b-4249-a778-9306f454b740 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:42.154151 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-34927431-320b-4249-a778-9306f454b740 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1745 microversion: 2.20 time: 0.311023 Aug 25 05:34:42.154151 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 289/596] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:34:41 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1745 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:34:42.931907 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6cd02c95-5773-4e3c-aa60-6b9f629a0d1a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:42.937928 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6cd02c95-5773-4e3c-aa60-6b9f629a0d1a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:42.940330 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6cd02c95-5773-4e3c-aa60-6b9f629a0d1a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:42.940774 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6cd02c95-5773-4e3c-aa60-6b9f629a0d1a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:42.941556 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6cd02c95-5773-4e3c-aa60-6b9f629a0d1a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:42.942058 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6cd02c95-5773-4e3c-aa60-6b9f629a0d1a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:43.158418 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-6cd02c95-5773-4e3c-aa60-6b9f629a0d1a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:43.173663 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-08bdc84f-807f-4557-a71c-bdfef744458a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:43.174852 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6cd02c95-5773-4e3c-aa60-6b9f629a0d1a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1722 microversion: 2.1 time: 0.246502 Aug 25 05:34:43.175428 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-08bdc84f-807f-4557-a71c-bdfef744458a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:43.185667 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 308/597] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:42 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:34:43.194446 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-08bdc84f-807f-4557-a71c-bdfef744458a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:43.196824 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-08bdc84f-807f-4557-a71c-bdfef744458a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:43.197923 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-08bdc84f-807f-4557-a71c-bdfef744458a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:43.198654 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-08bdc84f-807f-4557-a71c-bdfef744458a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:43.482407 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-08bdc84f-807f-4557-a71c-bdfef744458a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:43.490738 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-08bdc84f-807f-4557-a71c-bdfef744458a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:43.492405 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-08bdc84f-807f-4557-a71c-bdfef744458a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:43.493594 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-08bdc84f-807f-4557-a71c-bdfef744458a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1745 microversion: 2.20 time: 0.325961 Aug 25 05:34:43.494375 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 290/598] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:34:43 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1745 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:34:44.192419 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-00661eea-a053-4976-a5d1-8b3711f5430e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:44.193118 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-00661eea-a053-4976-a5d1-8b3711f5430e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:44.199636 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-00661eea-a053-4976-a5d1-8b3711f5430e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:44.200141 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-00661eea-a053-4976-a5d1-8b3711f5430e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:44.200963 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-00661eea-a053-4976-a5d1-8b3711f5430e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:44.202229 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-00661eea-a053-4976-a5d1-8b3711f5430e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:44.513703 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a7f55287-7b03-47ae-b725-12ca565d0e1b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:44.514771 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a7f55287-7b03-47ae-b725-12ca565d0e1b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:44.520927 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a7f55287-7b03-47ae-b725-12ca565d0e1b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:44.521748 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a7f55287-7b03-47ae-b725-12ca565d0e1b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:44.522176 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a7f55287-7b03-47ae-b725-12ca565d0e1b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:44.522614 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a7f55287-7b03-47ae-b725-12ca565d0e1b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:44.761516 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-00661eea-a053-4976-a5d1-8b3711f5430e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:44.768176 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-a7f55287-7b03-47ae-b725-12ca565d0e1b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:44.797762 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-00661eea-a053-4976-a5d1-8b3711f5430e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1722 microversion: 2.1 time: 0.602241 Aug 25 05:34:44.799180 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 309/599] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:44 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1722 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:44.815624 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-a7f55287-7b03-47ae-b725-12ca565d0e1b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:44.820185 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-a7f55287-7b03-47ae-b725-12ca565d0e1b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:44.824055 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a7f55287-7b03-47ae-b725-12ca565d0e1b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1745 microversion: 2.20 time: 0.315552 Aug 25 05:34:44.825923 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 291/600] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:34:44 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1745 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:34:45.191179 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [req-31f7be09-18ef-4909-b8cc-9f4234eab817 req-a7072e3f-ecc9-42ef-9d7c-12bd2a71f801 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cb635d4-76ba-4143-8f4d-a64c720966da", "name": "network-vif-plugged", "status": "completed", "tag": "605f6633-54d1-4fa5-b498-9157fffe1b41"}]} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:34:45.195161 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:34:45.195161 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: warnings.warn(msg) Aug 25 05:34:45.207389 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-31f7be09-18ef-4909-b8cc-9f4234eab817 req-a7072e3f-ecc9-42ef-9d7c-12bd2a71f801 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:45.208087 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-31f7be09-18ef-4909-b8cc-9f4234eab817 req-a7072e3f-ecc9-42ef-9d7c-12bd2a71f801 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:45.261816 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.compute.server_external_events [req-31f7be09-18ef-4909-b8cc-9f4234eab817 req-a7072e3f-ecc9-42ef-9d7c-12bd2a71f801 service nova] Creating event network-vif-plugged:605f6633-54d1-4fa5-b498-9157fffe1b41 for instance 4cb635d4-76ba-4143-8f4d-a64c720966da on hv-cinder-78662 Aug 25 05:34:45.277494 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [req-31f7be09-18ef-4909-b8cc-9f4234eab817 req-a7072e3f-ecc9-42ef-9d7c-12bd2a71f801 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093089 Aug 25 05:34:45.283448 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 310/601] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:34:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:34:45.818458 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-9c88769e-4313-49d6-a08a-78e2e71f68ac tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:45.820439 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-9c88769e-4313-49d6-a08a-78e2e71f68ac tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:45.830550 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9c88769e-4313-49d6-a08a-78e2e71f68ac tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:45.831257 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9c88769e-4313-49d6-a08a-78e2e71f68ac tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:45.832734 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9c88769e-4313-49d6-a08a-78e2e71f68ac tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:45.833631 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9c88769e-4313-49d6-a08a-78e2e71f68ac tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:45.857301 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-dc6b2521-e718-41f3-8d44-a5940c96765e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:45.859054 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-dc6b2521-e718-41f3-8d44-a5940c96765e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:45.866603 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-dc6b2521-e718-41f3-8d44-a5940c96765e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:45.868042 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-dc6b2521-e718-41f3-8d44-a5940c96765e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:45.869413 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-dc6b2521-e718-41f3-8d44-a5940c96765e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:45.874662 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-dc6b2521-e718-41f3-8d44-a5940c96765e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:46.099098 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-9c88769e-4313-49d6-a08a-78e2e71f68ac tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:46.111699 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-9c88769e-4313-49d6-a08a-78e2e71f68ac tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1722 microversion: 2.1 time: 0.299000 Aug 25 05:34:46.119801 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 292/602] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:45 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1722 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:34:46.145879 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-dc6b2521-e718-41f3-8d44-a5940c96765e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:46.157707 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-dc6b2521-e718-41f3-8d44-a5940c96765e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:46.159549 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-dc6b2521-e718-41f3-8d44-a5940c96765e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:46.161024 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-dc6b2521-e718-41f3-8d44-a5940c96765e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1745 microversion: 2.20 time: 0.308489 Aug 25 05:34:46.162486 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 311/603] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:34:45 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1745 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:34:47.136323 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-91e4e9e1-5a5b-47b0-a150-374001d57a6f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:47.137656 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-91e4e9e1-5a5b-47b0-a150-374001d57a6f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:47.146625 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-91e4e9e1-5a5b-47b0-a150-374001d57a6f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:47.147382 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-91e4e9e1-5a5b-47b0-a150-374001d57a6f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:47.148403 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-91e4e9e1-5a5b-47b0-a150-374001d57a6f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:47.149158 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-91e4e9e1-5a5b-47b0-a150-374001d57a6f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:47.180524 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a371f590-a559-4f8f-a2cf-521ef3bb2fbd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:47.189778 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a371f590-a559-4f8f-a2cf-521ef3bb2fbd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:47.189778 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a371f590-a559-4f8f-a2cf-521ef3bb2fbd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:47.189778 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a371f590-a559-4f8f-a2cf-521ef3bb2fbd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:47.191404 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a371f590-a559-4f8f-a2cf-521ef3bb2fbd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:47.192066 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a371f590-a559-4f8f-a2cf-521ef3bb2fbd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:47.389550 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-91e4e9e1-5a5b-47b0-a150-374001d57a6f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:47.398921 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-91e4e9e1-5a5b-47b0-a150-374001d57a6f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1722 microversion: 2.1 time: 0.267001 Aug 25 05:34:47.410371 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 293/604] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:47 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1722 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:47.412745 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-a371f590-a559-4f8f-a2cf-521ef3bb2fbd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:47.421678 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-a371f590-a559-4f8f-a2cf-521ef3bb2fbd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:47.423187 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-a371f590-a559-4f8f-a2cf-521ef3bb2fbd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:47.424394 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a371f590-a559-4f8f-a2cf-521ef3bb2fbd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1745 microversion: 2.20 time: 0.247871 Aug 25 05:34:47.424972 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 312/605] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:34:47 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1745 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:34:48.416293 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ea5ed6c4-d89c-47b0-a8f3-68d2306b57b5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:48.417581 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ea5ed6c4-d89c-47b0-a8f3-68d2306b57b5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:48.424810 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ea5ed6c4-d89c-47b0-a8f3-68d2306b57b5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:48.425282 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ea5ed6c4-d89c-47b0-a8f3-68d2306b57b5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:48.426083 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ea5ed6c4-d89c-47b0-a8f3-68d2306b57b5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:48.426671 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ea5ed6c4-d89c-47b0-a8f3-68d2306b57b5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:48.444980 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7b1fe3de-dd51-4f29-ad63-74d410d7c45d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:48.445764 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-7b1fe3de-dd51-4f29-ad63-74d410d7c45d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:48.458062 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7b1fe3de-dd51-4f29-ad63-74d410d7c45d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:48.458588 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7b1fe3de-dd51-4f29-ad63-74d410d7c45d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:48.459477 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7b1fe3de-dd51-4f29-ad63-74d410d7c45d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:48.460013 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7b1fe3de-dd51-4f29-ad63-74d410d7c45d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:48.685106 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ea5ed6c4-d89c-47b0-a8f3-68d2306b57b5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:48.696763 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ea5ed6c4-d89c-47b0-a8f3-68d2306b57b5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1699 microversion: 2.1 time: 0.283860 Aug 25 05:34:48.696952 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-7b1fe3de-dd51-4f29-ad63-74d410d7c45d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:48.698301 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 294/606] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:48 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1699 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:48.718156 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1652c91d-c783-4512-8c44-8f92fe840a60 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:34:48.719188 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-7b1fe3de-dd51-4f29-ad63-74d410d7c45d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:48.723397 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-7b1fe3de-dd51-4f29-ad63-74d410d7c45d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:48.724583 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-7b1fe3de-dd51-4f29-ad63-74d410d7c45d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1745 microversion: 2.20 time: 0.283712 Aug 25 05:34:48.727281 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1652c91d-c783-4512-8c44-8f92fe840a60 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:48.727890 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1652c91d-c783-4512-8c44-8f92fe840a60 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:48.730500 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 313/607] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:34:48 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1745 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:34:48.800262 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1652c91d-c783-4512-8c44-8f92fe840a60 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Going to try to start instance {{(pid=108884) start /opt/stack/nova/nova/compute/api.py:2637}} Aug 25 05:34:48.997086 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1652c91d-c783-4512-8c44-8f92fe840a60 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 202 len: 0 microversion: 2.1 time: 0.285918 Aug 25 05:34:48.998802 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 295/608] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:34:48 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:34:49.014829 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-def2f031-e97f-478d-9e55-f4e1ff36583c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:49.015745 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-def2f031-e97f-478d-9e55-f4e1ff36583c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:49.025128 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-def2f031-e97f-478d-9e55-f4e1ff36583c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:49.031314 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-def2f031-e97f-478d-9e55-f4e1ff36583c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:49.032319 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-def2f031-e97f-478d-9e55-f4e1ff36583c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:49.032902 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-def2f031-e97f-478d-9e55-f4e1ff36583c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:49.307584 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-def2f031-e97f-478d-9e55-f4e1ff36583c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:49.319179 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-def2f031-e97f-478d-9e55-f4e1ff36583c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1708 microversion: 2.1 time: 0.313651 Aug 25 05:34:49.319776 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 314/609] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:49 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1708 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:49.753979 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1a581d30-a85b-4bed-aaed-a10e893a60a7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:49.755601 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1a581d30-a85b-4bed-aaed-a10e893a60a7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:49.771054 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1a581d30-a85b-4bed-aaed-a10e893a60a7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:49.771981 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1a581d30-a85b-4bed-aaed-a10e893a60a7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:49.773505 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1a581d30-a85b-4bed-aaed-a10e893a60a7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:49.774190 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1a581d30-a85b-4bed-aaed-a10e893a60a7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:49.978876 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-1a581d30-a85b-4bed-aaed-a10e893a60a7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:49.990315 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-1a581d30-a85b-4bed-aaed-a10e893a60a7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:49.992881 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-1a581d30-a85b-4bed-aaed-a10e893a60a7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:49.996572 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1a581d30-a85b-4bed-aaed-a10e893a60a7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1745 microversion: 2.20 time: 0.247462 Aug 25 05:34:50.006256 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 296/610] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:34:49 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1745 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:34:50.343083 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d022f0e3-916b-4f3c-8e9c-7b5df99581c2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:50.344659 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d022f0e3-916b-4f3c-8e9c-7b5df99581c2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:50.376716 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d022f0e3-916b-4f3c-8e9c-7b5df99581c2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:50.377728 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d022f0e3-916b-4f3c-8e9c-7b5df99581c2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:50.379048 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d022f0e3-916b-4f3c-8e9c-7b5df99581c2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:50.381180 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d022f0e3-916b-4f3c-8e9c-7b5df99581c2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:50.651225 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d022f0e3-916b-4f3c-8e9c-7b5df99581c2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:50.674148 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d022f0e3-916b-4f3c-8e9c-7b5df99581c2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1708 microversion: 2.1 time: 0.335515 Aug 25 05:34:50.675317 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 315/611] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:50 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1708 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:51.021213 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-4f0f7875-b75d-4a51-99f2-4f67cd431396 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:51.021869 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-4f0f7875-b75d-4a51-99f2-4f67cd431396 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:51.028879 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4f0f7875-b75d-4a51-99f2-4f67cd431396 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:51.033435 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4f0f7875-b75d-4a51-99f2-4f67cd431396 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:51.036955 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4f0f7875-b75d-4a51-99f2-4f67cd431396 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:51.037450 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4f0f7875-b75d-4a51-99f2-4f67cd431396 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:51.297564 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-4f0f7875-b75d-4a51-99f2-4f67cd431396 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:51.316172 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-4f0f7875-b75d-4a51-99f2-4f67cd431396 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:51.319269 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-4f0f7875-b75d-4a51-99f2-4f67cd431396 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:51.321658 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-4f0f7875-b75d-4a51-99f2-4f67cd431396 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1740 microversion: 2.20 time: 0.304324 Aug 25 05:34:51.335979 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 297/612] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:34:51 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1740 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:34:51.694146 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d94bb98a-97cc-4940-8072-b417ab8ab22b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:51.698297 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d94bb98a-97cc-4940-8072-b417ab8ab22b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:51.707418 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d94bb98a-97cc-4940-8072-b417ab8ab22b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:51.708594 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d94bb98a-97cc-4940-8072-b417ab8ab22b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:51.710359 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d94bb98a-97cc-4940-8072-b417ab8ab22b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:51.711277 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d94bb98a-97cc-4940-8072-b417ab8ab22b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:51.900117 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d94bb98a-97cc-4940-8072-b417ab8ab22b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:51.909189 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d94bb98a-97cc-4940-8072-b417ab8ab22b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1708 microversion: 2.1 time: 0.220856 Aug 25 05:34:51.909814 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 316/613] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:51 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1708 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:52.351600 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-abf575bd-03e9-4b81-9cbf-c41ebea4d44f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:52.352224 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-abf575bd-03e9-4b81-9cbf-c41ebea4d44f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:52.367052 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-abf575bd-03e9-4b81-9cbf-c41ebea4d44f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:52.369960 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-abf575bd-03e9-4b81-9cbf-c41ebea4d44f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:52.373332 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-abf575bd-03e9-4b81-9cbf-c41ebea4d44f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:52.373332 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-abf575bd-03e9-4b81-9cbf-c41ebea4d44f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:52.567884 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-abf575bd-03e9-4b81-9cbf-c41ebea4d44f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:52.578079 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-abf575bd-03e9-4b81-9cbf-c41ebea4d44f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:52.580502 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-abf575bd-03e9-4b81-9cbf-c41ebea4d44f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:52.582489 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-abf575bd-03e9-4b81-9cbf-c41ebea4d44f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1740 microversion: 2.20 time: 0.236722 Aug 25 05:34:52.583694 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 298/614] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:34:52 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1740 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:34:52.926390 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b9781685-c240-436e-8892-d3a40ab30ddd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:52.927001 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b9781685-c240-436e-8892-d3a40ab30ddd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:52.932736 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b9781685-c240-436e-8892-d3a40ab30ddd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:52.933189 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b9781685-c240-436e-8892-d3a40ab30ddd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:52.933987 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b9781685-c240-436e-8892-d3a40ab30ddd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:52.934425 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b9781685-c240-436e-8892-d3a40ab30ddd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:53.131235 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-b9781685-c240-436e-8892-d3a40ab30ddd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:53.146439 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b9781685-c240-436e-8892-d3a40ab30ddd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1708 microversion: 2.1 time: 0.221558 Aug 25 05:34:53.147802 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 317/615] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:52 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1708 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:53.600626 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-0bb8bf97-e7db-459b-b938-8aa9fe15305a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:53.601241 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-0bb8bf97-e7db-459b-b938-8aa9fe15305a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:53.608642 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0bb8bf97-e7db-459b-b938-8aa9fe15305a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:53.610394 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0bb8bf97-e7db-459b-b938-8aa9fe15305a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:53.611380 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0bb8bf97-e7db-459b-b938-8aa9fe15305a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:53.611826 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0bb8bf97-e7db-459b-b938-8aa9fe15305a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:53.805692 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-0bb8bf97-e7db-459b-b938-8aa9fe15305a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:53.817992 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-0bb8bf97-e7db-459b-b938-8aa9fe15305a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:53.820152 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-0bb8bf97-e7db-459b-b938-8aa9fe15305a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:53.821593 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-0bb8bf97-e7db-459b-b938-8aa9fe15305a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1740 microversion: 2.20 time: 0.224665 Aug 25 05:34:53.833369 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 299/616] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:34:53 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1740 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:34:54.165757 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-38a9359b-ca3c-45de-b583-910a57c455f9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:54.167162 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-38a9359b-ca3c-45de-b583-910a57c455f9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:54.174286 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-38a9359b-ca3c-45de-b583-910a57c455f9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:54.174953 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-38a9359b-ca3c-45de-b583-910a57c455f9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:54.175897 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-38a9359b-ca3c-45de-b583-910a57c455f9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:54.176488 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-38a9359b-ca3c-45de-b583-910a57c455f9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:54.382068 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-38a9359b-ca3c-45de-b583-910a57c455f9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:54.391767 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-38a9359b-ca3c-45de-b583-910a57c455f9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1708 microversion: 2.1 time: 0.229902 Aug 25 05:34:54.392811 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 318/617] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:54 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1708 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:54.839656 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6c8ae65f-a4d4-42fc-951d-6f569297e57c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:54.840266 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6c8ae65f-a4d4-42fc-951d-6f569297e57c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:54.853188 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6c8ae65f-a4d4-42fc-951d-6f569297e57c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:54.853668 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6c8ae65f-a4d4-42fc-951d-6f569297e57c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:54.854639 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6c8ae65f-a4d4-42fc-951d-6f569297e57c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:54.855301 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6c8ae65f-a4d4-42fc-951d-6f569297e57c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:55.012465 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6c8ae65f-a4d4-42fc-951d-6f569297e57c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:55.025656 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6c8ae65f-a4d4-42fc-951d-6f569297e57c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:55.028962 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6c8ae65f-a4d4-42fc-951d-6f569297e57c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:55.030697 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6c8ae65f-a4d4-42fc-951d-6f569297e57c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1740 microversion: 2.20 time: 0.194585 Aug 25 05:34:55.042128 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 300/618] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:34:54 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1740 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:34:55.410057 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f791eae0-46b2-42f2-931e-23fab3000abb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:55.410767 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f791eae0-46b2-42f2-931e-23fab3000abb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:55.420820 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f791eae0-46b2-42f2-931e-23fab3000abb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:55.421263 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f791eae0-46b2-42f2-931e-23fab3000abb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:55.422294 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f791eae0-46b2-42f2-931e-23fab3000abb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:55.422722 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f791eae0-46b2-42f2-931e-23fab3000abb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:55.634008 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-f791eae0-46b2-42f2-931e-23fab3000abb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:55.678692 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f791eae0-46b2-42f2-931e-23fab3000abb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1712 microversion: 2.1 time: 0.271882 Aug 25 05:34:55.683961 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 319/619] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:34:55 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1712 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:56.051265 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6d4f3721-732e-46b5-ad0b-678078f398ba tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:56.052028 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6d4f3721-732e-46b5-ad0b-678078f398ba tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:56.058604 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6d4f3721-732e-46b5-ad0b-678078f398ba tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:56.059172 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6d4f3721-732e-46b5-ad0b-678078f398ba tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:56.060002 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6d4f3721-732e-46b5-ad0b-678078f398ba tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:56.060711 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6d4f3721-732e-46b5-ad0b-678078f398ba tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:56.259388 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6d4f3721-732e-46b5-ad0b-678078f398ba tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:56.272699 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6d4f3721-732e-46b5-ad0b-678078f398ba tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:56.274182 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6d4f3721-732e-46b5-ad0b-678078f398ba tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:56.275385 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6d4f3721-732e-46b5-ad0b-678078f398ba tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1740 microversion: 2.20 time: 0.228385 Aug 25 05:34:56.275950 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 301/620] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:34:56 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1740 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:34:57.297084 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-066c7bff-2190-4acf-8da8-279135807a36 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:57.297739 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-066c7bff-2190-4acf-8da8-279135807a36 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:57.306084 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-066c7bff-2190-4acf-8da8-279135807a36 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:57.306781 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-066c7bff-2190-4acf-8da8-279135807a36 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:57.307769 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-066c7bff-2190-4acf-8da8-279135807a36 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:57.308376 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-066c7bff-2190-4acf-8da8-279135807a36 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:57.473847 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-066c7bff-2190-4acf-8da8-279135807a36 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:57.487516 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-066c7bff-2190-4acf-8da8-279135807a36 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:57.489614 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-066c7bff-2190-4acf-8da8-279135807a36 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:57.491235 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-066c7bff-2190-4acf-8da8-279135807a36 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1740 microversion: 2.20 time: 0.198961 Aug 25 05:34:57.496847 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 320/621] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:34:57 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1740 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:34:58.516351 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-612aba36-fb7b-4bd3-b6a3-341ec507d470 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:58.517956 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-612aba36-fb7b-4bd3-b6a3-341ec507d470 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:58.530676 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-612aba36-fb7b-4bd3-b6a3-341ec507d470 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:58.531648 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-612aba36-fb7b-4bd3-b6a3-341ec507d470 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:58.532776 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-612aba36-fb7b-4bd3-b6a3-341ec507d470 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:58.533614 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-612aba36-fb7b-4bd3-b6a3-341ec507d470 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:58.696292 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-612aba36-fb7b-4bd3-b6a3-341ec507d470 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:58.706859 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-612aba36-fb7b-4bd3-b6a3-341ec507d470 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:58.709137 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-612aba36-fb7b-4bd3-b6a3-341ec507d470 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:58.711099 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-612aba36-fb7b-4bd3-b6a3-341ec507d470 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1740 microversion: 2.20 time: 0.200744 Aug 25 05:34:58.715232 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 302/622] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:34:58 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1740 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:34:59.745983 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2a544252-90a5-4d94-bedf-6659c097ced1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:59.748789 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2a544252-90a5-4d94-bedf-6659c097ced1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:34:59.752524 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2a544252-90a5-4d94-bedf-6659c097ced1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:59.753082 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2a544252-90a5-4d94-bedf-6659c097ced1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:59.755144 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2a544252-90a5-4d94-bedf-6659c097ced1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:34:59.755144 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2a544252-90a5-4d94-bedf-6659c097ced1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:34:59.902015 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-2a544252-90a5-4d94-bedf-6659c097ced1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:59.911039 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-2a544252-90a5-4d94-bedf-6659c097ced1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:59.912728 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-2a544252-90a5-4d94-bedf-6659c097ced1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:59.913879 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2a544252-90a5-4d94-bedf-6659c097ced1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1740 microversion: 2.20 time: 0.172693 Aug 25 05:34:59.914730 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 321/623] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:34:59 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:35:00.934083 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-128e233f-99c3-4f70-9e40-50fd4689e1e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:00.935348 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-128e233f-99c3-4f70-9e40-50fd4689e1e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:00.945375 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-128e233f-99c3-4f70-9e40-50fd4689e1e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:00.946166 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-128e233f-99c3-4f70-9e40-50fd4689e1e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:00.947227 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-128e233f-99c3-4f70-9e40-50fd4689e1e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:00.947673 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-128e233f-99c3-4f70-9e40-50fd4689e1e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:01.104852 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-128e233f-99c3-4f70-9e40-50fd4689e1e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:01.115020 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-128e233f-99c3-4f70-9e40-50fd4689e1e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:01.117059 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-128e233f-99c3-4f70-9e40-50fd4689e1e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:01.118489 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-128e233f-99c3-4f70-9e40-50fd4689e1e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1740 microversion: 2.20 time: 0.188874 Aug 25 05:35:01.119668 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 303/624] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:00 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:35:02.139050 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-05d9186d-cbd1-49e1-9d7d-9f80bf679239 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:02.140289 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-05d9186d-cbd1-49e1-9d7d-9f80bf679239 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:02.146866 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-05d9186d-cbd1-49e1-9d7d-9f80bf679239 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:02.147541 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-05d9186d-cbd1-49e1-9d7d-9f80bf679239 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:02.148317 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-05d9186d-cbd1-49e1-9d7d-9f80bf679239 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:02.148909 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-05d9186d-cbd1-49e1-9d7d-9f80bf679239 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:02.364871 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-05d9186d-cbd1-49e1-9d7d-9f80bf679239 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:02.374303 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-05d9186d-cbd1-49e1-9d7d-9f80bf679239 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:02.376123 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-05d9186d-cbd1-49e1-9d7d-9f80bf679239 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:02.377279 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-05d9186d-cbd1-49e1-9d7d-9f80bf679239 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1740 microversion: 2.20 time: 0.242733 Aug 25 05:35:02.388443 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 322/625] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:02 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1740 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:35:03.396294 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e9cf0f28-5661-4316-a0dc-cece7b5a0dd1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:03.396959 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e9cf0f28-5661-4316-a0dc-cece7b5a0dd1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:03.403027 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e9cf0f28-5661-4316-a0dc-cece7b5a0dd1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:03.403746 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e9cf0f28-5661-4316-a0dc-cece7b5a0dd1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:03.404593 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e9cf0f28-5661-4316-a0dc-cece7b5a0dd1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:03.405029 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e9cf0f28-5661-4316-a0dc-cece7b5a0dd1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:03.543231 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e9cf0f28-5661-4316-a0dc-cece7b5a0dd1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:03.553330 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e9cf0f28-5661-4316-a0dc-cece7b5a0dd1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:03.555033 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e9cf0f28-5661-4316-a0dc-cece7b5a0dd1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:03.556237 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e9cf0f28-5661-4316-a0dc-cece7b5a0dd1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1740 microversion: 2.20 time: 0.163843 Aug 25 05:35:03.556742 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 304/626] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:03 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:35:04.577280 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-0bac4370-482c-47c2-8832-e7a6e9b681de tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:04.577907 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-0bac4370-482c-47c2-8832-e7a6e9b681de tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:04.584339 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0bac4370-482c-47c2-8832-e7a6e9b681de tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:04.584790 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0bac4370-482c-47c2-8832-e7a6e9b681de tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:04.585630 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0bac4370-482c-47c2-8832-e7a6e9b681de tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:04.586078 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0bac4370-482c-47c2-8832-e7a6e9b681de tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:04.729394 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-0bac4370-482c-47c2-8832-e7a6e9b681de tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:04.737944 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-0bac4370-482c-47c2-8832-e7a6e9b681de tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:04.739537 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-0bac4370-482c-47c2-8832-e7a6e9b681de tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:04.740676 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-0bac4370-482c-47c2-8832-e7a6e9b681de tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1740 microversion: 2.20 time: 0.168855 Aug 25 05:35:04.741229 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 323/627] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:04 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1740 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:35:05.759866 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-be4a6a80-773d-41ed-ad7a-2ab9a4dfaaa8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:05.760460 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-be4a6a80-773d-41ed-ad7a-2ab9a4dfaaa8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:05.767316 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-be4a6a80-773d-41ed-ad7a-2ab9a4dfaaa8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:05.767768 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-be4a6a80-773d-41ed-ad7a-2ab9a4dfaaa8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:05.768595 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-be4a6a80-773d-41ed-ad7a-2ab9a4dfaaa8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:05.769030 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-be4a6a80-773d-41ed-ad7a-2ab9a4dfaaa8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:05.899419 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-be4a6a80-773d-41ed-ad7a-2ab9a4dfaaa8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:05.908588 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-be4a6a80-773d-41ed-ad7a-2ab9a4dfaaa8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:05.910121 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-be4a6a80-773d-41ed-ad7a-2ab9a4dfaaa8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:05.911284 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-be4a6a80-773d-41ed-ad7a-2ab9a4dfaaa8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1740 microversion: 2.20 time: 0.155184 Aug 25 05:35:05.911830 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 305/628] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:05 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1740 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:35:06.930682 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6ac90fea-dcca-4129-949f-3b6f5c492080 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:06.931278 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6ac90fea-dcca-4129-949f-3b6f5c492080 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:06.937011 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6ac90fea-dcca-4129-949f-3b6f5c492080 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:06.937450 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6ac90fea-dcca-4129-949f-3b6f5c492080 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:06.938230 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6ac90fea-dcca-4129-949f-3b6f5c492080 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:06.938654 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6ac90fea-dcca-4129-949f-3b6f5c492080 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:07.079669 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-6ac90fea-dcca-4129-949f-3b6f5c492080 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:07.088171 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-6ac90fea-dcca-4129-949f-3b6f5c492080 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:07.089702 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-6ac90fea-dcca-4129-949f-3b6f5c492080 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:07.091373 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6ac90fea-dcca-4129-949f-3b6f5c492080 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1740 microversion: 2.20 time: 0.163960 Aug 25 05:35:07.091935 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 324/629] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:06 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:35:08.109862 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ce120a54-78eb-41b1-8d08-68f31dd5e4ea tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:08.110473 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ce120a54-78eb-41b1-8d08-68f31dd5e4ea tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:08.116432 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ce120a54-78eb-41b1-8d08-68f31dd5e4ea tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:08.116876 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ce120a54-78eb-41b1-8d08-68f31dd5e4ea tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:08.117668 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ce120a54-78eb-41b1-8d08-68f31dd5e4ea tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:08.118102 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ce120a54-78eb-41b1-8d08-68f31dd5e4ea tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:08.256670 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ce120a54-78eb-41b1-8d08-68f31dd5e4ea tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:08.265194 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ce120a54-78eb-41b1-8d08-68f31dd5e4ea tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:08.266815 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ce120a54-78eb-41b1-8d08-68f31dd5e4ea tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:08.267971 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ce120a54-78eb-41b1-8d08-68f31dd5e4ea tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1740 microversion: 2.20 time: 0.162471 Aug 25 05:35:08.273691 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 306/630] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:08 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:35:09.287931 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ea788516-9842-4faf-9112-9ad1649755f0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:09.288529 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ea788516-9842-4faf-9112-9ad1649755f0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:09.296751 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ea788516-9842-4faf-9112-9ad1649755f0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:09.297239 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ea788516-9842-4faf-9112-9ad1649755f0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:09.298218 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ea788516-9842-4faf-9112-9ad1649755f0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:09.298657 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ea788516-9842-4faf-9112-9ad1649755f0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:09.430804 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ea788516-9842-4faf-9112-9ad1649755f0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:09.439004 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ea788516-9842-4faf-9112-9ad1649755f0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:09.440963 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ea788516-9842-4faf-9112-9ad1649755f0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:09.442134 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ea788516-9842-4faf-9112-9ad1649755f0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1740 microversion: 2.20 time: 0.158034 Aug 25 05:35:09.442704 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 325/631] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:09 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:35:10.460133 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-44d1f4ef-dc4c-4871-aaa7-8972046c6f27 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:10.460758 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-44d1f4ef-dc4c-4871-aaa7-8972046c6f27 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:10.466983 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-44d1f4ef-dc4c-4871-aaa7-8972046c6f27 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:10.467446 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-44d1f4ef-dc4c-4871-aaa7-8972046c6f27 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:10.468209 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-44d1f4ef-dc4c-4871-aaa7-8972046c6f27 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:10.468633 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-44d1f4ef-dc4c-4871-aaa7-8972046c6f27 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:10.609670 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-44d1f4ef-dc4c-4871-aaa7-8972046c6f27 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:10.618133 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-44d1f4ef-dc4c-4871-aaa7-8972046c6f27 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:10.619641 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-44d1f4ef-dc4c-4871-aaa7-8972046c6f27 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:10.620805 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-44d1f4ef-dc4c-4871-aaa7-8972046c6f27 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1740 microversion: 2.20 time: 0.164537 Aug 25 05:35:10.621337 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 307/632] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:10 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:35:11.649799 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5126358f-c2df-4112-83b5-04504e2b6f9a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:11.650417 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5126358f-c2df-4112-83b5-04504e2b6f9a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:11.676705 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5126358f-c2df-4112-83b5-04504e2b6f9a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:11.677163 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5126358f-c2df-4112-83b5-04504e2b6f9a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:11.677998 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5126358f-c2df-4112-83b5-04504e2b6f9a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:11.678652 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5126358f-c2df-4112-83b5-04504e2b6f9a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:11.842139 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-5126358f-c2df-4112-83b5-04504e2b6f9a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:11.851182 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-5126358f-c2df-4112-83b5-04504e2b6f9a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:11.854181 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-5126358f-c2df-4112-83b5-04504e2b6f9a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:11.857026 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5126358f-c2df-4112-83b5-04504e2b6f9a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1722 microversion: 2.20 time: 0.216779 Aug 25 05:35:11.858575 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 326/633] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:11 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:35:12.876697 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-bc5be1eb-e69e-4977-b347-01f28fbbb177 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:12.878763 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-bc5be1eb-e69e-4977-b347-01f28fbbb177 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:12.883638 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bc5be1eb-e69e-4977-b347-01f28fbbb177 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:12.884089 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bc5be1eb-e69e-4977-b347-01f28fbbb177 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:12.886280 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bc5be1eb-e69e-4977-b347-01f28fbbb177 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:12.886280 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bc5be1eb-e69e-4977-b347-01f28fbbb177 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:13.024876 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-bc5be1eb-e69e-4977-b347-01f28fbbb177 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:13.033066 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-bc5be1eb-e69e-4977-b347-01f28fbbb177 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:13.034584 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-bc5be1eb-e69e-4977-b347-01f28fbbb177 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:13.035721 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-bc5be1eb-e69e-4977-b347-01f28fbbb177 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1722 microversion: 2.20 time: 0.163172 Aug 25 05:35:13.036285 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 308/634] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:12 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:35:14.053108 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1f114904-b19a-4483-9ae1-73d660ff0fde tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:14.053772 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1f114904-b19a-4483-9ae1-73d660ff0fde tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:14.059625 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1f114904-b19a-4483-9ae1-73d660ff0fde tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:14.060064 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1f114904-b19a-4483-9ae1-73d660ff0fde tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:14.061109 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1f114904-b19a-4483-9ae1-73d660ff0fde tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:14.061578 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1f114904-b19a-4483-9ae1-73d660ff0fde tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:14.186902 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-1f114904-b19a-4483-9ae1-73d660ff0fde tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:14.195516 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-1f114904-b19a-4483-9ae1-73d660ff0fde tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:14.196996 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-1f114904-b19a-4483-9ae1-73d660ff0fde tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:14.198166 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1f114904-b19a-4483-9ae1-73d660ff0fde tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1722 microversion: 2.20 time: 0.148838 Aug 25 05:35:14.198726 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 327/635] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:14 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:35:14.350818 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [req-280be160-eefe-4791-8ec6-1b42be767459 req-e4f9c0b0-c3d2-4458-a43b-3448a91c4a95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cb635d4-76ba-4143-8f4d-a64c720966da", "name": "network-vif-unplugged", "status": "completed", "tag": "605f6633-54d1-4fa5-b498-9157fffe1b41"}]} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:35:14.352433 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:35:14.352433 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: warnings.warn(msg) Aug 25 05:35:14.359245 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-280be160-eefe-4791-8ec6-1b42be767459 req-e4f9c0b0-c3d2-4458-a43b-3448a91c4a95 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:14.359722 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-280be160-eefe-4791-8ec6-1b42be767459 req-e4f9c0b0-c3d2-4458-a43b-3448a91c4a95 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:14.370637 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.compute.server_external_events [req-280be160-eefe-4791-8ec6-1b42be767459 req-e4f9c0b0-c3d2-4458-a43b-3448a91c4a95 service nova] Creating event network-vif-unplugged:605f6633-54d1-4fa5-b498-9157fffe1b41 for instance 4cb635d4-76ba-4143-8f4d-a64c720966da on hv-cinder-78662 Aug 25 05:35:14.375994 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [req-280be160-eefe-4791-8ec6-1b42be767459 req-e4f9c0b0-c3d2-4458-a43b-3448a91c4a95 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028721 Aug 25 05:35:14.376579 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 309/636] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:35:14 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:35:15.218945 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1d79b266-8d22-46d5-b551-dc3a5e658700 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:15.219621 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1d79b266-8d22-46d5-b551-dc3a5e658700 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:15.225713 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1d79b266-8d22-46d5-b551-dc3a5e658700 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:15.226158 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1d79b266-8d22-46d5-b551-dc3a5e658700 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:15.226928 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1d79b266-8d22-46d5-b551-dc3a5e658700 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:15.227361 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1d79b266-8d22-46d5-b551-dc3a5e658700 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:15.352839 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-1d79b266-8d22-46d5-b551-dc3a5e658700 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:15.361368 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-1d79b266-8d22-46d5-b551-dc3a5e658700 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:15.362869 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-1d79b266-8d22-46d5-b551-dc3a5e658700 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:15.364044 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1d79b266-8d22-46d5-b551-dc3a5e658700 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1722 microversion: 2.20 time: 0.149749 Aug 25 05:35:15.364627 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 328/637] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:15 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:35:16.383549 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e24eb25a-3933-407b-8908-d8df9a63f183 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:16.384154 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e24eb25a-3933-407b-8908-d8df9a63f183 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:16.390786 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e24eb25a-3933-407b-8908-d8df9a63f183 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:16.391228 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e24eb25a-3933-407b-8908-d8df9a63f183 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:16.392017 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e24eb25a-3933-407b-8908-d8df9a63f183 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:16.392461 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e24eb25a-3933-407b-8908-d8df9a63f183 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:16.523750 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e24eb25a-3933-407b-8908-d8df9a63f183 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:16.531820 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e24eb25a-3933-407b-8908-d8df9a63f183 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:16.533306 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e24eb25a-3933-407b-8908-d8df9a63f183 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:16.534473 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e24eb25a-3933-407b-8908-d8df9a63f183 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1722 microversion: 2.20 time: 0.155317 Aug 25 05:35:16.535029 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 310/638] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:16 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:35:17.554989 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f772f825-2866-4554-b594-7c396279472b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:17.555674 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f772f825-2866-4554-b594-7c396279472b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:17.562364 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f772f825-2866-4554-b594-7c396279472b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:17.562813 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f772f825-2866-4554-b594-7c396279472b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:17.563617 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f772f825-2866-4554-b594-7c396279472b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:17.564053 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f772f825-2866-4554-b594-7c396279472b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:17.692778 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-f772f825-2866-4554-b594-7c396279472b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:17.700764 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-f772f825-2866-4554-b594-7c396279472b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:17.702965 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-f772f825-2866-4554-b594-7c396279472b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:17.704155 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f772f825-2866-4554-b594-7c396279472b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1725 microversion: 2.20 time: 0.152881 Aug 25 05:35:17.704710 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 329/639] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:17 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:35:17.727176 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-024e777c-5d4c-4875-9f49-e4645e091a18 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0cc795f2-71c7-4a92-b053-54fa85cbf2e0"}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:35:17.728267 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-024e777c-5d4c-4875-9f49-e4645e091a18 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:17.735181 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-024e777c-5d4c-4875-9f49-e4645e091a18 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:17.735633 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-024e777c-5d4c-4875-9f49-e4645e091a18 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:17.736406 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-024e777c-5d4c-4875-9f49-e4645e091a18 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:17.736844 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-024e777c-5d4c-4875-9f49-e4645e091a18 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:18.034821 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c6509019-d48f-4e1b-bc61-c4a7079c314b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:18.035179 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c6509019-d48f-4e1b-bc61-c4a7079c314b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 92dd15ea-adff-40f8-86b3-3333f26586d5] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:18.041268 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c6509019-d48f-4e1b-bc61-c4a7079c314b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:18.041923 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c6509019-d48f-4e1b-bc61-c4a7079c314b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:18.042711 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c6509019-d48f-4e1b-bc61-c4a7079c314b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:18.043141 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c6509019-d48f-4e1b-bc61-c4a7079c314b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:18.154975 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.objects.instance [None req-c6509019-d48f-4e1b-bc61-c4a7079c314b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lazy-loading 'services' on Instance uuid 92dd15ea-adff-40f8-86b3-3333f26586d5 {{(pid=108885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 05:35:18.499523 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c6509019-d48f-4e1b-bc61-c4a7079c314b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "DELETE /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5/os-volume_attachments/0546dc97-6ead-4f59-a674-0382fb85f5bf" status: 202 len: 0 microversion: 2.1 time: 0.471405 Aug 25 05:35:18.500123 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 330/640] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 25 05:35:18 2021] DELETE /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5/os-volume_attachments/0546dc97-6ead-4f59-a674-0382fb85f5bf => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 05:35:18.864421 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-024e777c-5d4c-4875-9f49-e4645e091a18 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.141497 Aug 25 05:35:18.865034 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 311/641] 10.222.0.42 () {62 vars in 1364 bytes} [Wed Aug 25 05:35:17 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 188 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:35:19.027989 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-0bc41742-04cd-4b04-8708-29dc1bcb12b6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:35:19.028702 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-0bc41742-04cd-4b04-8708-29dc1bcb12b6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:19.035730 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0bc41742-04cd-4b04-8708-29dc1bcb12b6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:19.038071 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0bc41742-04cd-4b04-8708-29dc1bcb12b6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:19.038071 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0bc41742-04cd-4b04-8708-29dc1bcb12b6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:19.038071 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0bc41742-04cd-4b04-8708-29dc1bcb12b6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:19.331422 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-0bc41742-04cd-4b04-8708-29dc1bcb12b6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 202 len: 0 microversion: 2.20 time: 0.307428 Aug 25 05:35:19.332082 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 331/642] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:35:19 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 05:35:19.340096 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-4fb11b0e-6769-4477-9195-d4dc4c68367a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:19.340663 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-4fb11b0e-6769-4477-9195-d4dc4c68367a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:19.349146 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4fb11b0e-6769-4477-9195-d4dc4c68367a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:19.349618 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4fb11b0e-6769-4477-9195-d4dc4c68367a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:19.350909 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4fb11b0e-6769-4477-9195-d4dc4c68367a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:19.350909 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4fb11b0e-6769-4477-9195-d4dc4c68367a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:19.489211 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-4fb11b0e-6769-4477-9195-d4dc4c68367a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:19.497800 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-4fb11b0e-6769-4477-9195-d4dc4c68367a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:19.500022 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-4fb11b0e-6769-4477-9195-d4dc4c68367a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:19.501189 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-4fb11b0e-6769-4477-9195-d4dc4c68367a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1751 microversion: 2.20 time: 0.164872 Aug 25 05:35:19.501815 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 312/643] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:19 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:35:20.521629 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-12da610e-53f0-4483-b35c-644b7568b2e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:20.522439 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-12da610e-53f0-4483-b35c-644b7568b2e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:20.528474 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-12da610e-53f0-4483-b35c-644b7568b2e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:20.528921 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-12da610e-53f0-4483-b35c-644b7568b2e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:20.530662 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-12da610e-53f0-4483-b35c-644b7568b2e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:20.531115 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-12da610e-53f0-4483-b35c-644b7568b2e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:20.690679 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-12da610e-53f0-4483-b35c-644b7568b2e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:20.698885 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-12da610e-53f0-4483-b35c-644b7568b2e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:20.700373 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-12da610e-53f0-4483-b35c-644b7568b2e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:20.702160 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-12da610e-53f0-4483-b35c-644b7568b2e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1751 microversion: 2.20 time: 0.184206 Aug 25 05:35:20.702894 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 332/644] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:20 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1751 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:35:20.733947 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-115ce3b7-3f37-4d62-ab3b-34b310d02b65 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:20.734660 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-115ce3b7-3f37-4d62-ab3b-34b310d02b65 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 92dd15ea-adff-40f8-86b3-3333f26586d5] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:20.741000 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-115ce3b7-3f37-4d62-ab3b-34b310d02b65 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:20.741481 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-115ce3b7-3f37-4d62-ab3b-34b310d02b65 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:20.742301 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-115ce3b7-3f37-4d62-ab3b-34b310d02b65 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:20.742738 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-115ce3b7-3f37-4d62-ab3b-34b310d02b65 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:20.770954 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-115ce3b7-3f37-4d62-ab3b-34b310d02b65 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 92dd15ea-adff-40f8-86b3-3333f26586d5] Going to try to terminate instance {{(pid=108884) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 25 05:35:21.082929 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-115ce3b7-3f37-4d62-ab3b-34b310d02b65 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "DELETE /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5" status: 204 len: 0 microversion: 2.1 time: 0.353419 Aug 25 05:35:21.083565 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 313/645] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 25 05:35:20 2021] DELETE /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 05:35:21.091762 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-31597683-b872-4c40-b6bc-f359c421a004 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:21.092964 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-31597683-b872-4c40-b6bc-f359c421a004 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 92dd15ea-adff-40f8-86b3-3333f26586d5] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:21.098962 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-31597683-b872-4c40-b6bc-f359c421a004 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:21.099405 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-31597683-b872-4c40-b6bc-f359c421a004 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:21.100162 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-31597683-b872-4c40-b6bc-f359c421a004 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:21.100596 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-31597683-b872-4c40-b6bc-f359c421a004 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:21.226908 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-31597683-b872-4c40-b6bc-f359c421a004 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:21.234211 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-31597683-b872-4c40-b6bc-f359c421a004 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5" status: 200 len: 1514 microversion: 2.1 time: 0.146096 Aug 25 05:35:21.234771 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 333/646] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:35:21 2021] GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5 => generated 1514 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:35:21.721591 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ac3066d9-5c28-48ec-842a-dca057de65d8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:21.722213 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ac3066d9-5c28-48ec-842a-dca057de65d8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:21.727960 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ac3066d9-5c28-48ec-842a-dca057de65d8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:21.728399 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ac3066d9-5c28-48ec-842a-dca057de65d8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:21.729159 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ac3066d9-5c28-48ec-842a-dca057de65d8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:21.729615 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ac3066d9-5c28-48ec-842a-dca057de65d8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:21.862482 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ac3066d9-5c28-48ec-842a-dca057de65d8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:21.871205 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ac3066d9-5c28-48ec-842a-dca057de65d8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:21.872614 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ac3066d9-5c28-48ec-842a-dca057de65d8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:21.874668 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ac3066d9-5c28-48ec-842a-dca057de65d8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1753 microversion: 2.20 time: 0.157861 Aug 25 05:35:21.875298 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 314/647] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:21 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:35:22.252265 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-159ead6a-04ad-42cf-b9bb-7064f069c77e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:22.252857 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-159ead6a-04ad-42cf-b9bb-7064f069c77e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 92dd15ea-adff-40f8-86b3-3333f26586d5] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:22.258712 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-159ead6a-04ad-42cf-b9bb-7064f069c77e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:22.266144 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-159ead6a-04ad-42cf-b9bb-7064f069c77e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:22.266144 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-159ead6a-04ad-42cf-b9bb-7064f069c77e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:22.266144 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-159ead6a-04ad-42cf-b9bb-7064f069c77e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:22.398084 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-159ead6a-04ad-42cf-b9bb-7064f069c77e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:22.408511 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-159ead6a-04ad-42cf-b9bb-7064f069c77e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5" status: 200 len: 1514 microversion: 2.1 time: 0.160599 Aug 25 05:35:22.409080 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 334/648] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:35:22 2021] GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:35:22.893159 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-bbfef9c5-4d1b-41df-b56a-db0f58f211f3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:22.893785 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-bbfef9c5-4d1b-41df-b56a-db0f58f211f3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:22.902130 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bbfef9c5-4d1b-41df-b56a-db0f58f211f3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:22.902581 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bbfef9c5-4d1b-41df-b56a-db0f58f211f3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:22.903428 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bbfef9c5-4d1b-41df-b56a-db0f58f211f3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:22.903865 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bbfef9c5-4d1b-41df-b56a-db0f58f211f3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:23.031504 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-bbfef9c5-4d1b-41df-b56a-db0f58f211f3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:23.041953 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-bbfef9c5-4d1b-41df-b56a-db0f58f211f3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:23.043449 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-bbfef9c5-4d1b-41df-b56a-db0f58f211f3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:23.044603 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-bbfef9c5-4d1b-41df-b56a-db0f58f211f3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1809 microversion: 2.20 time: 0.155490 Aug 25 05:35:23.045341 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 315/649] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:22 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:35:23.426346 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-aaa5d058-886c-430c-b983-97a189097fd2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:23.427013 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-aaa5d058-886c-430c-b983-97a189097fd2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 92dd15ea-adff-40f8-86b3-3333f26586d5] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:23.433553 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-aaa5d058-886c-430c-b983-97a189097fd2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:23.434021 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-aaa5d058-886c-430c-b983-97a189097fd2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:23.439008 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-aaa5d058-886c-430c-b983-97a189097fd2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:23.439008 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-aaa5d058-886c-430c-b983-97a189097fd2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:23.572879 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-aaa5d058-886c-430c-b983-97a189097fd2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:23.581432 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-aaa5d058-886c-430c-b983-97a189097fd2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5" status: 200 len: 1514 microversion: 2.1 time: 0.158645 Aug 25 05:35:23.582204 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 335/650] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:35:23 2021] GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:35:24.065157 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-cd09fb7e-bbe1-4892-a1e1-bdab88e836d3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:24.065826 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-cd09fb7e-bbe1-4892-a1e1-bdab88e836d3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:24.072791 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cd09fb7e-bbe1-4892-a1e1-bdab88e836d3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:24.073291 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cd09fb7e-bbe1-4892-a1e1-bdab88e836d3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:24.074880 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cd09fb7e-bbe1-4892-a1e1-bdab88e836d3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:24.075582 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cd09fb7e-bbe1-4892-a1e1-bdab88e836d3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:24.087216 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [req-fe6a6a64-f25f-4b94-ad98-77b61c6711f1 req-bc7a26d8-75cb-483e-8997-cc92c2efd9d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92dd15ea-adff-40f8-86b3-3333f26586d5", "name": "network-vif-deleted", "tag": "ead2fa26-3920-4558-83c9-db855966516e"}]} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:35:24.089668 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:35:24.089668 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: warnings.warn(msg) Aug 25 05:35:24.097746 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-fe6a6a64-f25f-4b94-ad98-77b61c6711f1 req-bc7a26d8-75cb-483e-8997-cc92c2efd9d8 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:24.098185 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-fe6a6a64-f25f-4b94-ad98-77b61c6711f1 req-bc7a26d8-75cb-483e-8997-cc92c2efd9d8 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:24.110698 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.compute.server_external_events [req-fe6a6a64-f25f-4b94-ad98-77b61c6711f1 req-bc7a26d8-75cb-483e-8997-cc92c2efd9d8 service nova] Creating event network-vif-deleted:ead2fa26-3920-4558-83c9-db855966516e for instance 92dd15ea-adff-40f8-86b3-3333f26586d5 on hv-cinder-78662 Aug 25 05:35:24.115579 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [req-fe6a6a64-f25f-4b94-ad98-77b61c6711f1 req-bc7a26d8-75cb-483e-8997-cc92c2efd9d8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031899 Aug 25 05:35:24.116476 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 336/651] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:35:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:35:24.211285 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-cd09fb7e-bbe1-4892-a1e1-bdab88e836d3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:24.220197 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-cd09fb7e-bbe1-4892-a1e1-bdab88e836d3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:24.221775 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-cd09fb7e-bbe1-4892-a1e1-bdab88e836d3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:24.223053 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-cd09fb7e-bbe1-4892-a1e1-bdab88e836d3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1809 microversion: 2.20 time: 0.162947 Aug 25 05:35:24.223615 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 316/652] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:24 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:35:24.599508 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-bd8a14c0-9240-467e-803e-b3ff38a4db3c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:24.600198 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-bd8a14c0-9240-467e-803e-b3ff38a4db3c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 92dd15ea-adff-40f8-86b3-3333f26586d5] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:24.606669 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bd8a14c0-9240-467e-803e-b3ff38a4db3c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:24.607124 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bd8a14c0-9240-467e-803e-b3ff38a4db3c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:24.608381 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bd8a14c0-9240-467e-803e-b3ff38a4db3c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:24.608809 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bd8a14c0-9240-467e-803e-b3ff38a4db3c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:24.644724 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bd8a14c0-9240-467e-803e-b3ff38a4db3c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:24.645167 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bd8a14c0-9240-467e-803e-b3ff38a4db3c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:24.645667 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.objects.instance [None req-bd8a14c0-9240-467e-803e-b3ff38a4db3c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lazy-loading 'fault' on Instance uuid 92dd15ea-adff-40f8-86b3-3333f26586d5 {{(pid=108885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 05:35:24.699277 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-bd8a14c0-9240-467e-803e-b3ff38a4db3c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:24.708927 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-bd8a14c0-9240-467e-803e-b3ff38a4db3c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5" status: 200 len: 1309 microversion: 2.1 time: 0.113402 Aug 25 05:35:24.709498 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 337/653] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:35:24 2021] GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5 => generated 1309 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:35:25.243759 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-51a1af85-3665-4ba3-9051-7737ec12151d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:25.246018 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-51a1af85-3665-4ba3-9051-7737ec12151d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:25.274010 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-51a1af85-3665-4ba3-9051-7737ec12151d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:25.274010 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-51a1af85-3665-4ba3-9051-7737ec12151d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:25.274010 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-51a1af85-3665-4ba3-9051-7737ec12151d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:25.274010 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-51a1af85-3665-4ba3-9051-7737ec12151d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:25.441420 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-51a1af85-3665-4ba3-9051-7737ec12151d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:25.450668 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-51a1af85-3665-4ba3-9051-7737ec12151d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:25.455229 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-51a1af85-3665-4ba3-9051-7737ec12151d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:25.456473 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-51a1af85-3665-4ba3-9051-7737ec12151d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1809 microversion: 2.20 time: 0.217566 Aug 25 05:35:25.457391 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 317/654] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:25 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1809 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:35:25.726033 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-bef53300-48ec-4e76-8a0f-9cb56803eb4e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:25.727232 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-bef53300-48ec-4e76-8a0f-9cb56803eb4e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 92dd15ea-adff-40f8-86b3-3333f26586d5] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:25.734763 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bef53300-48ec-4e76-8a0f-9cb56803eb4e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:25.735428 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bef53300-48ec-4e76-8a0f-9cb56803eb4e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:25.736368 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bef53300-48ec-4e76-8a0f-9cb56803eb4e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:25.736791 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bef53300-48ec-4e76-8a0f-9cb56803eb4e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:25.778176 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bef53300-48ec-4e76-8a0f-9cb56803eb4e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:25.778920 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bef53300-48ec-4e76-8a0f-9cb56803eb4e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:25.780552 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.objects.instance [None req-bef53300-48ec-4e76-8a0f-9cb56803eb4e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lazy-loading 'fault' on Instance uuid 92dd15ea-adff-40f8-86b3-3333f26586d5 {{(pid=108885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 05:35:25.844120 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-bef53300-48ec-4e76-8a0f-9cb56803eb4e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:25.857485 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-bef53300-48ec-4e76-8a0f-9cb56803eb4e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5" status: 200 len: 1309 microversion: 2.1 time: 0.134992 Aug 25 05:35:25.861705 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 338/655] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:35:25 2021] GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5 => generated 1309 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:35:26.480048 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-0c559dba-b047-4588-816f-c1c9f744118a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:26.481497 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-0c559dba-b047-4588-816f-c1c9f744118a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:26.489775 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0c559dba-b047-4588-816f-c1c9f744118a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:26.490304 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0c559dba-b047-4588-816f-c1c9f744118a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:26.491200 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0c559dba-b047-4588-816f-c1c9f744118a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:26.491693 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0c559dba-b047-4588-816f-c1c9f744118a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:26.693904 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-0c559dba-b047-4588-816f-c1c9f744118a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:26.705547 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-0c559dba-b047-4588-816f-c1c9f744118a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:26.707626 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-0c559dba-b047-4588-816f-c1c9f744118a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:26.709195 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-0c559dba-b047-4588-816f-c1c9f744118a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1809 microversion: 2.20 time: 0.236108 Aug 25 05:35:26.720966 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 318/656] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:26 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1809 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:35:26.890454 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-63b2f215-91fa-423c-9427-d2cd85d88650 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:26.892748 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-63b2f215-91fa-423c-9427-d2cd85d88650 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 92dd15ea-adff-40f8-86b3-3333f26586d5] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:26.907441 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-63b2f215-91fa-423c-9427-d2cd85d88650 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:26.908655 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-63b2f215-91fa-423c-9427-d2cd85d88650 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:26.910513 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-63b2f215-91fa-423c-9427-d2cd85d88650 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:26.911538 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-63b2f215-91fa-423c-9427-d2cd85d88650 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:26.993322 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-63b2f215-91fa-423c-9427-d2cd85d88650 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:26.994271 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-63b2f215-91fa-423c-9427-d2cd85d88650 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:26.995066 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.objects.instance [None req-63b2f215-91fa-423c-9427-d2cd85d88650 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lazy-loading 'fault' on Instance uuid 92dd15ea-adff-40f8-86b3-3333f26586d5 {{(pid=108885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 05:35:27.057143 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-63b2f215-91fa-423c-9427-d2cd85d88650 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:27.071395 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-63b2f215-91fa-423c-9427-d2cd85d88650 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5" status: 200 len: 1309 microversion: 2.1 time: 0.189870 Aug 25 05:35:27.072043 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 339/657] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:35:26 2021] GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5 => generated 1309 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:35:27.730390 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-9306c3d4-6fd6-4940-b7e5-4ae318b2b785 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:27.732467 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-9306c3d4-6fd6-4940-b7e5-4ae318b2b785 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:27.753350 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9306c3d4-6fd6-4940-b7e5-4ae318b2b785 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:27.759503 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9306c3d4-6fd6-4940-b7e5-4ae318b2b785 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:27.759503 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9306c3d4-6fd6-4940-b7e5-4ae318b2b785 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:27.759503 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9306c3d4-6fd6-4940-b7e5-4ae318b2b785 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:28.016636 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-9306c3d4-6fd6-4940-b7e5-4ae318b2b785 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:28.031048 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-9306c3d4-6fd6-4940-b7e5-4ae318b2b785 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:28.033611 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-9306c3d4-6fd6-4940-b7e5-4ae318b2b785 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:28.035394 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-9306c3d4-6fd6-4940-b7e5-4ae318b2b785 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1809 microversion: 2.20 time: 0.310790 Aug 25 05:35:28.036102 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 319/658] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:27 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1809 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:35:28.099556 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d4cb7b9d-0fec-469e-a985-1ffd53550ee7 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:28.101026 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d4cb7b9d-0fec-469e-a985-1ffd53550ee7 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 92dd15ea-adff-40f8-86b3-3333f26586d5] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:28.116586 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d4cb7b9d-0fec-469e-a985-1ffd53550ee7 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:28.117945 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d4cb7b9d-0fec-469e-a985-1ffd53550ee7 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:28.119458 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d4cb7b9d-0fec-469e-a985-1ffd53550ee7 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:28.120287 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d4cb7b9d-0fec-469e-a985-1ffd53550ee7 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:28.182834 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d4cb7b9d-0fec-469e-a985-1ffd53550ee7 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:28.183553 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d4cb7b9d-0fec-469e-a985-1ffd53550ee7 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:28.184019 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.objects.instance [None req-d4cb7b9d-0fec-469e-a985-1ffd53550ee7 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lazy-loading 'fault' on Instance uuid 92dd15ea-adff-40f8-86b3-3333f26586d5 {{(pid=108885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 05:35:28.235706 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d4cb7b9d-0fec-469e-a985-1ffd53550ee7 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:28.243884 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d4cb7b9d-0fec-469e-a985-1ffd53550ee7 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5" status: 200 len: 1309 microversion: 2.1 time: 0.155668 Aug 25 05:35:28.244710 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 340/659] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:35:28 2021] GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5 => generated 1309 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:35:29.056973 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-45874eb0-767f-48ac-a866-4f261c5e2eeb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:29.058048 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-45874eb0-767f-48ac-a866-4f261c5e2eeb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:29.065378 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-45874eb0-767f-48ac-a866-4f261c5e2eeb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:29.070070 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-45874eb0-767f-48ac-a866-4f261c5e2eeb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:29.076347 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-45874eb0-767f-48ac-a866-4f261c5e2eeb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:29.077172 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-45874eb0-767f-48ac-a866-4f261c5e2eeb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:29.267754 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e96a0214-1c3c-49a3-a4c7-d9505c3eb5cc tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:29.268630 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e96a0214-1c3c-49a3-a4c7-d9505c3eb5cc tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 92dd15ea-adff-40f8-86b3-3333f26586d5] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:29.277709 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e96a0214-1c3c-49a3-a4c7-d9505c3eb5cc tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:29.278317 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e96a0214-1c3c-49a3-a4c7-d9505c3eb5cc tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:29.279219 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e96a0214-1c3c-49a3-a4c7-d9505c3eb5cc tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:29.279990 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e96a0214-1c3c-49a3-a4c7-d9505c3eb5cc tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:29.326066 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e96a0214-1c3c-49a3-a4c7-d9505c3eb5cc tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:29.326544 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e96a0214-1c3c-49a3-a4c7-d9505c3eb5cc tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:29.327205 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.objects.instance [None req-e96a0214-1c3c-49a3-a4c7-d9505c3eb5cc tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lazy-loading 'fault' on Instance uuid 92dd15ea-adff-40f8-86b3-3333f26586d5 {{(pid=108885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 05:35:29.365972 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-45874eb0-767f-48ac-a866-4f261c5e2eeb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:29.382666 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-45874eb0-767f-48ac-a866-4f261c5e2eeb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:29.382666 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-45874eb0-767f-48ac-a866-4f261c5e2eeb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:29.383943 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-45874eb0-767f-48ac-a866-4f261c5e2eeb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1809 microversion: 2.20 time: 0.331218 Aug 25 05:35:29.384689 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 320/660] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:29 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1809 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:35:29.392863 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-e96a0214-1c3c-49a3-a4c7-d9505c3eb5cc tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:29.407607 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e96a0214-1c3c-49a3-a4c7-d9505c3eb5cc tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5" status: 200 len: 1309 microversion: 2.1 time: 0.144552 Aug 25 05:35:29.416510 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 341/661] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:35:29 2021] GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5 => generated 1309 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:35:30.414184 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-f3a76b08-9cc1-4b7c-92d4-22dc96a9bab4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:30.417414 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-f3a76b08-9cc1-4b7c-92d4-22dc96a9bab4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:30.444607 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5c211985-d32c-4133-abdb-08b5d0c1d374 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:30.453267 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f3a76b08-9cc1-4b7c-92d4-22dc96a9bab4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:30.453790 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f3a76b08-9cc1-4b7c-92d4-22dc96a9bab4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:30.453958 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5c211985-d32c-4133-abdb-08b5d0c1d374 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 92dd15ea-adff-40f8-86b3-3333f26586d5] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:30.454644 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f3a76b08-9cc1-4b7c-92d4-22dc96a9bab4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:30.455084 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f3a76b08-9cc1-4b7c-92d4-22dc96a9bab4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:30.466123 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5c211985-d32c-4133-abdb-08b5d0c1d374 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:30.467898 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5c211985-d32c-4133-abdb-08b5d0c1d374 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:30.469390 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5c211985-d32c-4133-abdb-08b5d0c1d374 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:30.470181 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5c211985-d32c-4133-abdb-08b5d0c1d374 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:30.543482 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5c211985-d32c-4133-abdb-08b5d0c1d374 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:30.545088 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5c211985-d32c-4133-abdb-08b5d0c1d374 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:30.546472 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.objects.instance [None req-5c211985-d32c-4133-abdb-08b5d0c1d374 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lazy-loading 'fault' on Instance uuid 92dd15ea-adff-40f8-86b3-3333f26586d5 {{(pid=108885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 05:35:30.749779 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-5c211985-d32c-4133-abdb-08b5d0c1d374 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:30.762327 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5c211985-d32c-4133-abdb-08b5d0c1d374 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5" status: 200 len: 1309 microversion: 2.1 time: 0.326456 Aug 25 05:35:30.764916 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 342/662] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:35:30 2021] GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5 => generated 1309 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:35:31.549228 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-f3a76b08-9cc1-4b7c-92d4-22dc96a9bab4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:31.585874 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-f3a76b08-9cc1-4b7c-92d4-22dc96a9bab4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:31.588882 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-f3a76b08-9cc1-4b7c-92d4-22dc96a9bab4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:31.596087 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-f3a76b08-9cc1-4b7c-92d4-22dc96a9bab4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1809 microversion: 2.20 time: 1.193994 Aug 25 05:35:31.601402 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 321/663] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:30 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1809 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:35:31.783126 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9c175cea-f8f7-41d0-969b-2f0d2566c9da tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:31.783756 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9c175cea-f8f7-41d0-969b-2f0d2566c9da tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 92dd15ea-adff-40f8-86b3-3333f26586d5] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:31.808608 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9c175cea-f8f7-41d0-969b-2f0d2566c9da tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:31.812880 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9c175cea-f8f7-41d0-969b-2f0d2566c9da tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:31.815149 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9c175cea-f8f7-41d0-969b-2f0d2566c9da tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:31.816621 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9c175cea-f8f7-41d0-969b-2f0d2566c9da tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:31.940108 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9c175cea-f8f7-41d0-969b-2f0d2566c9da tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:31.942087 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9c175cea-f8f7-41d0-969b-2f0d2566c9da tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:31.945605 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.objects.instance [None req-9c175cea-f8f7-41d0-969b-2f0d2566c9da tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lazy-loading 'fault' on Instance uuid 92dd15ea-adff-40f8-86b3-3333f26586d5 {{(pid=108885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 05:35:32.044058 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-9c175cea-f8f7-41d0-969b-2f0d2566c9da tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:32.057554 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9c175cea-f8f7-41d0-969b-2f0d2566c9da tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5" status: 200 len: 1309 microversion: 2.1 time: 0.277759 Aug 25 05:35:32.057778 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 343/664] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:35:31 2021] GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5 => generated 1309 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:35:32.632616 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-09452d4c-31e5-4722-827a-dca24cc5fd6c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:32.635553 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-09452d4c-31e5-4722-827a-dca24cc5fd6c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:32.671639 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-09452d4c-31e5-4722-827a-dca24cc5fd6c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:32.684804 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-09452d4c-31e5-4722-827a-dca24cc5fd6c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:32.690151 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-09452d4c-31e5-4722-827a-dca24cc5fd6c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:32.692743 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-09452d4c-31e5-4722-827a-dca24cc5fd6c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:33.080220 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6f9137b3-42c3-4ce5-a6e7-29cf571d6240 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:33.081501 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6f9137b3-42c3-4ce5-a6e7-29cf571d6240 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 92dd15ea-adff-40f8-86b3-3333f26586d5] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:33.094696 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6f9137b3-42c3-4ce5-a6e7-29cf571d6240 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:33.095431 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6f9137b3-42c3-4ce5-a6e7-29cf571d6240 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:33.096413 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6f9137b3-42c3-4ce5-a6e7-29cf571d6240 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:33.100196 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6f9137b3-42c3-4ce5-a6e7-29cf571d6240 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:33.167929 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6f9137b3-42c3-4ce5-a6e7-29cf571d6240 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:33.168716 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6f9137b3-42c3-4ce5-a6e7-29cf571d6240 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:33.169496 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.objects.instance [None req-6f9137b3-42c3-4ce5-a6e7-29cf571d6240 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lazy-loading 'fault' on Instance uuid 92dd15ea-adff-40f8-86b3-3333f26586d5 {{(pid=108885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 05:35:33.338283 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-09452d4c-31e5-4722-827a-dca24cc5fd6c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:33.359346 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-09452d4c-31e5-4722-827a-dca24cc5fd6c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:33.363000 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-6f9137b3-42c3-4ce5-a6e7-29cf571d6240 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:33.393773 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-09452d4c-31e5-4722-827a-dca24cc5fd6c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:33.394286 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6f9137b3-42c3-4ce5-a6e7-29cf571d6240 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5" status: 200 len: 1309 microversion: 2.1 time: 0.306633 Aug 25 05:35:33.398222 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 344/665] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:35:33 2021] GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5 => generated 1309 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:35:33.402248 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-09452d4c-31e5-4722-827a-dca24cc5fd6c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1809 microversion: 2.20 time: 0.776899 Aug 25 05:35:33.403244 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 322/666] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:32 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1809 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:35:34.402032 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-36020a56-30d7-4e69-ae5c-ca19c5cf2494 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:34.403333 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-36020a56-30d7-4e69-ae5c-ca19c5cf2494 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 92dd15ea-adff-40f8-86b3-3333f26586d5] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:34.409852 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-36020a56-30d7-4e69-ae5c-ca19c5cf2494 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:34.410700 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-36020a56-30d7-4e69-ae5c-ca19c5cf2494 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:34.411692 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-36020a56-30d7-4e69-ae5c-ca19c5cf2494 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:34.412730 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-36020a56-30d7-4e69-ae5c-ca19c5cf2494 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:34.434253 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-800e43a1-ece9-437b-9a63-1e1282787313 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:34.436034 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-800e43a1-ece9-437b-9a63-1e1282787313 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:34.452960 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-800e43a1-ece9-437b-9a63-1e1282787313 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:34.453412 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-800e43a1-ece9-437b-9a63-1e1282787313 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:34.455941 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-36020a56-30d7-4e69-ae5c-ca19c5cf2494 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:34.456518 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-800e43a1-ece9-437b-9a63-1e1282787313 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:34.456912 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-36020a56-30d7-4e69-ae5c-ca19c5cf2494 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:34.457163 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-800e43a1-ece9-437b-9a63-1e1282787313 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:34.457896 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.objects.instance [None req-36020a56-30d7-4e69-ae5c-ca19c5cf2494 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lazy-loading 'fault' on Instance uuid 92dd15ea-adff-40f8-86b3-3333f26586d5 {{(pid=108885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 05:35:34.593436 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-36020a56-30d7-4e69-ae5c-ca19c5cf2494 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:34.641421 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-36020a56-30d7-4e69-ae5c-ca19c5cf2494 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5" status: 200 len: 1309 microversion: 2.1 time: 0.243020 Aug 25 05:35:34.645873 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 345/667] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:35:34 2021] GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5 => generated 1309 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:35:34.959651 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-800e43a1-ece9-437b-9a63-1e1282787313 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:34.977663 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-800e43a1-ece9-437b-9a63-1e1282787313 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:34.982766 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-800e43a1-ece9-437b-9a63-1e1282787313 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:34.986122 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-800e43a1-ece9-437b-9a63-1e1282787313 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1809 microversion: 2.20 time: 0.558068 Aug 25 05:35:34.988221 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 323/668] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:34 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1809 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:35:35.666064 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1a89aa6f-81a8-4093-bdc4-cc8d6a8c188c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:35.667101 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1a89aa6f-81a8-4093-bdc4-cc8d6a8c188c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 92dd15ea-adff-40f8-86b3-3333f26586d5] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:35.676179 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1a89aa6f-81a8-4093-bdc4-cc8d6a8c188c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:35.676628 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1a89aa6f-81a8-4093-bdc4-cc8d6a8c188c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:35.677420 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1a89aa6f-81a8-4093-bdc4-cc8d6a8c188c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:35.678107 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1a89aa6f-81a8-4093-bdc4-cc8d6a8c188c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:35.712578 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1a89aa6f-81a8-4093-bdc4-cc8d6a8c188c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:35.713035 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1a89aa6f-81a8-4093-bdc4-cc8d6a8c188c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:35.713483 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.objects.instance [None req-1a89aa6f-81a8-4093-bdc4-cc8d6a8c188c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lazy-loading 'fault' on Instance uuid 92dd15ea-adff-40f8-86b3-3333f26586d5 {{(pid=108885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 05:35:35.774651 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-1a89aa6f-81a8-4093-bdc4-cc8d6a8c188c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:35.786096 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1a89aa6f-81a8-4093-bdc4-cc8d6a8c188c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5" status: 200 len: 1309 microversion: 2.1 time: 0.125440 Aug 25 05:35:35.786834 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 346/669] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:35:35 2021] GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5 => generated 1309 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:35:36.016125 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-462f685a-7595-4ee9-8008-db74dbcef9f2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:36.018553 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-462f685a-7595-4ee9-8008-db74dbcef9f2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:36.035211 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-462f685a-7595-4ee9-8008-db74dbcef9f2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:36.039811 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-462f685a-7595-4ee9-8008-db74dbcef9f2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:36.043899 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-462f685a-7595-4ee9-8008-db74dbcef9f2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:36.043899 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-462f685a-7595-4ee9-8008-db74dbcef9f2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:36.383332 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-462f685a-7595-4ee9-8008-db74dbcef9f2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:36.397579 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-462f685a-7595-4ee9-8008-db74dbcef9f2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:36.408544 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-462f685a-7595-4ee9-8008-db74dbcef9f2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:36.408544 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-462f685a-7595-4ee9-8008-db74dbcef9f2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1809 microversion: 2.20 time: 0.398815 Aug 25 05:35:36.408544 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 324/670] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:36 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1809 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:35:36.805086 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b22672ff-61ad-4d1d-87b0-0307dc7bcdd5 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:36.805754 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b22672ff-61ad-4d1d-87b0-0307dc7bcdd5 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 92dd15ea-adff-40f8-86b3-3333f26586d5] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:36.827931 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b22672ff-61ad-4d1d-87b0-0307dc7bcdd5 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:36.828384 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b22672ff-61ad-4d1d-87b0-0307dc7bcdd5 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:36.829181 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b22672ff-61ad-4d1d-87b0-0307dc7bcdd5 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:36.829655 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b22672ff-61ad-4d1d-87b0-0307dc7bcdd5 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:36.899382 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b22672ff-61ad-4d1d-87b0-0307dc7bcdd5 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:36.900098 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b22672ff-61ad-4d1d-87b0-0307dc7bcdd5 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:36.900746 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.objects.instance [None req-b22672ff-61ad-4d1d-87b0-0307dc7bcdd5 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lazy-loading 'fault' on Instance uuid 92dd15ea-adff-40f8-86b3-3333f26586d5 {{(pid=108885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 05:35:37.225777 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-b22672ff-61ad-4d1d-87b0-0307dc7bcdd5 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:37.240268 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b22672ff-61ad-4d1d-87b0-0307dc7bcdd5 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5" status: 200 len: 1309 microversion: 2.1 time: 0.434672 Aug 25 05:35:37.240268 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 347/671] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:35:36 2021] GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5 => generated 1309 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:35:37.433747 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-bd8cbc8d-968f-4520-b9f6-805b6bb94278 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:37.434258 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-bd8cbc8d-968f-4520-b9f6-805b6bb94278 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:37.449823 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bd8cbc8d-968f-4520-b9f6-805b6bb94278 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:37.450554 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bd8cbc8d-968f-4520-b9f6-805b6bb94278 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:37.451685 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bd8cbc8d-968f-4520-b9f6-805b6bb94278 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:37.454021 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bd8cbc8d-968f-4520-b9f6-805b6bb94278 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:37.657790 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-bd8cbc8d-968f-4520-b9f6-805b6bb94278 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:37.668476 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-bd8cbc8d-968f-4520-b9f6-805b6bb94278 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:37.671595 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-bd8cbc8d-968f-4520-b9f6-805b6bb94278 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:37.672927 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-bd8cbc8d-968f-4520-b9f6-805b6bb94278 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1809 microversion: 2.20 time: 0.251891 Aug 25 05:35:37.673621 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 325/672] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:37 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1809 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:35:38.262615 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1a6b4515-b266-40dc-95b0-a7caad8ac6b9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:38.264631 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1a6b4515-b266-40dc-95b0-a7caad8ac6b9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 92dd15ea-adff-40f8-86b3-3333f26586d5] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:38.288340 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1a6b4515-b266-40dc-95b0-a7caad8ac6b9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:38.289604 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1a6b4515-b266-40dc-95b0-a7caad8ac6b9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:38.291416 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1a6b4515-b266-40dc-95b0-a7caad8ac6b9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:38.292408 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1a6b4515-b266-40dc-95b0-a7caad8ac6b9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:38.333970 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1a6b4515-b266-40dc-95b0-a7caad8ac6b9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:38.334370 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1a6b4515-b266-40dc-95b0-a7caad8ac6b9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:38.334825 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.objects.instance [None req-1a6b4515-b266-40dc-95b0-a7caad8ac6b9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lazy-loading 'fault' on Instance uuid 92dd15ea-adff-40f8-86b3-3333f26586d5 {{(pid=108885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 05:35:38.379569 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-1a6b4515-b266-40dc-95b0-a7caad8ac6b9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:38.394963 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1a6b4515-b266-40dc-95b0-a7caad8ac6b9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5" status: 200 len: 1309 microversion: 2.1 time: 0.134306 Aug 25 05:35:38.394963 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 348/673] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:35:38 2021] GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5 => generated 1309 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:35:38.692093 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-0d32101e-e714-4a23-9c91-7484ab968f0d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:38.692694 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-0d32101e-e714-4a23-9c91-7484ab968f0d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:38.699183 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0d32101e-e714-4a23-9c91-7484ab968f0d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:38.699669 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0d32101e-e714-4a23-9c91-7484ab968f0d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:38.701138 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0d32101e-e714-4a23-9c91-7484ab968f0d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:38.701789 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0d32101e-e714-4a23-9c91-7484ab968f0d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:38.941289 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-0d32101e-e714-4a23-9c91-7484ab968f0d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:38.945224 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-0d32101e-e714-4a23-9c91-7484ab968f0d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:38.946967 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-0d32101e-e714-4a23-9c91-7484ab968f0d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:38.948458 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-0d32101e-e714-4a23-9c91-7484ab968f0d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1809 microversion: 2.20 time: 0.260308 Aug 25 05:35:38.949364 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 326/674] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:38 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1809 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:35:39.404218 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-0a739668-91d1-44b2-911c-33fea8ee50cb tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:39.404826 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-0a739668-91d1-44b2-911c-33fea8ee50cb tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 92dd15ea-adff-40f8-86b3-3333f26586d5] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:39.411560 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0a739668-91d1-44b2-911c-33fea8ee50cb tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:39.411560 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0a739668-91d1-44b2-911c-33fea8ee50cb tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:39.412434 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0a739668-91d1-44b2-911c-33fea8ee50cb tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:39.412946 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0a739668-91d1-44b2-911c-33fea8ee50cb tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:39.449443 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0a739668-91d1-44b2-911c-33fea8ee50cb tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:39.449937 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0a739668-91d1-44b2-911c-33fea8ee50cb tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:39.450620 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.objects.instance [None req-0a739668-91d1-44b2-911c-33fea8ee50cb tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lazy-loading 'fault' on Instance uuid 92dd15ea-adff-40f8-86b3-3333f26586d5 {{(pid=108885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 05:35:39.495220 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-0a739668-91d1-44b2-911c-33fea8ee50cb tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:39.529728 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-0a739668-91d1-44b2-911c-33fea8ee50cb tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5" status: 200 len: 1309 microversion: 2.1 time: 0.128156 Aug 25 05:35:39.537778 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 349/675] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:35:39 2021] GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5 => generated 1309 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:35:39.968584 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-763e7888-4913-4625-bc19-61c3d414d77b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:39.969324 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-763e7888-4913-4625-bc19-61c3d414d77b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:39.977924 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-763e7888-4913-4625-bc19-61c3d414d77b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:39.978609 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-763e7888-4913-4625-bc19-61c3d414d77b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:39.979495 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-763e7888-4913-4625-bc19-61c3d414d77b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:39.980078 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-763e7888-4913-4625-bc19-61c3d414d77b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:40.131895 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-763e7888-4913-4625-bc19-61c3d414d77b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:40.140898 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-763e7888-4913-4625-bc19-61c3d414d77b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:40.142425 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-763e7888-4913-4625-bc19-61c3d414d77b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:40.143574 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-763e7888-4913-4625-bc19-61c3d414d77b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1809 microversion: 2.20 time: 0.179880 Aug 25 05:35:40.144360 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 327/676] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:39 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:35:40.562346 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7af9b305-fb10-4e5c-9e51-16a1f635a99a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:40.564817 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-7af9b305-fb10-4e5c-9e51-16a1f635a99a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 92dd15ea-adff-40f8-86b3-3333f26586d5] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:40.588386 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7af9b305-fb10-4e5c-9e51-16a1f635a99a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:40.592140 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7af9b305-fb10-4e5c-9e51-16a1f635a99a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:40.595807 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7af9b305-fb10-4e5c-9e51-16a1f635a99a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:40.596359 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7af9b305-fb10-4e5c-9e51-16a1f635a99a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:40.676844 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7af9b305-fb10-4e5c-9e51-16a1f635a99a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:40.678394 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7af9b305-fb10-4e5c-9e51-16a1f635a99a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:40.679771 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.objects.instance [None req-7af9b305-fb10-4e5c-9e51-16a1f635a99a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lazy-loading 'fault' on Instance uuid 92dd15ea-adff-40f8-86b3-3333f26586d5 {{(pid=108885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 05:35:41.166794 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6d2aa9c4-98cb-4dfe-a09b-591ba217ed63 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:41.167455 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6d2aa9c4-98cb-4dfe-a09b-591ba217ed63 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:41.184428 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6d2aa9c4-98cb-4dfe-a09b-591ba217ed63 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:41.185891 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6d2aa9c4-98cb-4dfe-a09b-591ba217ed63 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:41.191501 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6d2aa9c4-98cb-4dfe-a09b-591ba217ed63 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:41.193640 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6d2aa9c4-98cb-4dfe-a09b-591ba217ed63 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:41.215714 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-7af9b305-fb10-4e5c-9e51-16a1f635a99a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:41.234321 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-7af9b305-fb10-4e5c-9e51-16a1f635a99a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5" status: 200 len: 1309 microversion: 2.1 time: 0.678825 Aug 25 05:35:41.252784 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 350/677] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:35:40 2021] GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5 => generated 1309 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:35:41.507108 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6d2aa9c4-98cb-4dfe-a09b-591ba217ed63 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:41.532384 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6d2aa9c4-98cb-4dfe-a09b-591ba217ed63 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:41.549591 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6d2aa9c4-98cb-4dfe-a09b-591ba217ed63 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:41.552970 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6d2aa9c4-98cb-4dfe-a09b-591ba217ed63 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1809 microversion: 2.20 time: 0.393147 Aug 25 05:35:41.554776 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 328/678] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:41 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1809 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:35:42.259875 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-fe370283-fa10-4b98-8d0c-6d57a6609e36 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:42.260756 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-fe370283-fa10-4b98-8d0c-6d57a6609e36 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 92dd15ea-adff-40f8-86b3-3333f26586d5] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:42.270893 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fe370283-fa10-4b98-8d0c-6d57a6609e36 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:42.271346 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fe370283-fa10-4b98-8d0c-6d57a6609e36 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:42.272932 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fe370283-fa10-4b98-8d0c-6d57a6609e36 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:42.272932 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fe370283-fa10-4b98-8d0c-6d57a6609e36 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:42.288374 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.wsgi [None req-fe370283-fa10-4b98-8d0c-6d57a6609e36 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] HTTP exception thrown: Instance 92dd15ea-adff-40f8-86b3-3333f26586d5 could not be found. Aug 25 05:35:42.288981 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-fe370283-fa10-4b98-8d0c-6d57a6609e36 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Returning 404 to user: Instance 92dd15ea-adff-40f8-86b3-3333f26586d5 could not be found. {{(pid=108885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 05:35:42.289873 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-fe370283-fa10-4b98-8d0c-6d57a6609e36 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5" status: 404 len: 111 microversion: 2.1 time: 0.033767 Aug 25 05:35:42.290449 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 351/679] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:35:42 2021] GET /compute/v2.1/servers/92dd15ea-adff-40f8-86b3-3333f26586d5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:35:42.584759 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1cc010b7-7643-477c-a353-f32a9f4a1816 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:42.585846 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1cc010b7-7643-477c-a353-f32a9f4a1816 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:42.602643 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1cc010b7-7643-477c-a353-f32a9f4a1816 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:42.604036 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1cc010b7-7643-477c-a353-f32a9f4a1816 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:42.606583 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1cc010b7-7643-477c-a353-f32a9f4a1816 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:42.607619 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1cc010b7-7643-477c-a353-f32a9f4a1816 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:42.967923 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-1cc010b7-7643-477c-a353-f32a9f4a1816 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:42.976171 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-1cc010b7-7643-477c-a353-f32a9f4a1816 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:42.979113 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-1cc010b7-7643-477c-a353-f32a9f4a1816 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:42.979113 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1cc010b7-7643-477c-a353-f32a9f4a1816 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1809 microversion: 2.20 time: 0.400043 Aug 25 05:35:42.979449 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 329/680] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:42 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1809 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:35:44.000624 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-0c237ac5-ac42-47f9-98de-b0acef0d5599 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:44.001747 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-0c237ac5-ac42-47f9-98de-b0acef0d5599 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:44.012411 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0c237ac5-ac42-47f9-98de-b0acef0d5599 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:44.013708 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0c237ac5-ac42-47f9-98de-b0acef0d5599 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:44.015218 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0c237ac5-ac42-47f9-98de-b0acef0d5599 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:44.017007 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0c237ac5-ac42-47f9-98de-b0acef0d5599 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:44.493472 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-0c237ac5-ac42-47f9-98de-b0acef0d5599 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:44.506550 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-0c237ac5-ac42-47f9-98de-b0acef0d5599 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:44.508502 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-0c237ac5-ac42-47f9-98de-b0acef0d5599 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:44.510012 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-0c237ac5-ac42-47f9-98de-b0acef0d5599 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1809 microversion: 2.20 time: 0.514958 Aug 25 05:35:44.510749 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 352/681] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:43 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1809 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:35:44.870525 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 05:35:44.871290 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: Wed Aug 25 05:35:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 05:35:45.530450 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-abd2b71a-90e7-49a9-81e8-061fe9c5a6eb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:45.531348 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-abd2b71a-90e7-49a9-81e8-061fe9c5a6eb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:45.538797 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-abd2b71a-90e7-49a9-81e8-061fe9c5a6eb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:45.539258 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-abd2b71a-90e7-49a9-81e8-061fe9c5a6eb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:45.540039 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-abd2b71a-90e7-49a9-81e8-061fe9c5a6eb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:45.540787 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-abd2b71a-90e7-49a9-81e8-061fe9c5a6eb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:45.772223 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-abd2b71a-90e7-49a9-81e8-061fe9c5a6eb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:45.784374 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-abd2b71a-90e7-49a9-81e8-061fe9c5a6eb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:45.786189 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-abd2b71a-90e7-49a9-81e8-061fe9c5a6eb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:45.787620 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-abd2b71a-90e7-49a9-81e8-061fe9c5a6eb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1809 microversion: 2.20 time: 0.261856 Aug 25 05:35:45.788173 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 330/682] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:45 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1809 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:35:46.808160 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-3e99d4a7-a1e5-446e-8c19-1c4a5698d9bb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:46.808994 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-3e99d4a7-a1e5-446e-8c19-1c4a5698d9bb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:46.817009 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3e99d4a7-a1e5-446e-8c19-1c4a5698d9bb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:46.817442 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3e99d4a7-a1e5-446e-8c19-1c4a5698d9bb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:46.818442 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3e99d4a7-a1e5-446e-8c19-1c4a5698d9bb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:46.819042 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3e99d4a7-a1e5-446e-8c19-1c4a5698d9bb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:47.110411 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-3e99d4a7-a1e5-446e-8c19-1c4a5698d9bb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:47.129061 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-3e99d4a7-a1e5-446e-8c19-1c4a5698d9bb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:47.133009 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-3e99d4a7-a1e5-446e-8c19-1c4a5698d9bb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:47.135118 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-3e99d4a7-a1e5-446e-8c19-1c4a5698d9bb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1809 microversion: 2.20 time: 0.330618 Aug 25 05:35:47.135691 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 353/683] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:46 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1809 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:35:47.744223 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-76c3f47e-bc55-4434-af6c-e2605087cb9d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Action: 'create', calling method: .version_select at 0x7f9106ca3e50>, body: {"keypair": {"name": "tempest-TestShelveInstance-313165443"}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:35:47.765373 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.quota [None req-76c3f47e-bc55-4434-af6c-e2605087cb9d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Getting quotas for project 918ce72498a1413285a0c33ca0325419. Resources: {'key_pairs'} {{(pid=108884) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 05:35:47.770991 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.quota [None req-76c3f47e-bc55-4434-af6c-e2605087cb9d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Getting quotas for user abd9f0ff74ab430e8b718b7671242716 and project 918ce72498a1413285a0c33ca0325419. Resources: {'key_pairs'} {{(pid=108884) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 05:35:48.125571 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.quota [None req-76c3f47e-bc55-4434-af6c-e2605087cb9d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Getting quotas for project 918ce72498a1413285a0c33ca0325419. Resources: {'key_pairs'} {{(pid=108884) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 05:35:48.130670 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.quota [None req-76c3f47e-bc55-4434-af6c-e2605087cb9d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Getting quotas for user abd9f0ff74ab430e8b718b7671242716 and project 918ce72498a1413285a0c33ca0325419. Resources: {'key_pairs'} {{(pid=108884) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 05:35:48.144620 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-76c3f47e-bc55-4434-af6c-e2605087cb9d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.573134 Aug 25 05:35:48.145229 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 331/684] 10.222.0.42 () {60 vars in 1158 bytes} [Wed Aug 25 05:35:47 2021] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:35:48.157685 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ab74e7a7-51b6-4f01-9b95-bdbf1a5c7186 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:48.158538 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ab74e7a7-51b6-4f01-9b95-bdbf1a5c7186 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:48.166206 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ab74e7a7-51b6-4f01-9b95-bdbf1a5c7186 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:48.166638 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ab74e7a7-51b6-4f01-9b95-bdbf1a5c7186 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:48.167427 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ab74e7a7-51b6-4f01-9b95-bdbf1a5c7186 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:48.167850 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ab74e7a7-51b6-4f01-9b95-bdbf1a5c7186 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:48.313364 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ab74e7a7-51b6-4f01-9b95-bdbf1a5c7186 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:48.324026 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ab74e7a7-51b6-4f01-9b95-bdbf1a5c7186 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:48.326857 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ab74e7a7-51b6-4f01-9b95-bdbf1a5c7186 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:48.328061 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ab74e7a7-51b6-4f01-9b95-bdbf1a5c7186 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1809 microversion: 2.20 time: 0.175251 Aug 25 05:35:48.328629 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 354/685] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:48 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:35:49.347967 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-202a0866-7721-4263-ade4-6c680c51639f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:49.348437 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-202a0866-7721-4263-ade4-6c680c51639f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:49.355622 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-202a0866-7721-4263-ade4-6c680c51639f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:49.356104 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-202a0866-7721-4263-ade4-6c680c51639f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:49.359194 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-202a0866-7721-4263-ade4-6c680c51639f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:49.359820 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-202a0866-7721-4263-ade4-6c680c51639f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:49.529593 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-202a0866-7721-4263-ade4-6c680c51639f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:49.554053 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-202a0866-7721-4263-ade4-6c680c51639f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:49.556242 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-202a0866-7721-4263-ade4-6c680c51639f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:49.558059 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-202a0866-7721-4263-ade4-6c680c51639f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1809 microversion: 2.20 time: 0.213943 Aug 25 05:35:49.559204 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 332/686] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:49 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1809 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:35:50.578241 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-8de8eaec-311d-4745-a25a-a1ad646120a7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:50.579853 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-8de8eaec-311d-4745-a25a-a1ad646120a7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:50.585723 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8de8eaec-311d-4745-a25a-a1ad646120a7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:50.586116 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8de8eaec-311d-4745-a25a-a1ad646120a7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:50.586866 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8de8eaec-311d-4745-a25a-a1ad646120a7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:50.587293 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8de8eaec-311d-4745-a25a-a1ad646120a7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:50.735447 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-8de8eaec-311d-4745-a25a-a1ad646120a7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:50.746223 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-8de8eaec-311d-4745-a25a-a1ad646120a7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:50.749107 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-8de8eaec-311d-4745-a25a-a1ad646120a7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:50.750260 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-8de8eaec-311d-4745-a25a-a1ad646120a7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1809 microversion: 2.20 time: 0.177100 Aug 25 05:35:50.751567 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 355/687] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:50 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:35:51.782847 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-0b3976ac-9971-4ac6-837f-0abe564fceb6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:51.785076 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-0b3976ac-9971-4ac6-837f-0abe564fceb6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:51.793799 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0b3976ac-9971-4ac6-837f-0abe564fceb6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:51.794534 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0b3976ac-9971-4ac6-837f-0abe564fceb6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:51.795771 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0b3976ac-9971-4ac6-837f-0abe564fceb6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:51.796560 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0b3976ac-9971-4ac6-837f-0abe564fceb6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:52.041814 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-0b3976ac-9971-4ac6-837f-0abe564fceb6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:52.051689 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-0b3976ac-9971-4ac6-837f-0abe564fceb6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:52.053629 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-0b3976ac-9971-4ac6-837f-0abe564fceb6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:52.054951 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-0b3976ac-9971-4ac6-837f-0abe564fceb6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1809 microversion: 2.20 time: 0.278828 Aug 25 05:35:52.055526 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 333/688] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:51 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1809 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:35:53.077204 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-85639385-9bad-4efa-9746-feb0fa8f9d62 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:53.078106 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-85639385-9bad-4efa-9746-feb0fa8f9d62 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:53.091128 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-85639385-9bad-4efa-9746-feb0fa8f9d62 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:53.091806 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-85639385-9bad-4efa-9746-feb0fa8f9d62 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:53.092659 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-85639385-9bad-4efa-9746-feb0fa8f9d62 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:53.093435 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-85639385-9bad-4efa-9746-feb0fa8f9d62 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:53.249421 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-85639385-9bad-4efa-9746-feb0fa8f9d62 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:53.256652 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-85639385-9bad-4efa-9746-feb0fa8f9d62 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:53.258166 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-85639385-9bad-4efa-9746-feb0fa8f9d62 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:53.259297 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-85639385-9bad-4efa-9746-feb0fa8f9d62 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1809 microversion: 2.20 time: 0.188469 Aug 25 05:35:53.260068 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 356/689] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:53 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:35:54.277155 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5f5cd0f0-16be-4563-a1ca-f639c57bc393 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:54.278010 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5f5cd0f0-16be-4563-a1ca-f639c57bc393 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:54.284354 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5f5cd0f0-16be-4563-a1ca-f639c57bc393 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:54.284872 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5f5cd0f0-16be-4563-a1ca-f639c57bc393 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:54.285758 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5f5cd0f0-16be-4563-a1ca-f639c57bc393 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:54.286259 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5f5cd0f0-16be-4563-a1ca-f639c57bc393 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:54.416106 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-5f5cd0f0-16be-4563-a1ca-f639c57bc393 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:54.426708 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-5f5cd0f0-16be-4563-a1ca-f639c57bc393 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:54.428207 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-5f5cd0f0-16be-4563-a1ca-f639c57bc393 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:54.429385 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5f5cd0f0-16be-4563-a1ca-f639c57bc393 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1809 microversion: 2.20 time: 0.156203 Aug 25 05:35:54.429979 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 334/690] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:54 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:35:55.448515 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-58d93ed2-9dc2-475b-881d-6761ba79f95e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:55.449110 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-58d93ed2-9dc2-475b-881d-6761ba79f95e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:55.455726 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-58d93ed2-9dc2-475b-881d-6761ba79f95e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:55.456159 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-58d93ed2-9dc2-475b-881d-6761ba79f95e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:55.456932 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-58d93ed2-9dc2-475b-881d-6761ba79f95e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:55.457389 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-58d93ed2-9dc2-475b-881d-6761ba79f95e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:55.590112 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-58d93ed2-9dc2-475b-881d-6761ba79f95e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:55.598793 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-58d93ed2-9dc2-475b-881d-6761ba79f95e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:55.600283 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-58d93ed2-9dc2-475b-881d-6761ba79f95e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:55.601402 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-58d93ed2-9dc2-475b-881d-6761ba79f95e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1809 microversion: 2.20 time: 0.156643 Aug 25 05:35:55.601977 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 357/691] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:55 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:35:56.620174 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c6ddf8e4-0a23-4c68-87b9-1d3c0d177a95 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:56.620733 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c6ddf8e4-0a23-4c68-87b9-1d3c0d177a95 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:56.627215 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c6ddf8e4-0a23-4c68-87b9-1d3c0d177a95 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:56.627664 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c6ddf8e4-0a23-4c68-87b9-1d3c0d177a95 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:56.628438 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c6ddf8e4-0a23-4c68-87b9-1d3c0d177a95 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:56.628874 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c6ddf8e4-0a23-4c68-87b9-1d3c0d177a95 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:56.759663 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-c6ddf8e4-0a23-4c68-87b9-1d3c0d177a95 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:56.768110 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-c6ddf8e4-0a23-4c68-87b9-1d3c0d177a95 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:56.769627 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-c6ddf8e4-0a23-4c68-87b9-1d3c0d177a95 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:56.770773 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c6ddf8e4-0a23-4c68-87b9-1d3c0d177a95 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1809 microversion: 2.20 time: 0.154460 Aug 25 05:35:56.771320 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 335/692] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:56 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:35:57.790792 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-09c06558-caab-4d86-b6c1-9c514ac4a66b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:57.791428 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-09c06558-caab-4d86-b6c1-9c514ac4a66b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:57.798543 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-09c06558-caab-4d86-b6c1-9c514ac4a66b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:57.806698 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-09c06558-caab-4d86-b6c1-9c514ac4a66b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:57.806698 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-09c06558-caab-4d86-b6c1-9c514ac4a66b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:57.806698 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-09c06558-caab-4d86-b6c1-9c514ac4a66b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:57.937591 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-09c06558-caab-4d86-b6c1-9c514ac4a66b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:57.945031 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-09c06558-caab-4d86-b6c1-9c514ac4a66b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:57.946593 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-09c06558-caab-4d86-b6c1-9c514ac4a66b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:57.947732 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-09c06558-caab-4d86-b6c1-9c514ac4a66b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1809 microversion: 2.20 time: 0.160734 Aug 25 05:35:57.948290 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 358/693] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:57 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:35:58.499699 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-9c0c2376-5e32-4899-afb6-ee1f4c81e95b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1246835471", "imageRef": "05da2439-78f2-405c-b60a-89671b21a373", "flavorRef": "452", "networks": [{"uuid": "b295481c-f024-44d2-a980-479481e2cd4a"}]}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:35:58.572328 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.network.neutron [None req-9c0c2376-5e32-4899-afb6-ee1f4c81e95b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] validate_networks() for [('b295481c-f024-44d2-a980-479481e2cd4a', None, None, None, None, None)] {{(pid=108884) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 25 05:35:58.967227 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a5244ca6-d069-482e-97aa-8849877ee6e8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:58.969286 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a5244ca6-d069-482e-97aa-8849877ee6e8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:58.976026 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a5244ca6-d069-482e-97aa-8849877ee6e8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:58.976464 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a5244ca6-d069-482e-97aa-8849877ee6e8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:58.977248 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a5244ca6-d069-482e-97aa-8849877ee6e8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:58.977727 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a5244ca6-d069-482e-97aa-8849877ee6e8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:58.992522 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-9c0c2376-5e32-4899-afb6-ee1f4c81e95b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Flavor limits 0:0:0 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 05:35:58.992947 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-9c0c2376-5e32-4899-afb6-ee1f4c81e95b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Image limits 0:0:0 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 05:35:58.993422 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-9c0c2376-5e32-4899-afb6-ee1f4c81e95b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Flavor pref 0:0:0 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 05:35:58.993856 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-9c0c2376-5e32-4899-afb6-ee1f4c81e95b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Image pref 0:0:0 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 05:35:58.994266 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-9c0c2376-5e32-4899-afb6-ee1f4c81e95b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 05:35:59.003629 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9c0c2376-5e32-4899-afb6-ee1f4c81e95b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:59.004075 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9c0c2376-5e32-4899-afb6-ee1f4c81e95b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:59.004870 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9c0c2376-5e32-4899-afb6-ee1f4c81e95b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:59.005307 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9c0c2376-5e32-4899-afb6-ee1f4c81e95b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:59.022289 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.quota [None req-9c0c2376-5e32-4899-afb6-ee1f4c81e95b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Getting quotas for project bbccb403957943839b2b9f0171b88d1e. Resources: {'ram', 'cores', 'instances'} {{(pid=108884) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 05:35:59.026156 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.quota [None req-9c0c2376-5e32-4899-afb6-ee1f4c81e95b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Getting quotas for user 1248e051ab404b4faeb147e4d373166c and project bbccb403957943839b2b9f0171b88d1e. Resources: {'ram', 'cores', 'instances'} {{(pid=108884) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 05:35:59.037908 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-9c0c2376-5e32-4899-afb6-ee1f4c81e95b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Going to run 1 instances... {{(pid=108884) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 25 05:35:59.040222 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-9c0c2376-5e32-4899-afb6-ee1f4c81e95b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05da2439-78f2-405c-b60a-89671b21a373',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 25 05:35:59.105170 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-a5244ca6-d069-482e-97aa-8849877ee6e8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:59.114170 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-a5244ca6-d069-482e-97aa-8849877ee6e8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:59.115646 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-a5244ca6-d069-482e-97aa-8849877ee6e8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:59.116773 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a5244ca6-d069-482e-97aa-8849877ee6e8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1809 microversion: 2.20 time: 0.153612 Aug 25 05:35:59.117327 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 359/694] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:35:58 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:35:59.135823 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-9c0c2376-5e32-4899-afb6-ee1f4c81e95b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.641928 Aug 25 05:35:59.136467 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 336/695] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 25 05:35:58 2021] POST /compute/v2.1/servers => generated 380 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 05:35:59.147568 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-83449a33-b896-4761-8c43-4926ba88377c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:59.148197 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-83449a33-b896-4761-8c43-4926ba88377c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:35:59.200761 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-83449a33-b896-4761-8c43-4926ba88377c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:59.207303 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-83449a33-b896-4761-8c43-4926ba88377c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1219 microversion: 2.1 time: 0.064540 Aug 25 05:35:59.207948 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 360/696] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:35:59 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:35:59.495840 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [req-3535b656-6014-43d2-a088-12b849160e5f req-0f23db9e-1ab5-4e43-be3e-cf7a063c4511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cb635d4-76ba-4143-8f4d-a64c720966da", "name": "network-vif-plugged", "status": "completed", "tag": "605f6633-54d1-4fa5-b498-9157fffe1b41"}]} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:35:59.498232 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:35:59.498232 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: warnings.warn(msg) Aug 25 05:35:59.505421 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-3535b656-6014-43d2-a088-12b849160e5f req-0f23db9e-1ab5-4e43-be3e-cf7a063c4511 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:35:59.506041 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-3535b656-6014-43d2-a088-12b849160e5f req-0f23db9e-1ab5-4e43-be3e-cf7a063c4511 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:35:59.518558 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.compute.server_external_events [req-3535b656-6014-43d2-a088-12b849160e5f req-0f23db9e-1ab5-4e43-be3e-cf7a063c4511 service nova] Creating event network-vif-plugged:605f6633-54d1-4fa5-b498-9157fffe1b41 for instance 4cb635d4-76ba-4143-8f4d-a64c720966da on hv-cinder-78662 Aug 25 05:35:59.524946 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [req-3535b656-6014-43d2-a088-12b849160e5f req-0f23db9e-1ab5-4e43-be3e-cf7a063c4511 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032785 Aug 25 05:35:59.526111 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 337/697] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:35:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:36:00.136369 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-87fd8160-ebaf-4478-9da8-18bf6fb1bb80 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:00.136969 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-87fd8160-ebaf-4478-9da8-18bf6fb1bb80 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:00.144757 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-87fd8160-ebaf-4478-9da8-18bf6fb1bb80 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:00.145192 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-87fd8160-ebaf-4478-9da8-18bf6fb1bb80 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:00.146063 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-87fd8160-ebaf-4478-9da8-18bf6fb1bb80 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:00.146493 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-87fd8160-ebaf-4478-9da8-18bf6fb1bb80 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:00.225846 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d230251e-fd6c-4d8c-8678-9d65f27fd8f3 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:00.226936 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-d230251e-fd6c-4d8c-8678-9d65f27fd8f3 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:00.234337 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d230251e-fd6c-4d8c-8678-9d65f27fd8f3 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:00.234919 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d230251e-fd6c-4d8c-8678-9d65f27fd8f3 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:00.235961 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d230251e-fd6c-4d8c-8678-9d65f27fd8f3 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:00.236451 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d230251e-fd6c-4d8c-8678-9d65f27fd8f3 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:00.285656 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-87fd8160-ebaf-4478-9da8-18bf6fb1bb80 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:00.299438 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-87fd8160-ebaf-4478-9da8-18bf6fb1bb80 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:00.302338 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-87fd8160-ebaf-4478-9da8-18bf6fb1bb80 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:00.304210 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-87fd8160-ebaf-4478-9da8-18bf6fb1bb80 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1809 microversion: 2.20 time: 0.172383 Aug 25 05:36:00.309953 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 361/698] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:36:00 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:36:00.323882 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-d230251e-fd6c-4d8c-8678-9d65f27fd8f3 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:00.333064 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d230251e-fd6c-4d8c-8678-9d65f27fd8f3 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1223 microversion: 2.1 time: 0.111620 Aug 25 05:36:00.333699 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 338/699] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:36:00 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1223 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:36:01.325281 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-02496b59-d8ab-4468-a829-e311c5c0797b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:01.325929 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-02496b59-d8ab-4468-a829-e311c5c0797b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:01.332397 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-02496b59-d8ab-4468-a829-e311c5c0797b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:01.332833 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-02496b59-d8ab-4468-a829-e311c5c0797b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:01.333613 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-02496b59-d8ab-4468-a829-e311c5c0797b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:01.334396 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-02496b59-d8ab-4468-a829-e311c5c0797b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:01.349657 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-fee8f3bb-3311-4f96-b8e7-137c82b4569e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:01.350270 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-fee8f3bb-3311-4f96-b8e7-137c82b4569e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:01.355923 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fee8f3bb-3311-4f96-b8e7-137c82b4569e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:01.356364 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fee8f3bb-3311-4f96-b8e7-137c82b4569e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:01.357125 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fee8f3bb-3311-4f96-b8e7-137c82b4569e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:01.357571 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fee8f3bb-3311-4f96-b8e7-137c82b4569e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:01.426755 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-fee8f3bb-3311-4f96-b8e7-137c82b4569e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:01.434159 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-fee8f3bb-3311-4f96-b8e7-137c82b4569e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1271 microversion: 2.1 time: 0.088082 Aug 25 05:36:01.434730 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 339/700] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:36:01 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:36:01.480068 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-02496b59-d8ab-4468-a829-e311c5c0797b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:01.488916 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-02496b59-d8ab-4468-a829-e311c5c0797b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:01.490526 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-02496b59-d8ab-4468-a829-e311c5c0797b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:01.491664 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-02496b59-d8ab-4468-a829-e311c5c0797b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1809 microversion: 2.20 time: 0.170089 Aug 25 05:36:01.492214 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 362/701] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:36:01 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:36:02.452043 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ceefbd3d-e455-4454-9ce2-f715866b12b5 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:02.453361 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ceefbd3d-e455-4454-9ce2-f715866b12b5 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:02.459724 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ceefbd3d-e455-4454-9ce2-f715866b12b5 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:02.462394 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ceefbd3d-e455-4454-9ce2-f715866b12b5 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:02.462394 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ceefbd3d-e455-4454-9ce2-f715866b12b5 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:02.462394 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ceefbd3d-e455-4454-9ce2-f715866b12b5 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:02.512950 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-47860dd8-dc20-45d4-98d2-1a3668296072 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:02.513597 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-47860dd8-dc20-45d4-98d2-1a3668296072 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:02.523919 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-47860dd8-dc20-45d4-98d2-1a3668296072 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:02.525669 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-47860dd8-dc20-45d4-98d2-1a3668296072 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:02.525669 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-47860dd8-dc20-45d4-98d2-1a3668296072 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:02.525669 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-47860dd8-dc20-45d4-98d2-1a3668296072 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:02.550472 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ceefbd3d-e455-4454-9ce2-f715866b12b5 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:02.558367 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ceefbd3d-e455-4454-9ce2-f715866b12b5 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1277 microversion: 2.1 time: 0.110363 Aug 25 05:36:02.559240 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 340/702] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:36:02 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1277 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:36:02.688485 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-47860dd8-dc20-45d4-98d2-1a3668296072 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:02.698324 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-47860dd8-dc20-45d4-98d2-1a3668296072 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:02.700034 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-47860dd8-dc20-45d4-98d2-1a3668296072 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:02.701384 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-47860dd8-dc20-45d4-98d2-1a3668296072 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1809 microversion: 2.20 time: 0.194665 Aug 25 05:36:02.703256 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 363/703] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:36:02 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1809 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:36:03.576593 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c8efdfb7-ba7b-4373-9302-d860f8f4374f tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:03.577812 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c8efdfb7-ba7b-4373-9302-d860f8f4374f tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:03.584694 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c8efdfb7-ba7b-4373-9302-d860f8f4374f tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:03.585445 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c8efdfb7-ba7b-4373-9302-d860f8f4374f tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:03.586483 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c8efdfb7-ba7b-4373-9302-d860f8f4374f tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:03.587120 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c8efdfb7-ba7b-4373-9302-d860f8f4374f tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:03.588173 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [req-38ff5b8a-f2e0-4917-8fe4-2d05e877a025 req-404268ab-cc44-4d4f-8f49-9859f3518450 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e74fcd5-99b3-4716-b064-182c7db61275", "tag": "595c1454-355d-4c8f-85d4-ca230e7a0a3c"}]} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:36:03.589768 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:36:03.589768 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: warnings.warn(msg) Aug 25 05:36:03.597443 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-38ff5b8a-f2e0-4917-8fe4-2d05e877a025 req-404268ab-cc44-4d4f-8f49-9859f3518450 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:03.598076 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-38ff5b8a-f2e0-4917-8fe4-2d05e877a025 req-404268ab-cc44-4d4f-8f49-9859f3518450 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:03.609440 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.compute.server_external_events [req-38ff5b8a-f2e0-4917-8fe4-2d05e877a025 req-404268ab-cc44-4d4f-8f49-9859f3518450 service nova] Creating event network-changed:595c1454-355d-4c8f-85d4-ca230e7a0a3c for instance 8e74fcd5-99b3-4716-b064-182c7db61275 on hv-cinder-78662 Aug 25 05:36:03.614448 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [req-38ff5b8a-f2e0-4917-8fe4-2d05e877a025 req-404268ab-cc44-4d4f-8f49-9859f3518450 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030123 Aug 25 05:36:03.615048 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 364/704] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:36:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:36:03.722749 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-812518c0-6d8b-40a9-8fc9-7f8f2c9a64e3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:03.724353 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-812518c0-6d8b-40a9-8fc9-7f8f2c9a64e3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:03.733459 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-c8efdfb7-ba7b-4373-9302-d860f8f4374f tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:03.736497 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-812518c0-6d8b-40a9-8fc9-7f8f2c9a64e3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:03.736497 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-812518c0-6d8b-40a9-8fc9-7f8f2c9a64e3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:03.736497 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-812518c0-6d8b-40a9-8fc9-7f8f2c9a64e3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:03.736497 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-812518c0-6d8b-40a9-8fc9-7f8f2c9a64e3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:03.744438 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c8efdfb7-ba7b-4373-9302-d860f8f4374f tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1319 microversion: 2.1 time: 0.171884 Aug 25 05:36:03.745387 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 341/705] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:36:03 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:36:03.895675 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-812518c0-6d8b-40a9-8fc9-7f8f2c9a64e3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:03.903859 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-812518c0-6d8b-40a9-8fc9-7f8f2c9a64e3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:03.905389 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-812518c0-6d8b-40a9-8fc9-7f8f2c9a64e3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:03.906673 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-812518c0-6d8b-40a9-8fc9-7f8f2c9a64e3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1809 microversion: 2.20 time: 0.190093 Aug 25 05:36:03.907279 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 365/706] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:36:03 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:36:04.761281 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3cf01c39-4b4c-4aba-ac85-86a50922e46a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:04.761904 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3cf01c39-4b4c-4aba-ac85-86a50922e46a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:04.767915 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3cf01c39-4b4c-4aba-ac85-86a50922e46a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:04.768280 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3cf01c39-4b4c-4aba-ac85-86a50922e46a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:04.769029 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3cf01c39-4b4c-4aba-ac85-86a50922e46a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:04.769450 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3cf01c39-4b4c-4aba-ac85-86a50922e46a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:04.905728 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-3cf01c39-4b4c-4aba-ac85-86a50922e46a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:04.914410 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3cf01c39-4b4c-4aba-ac85-86a50922e46a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1319 microversion: 2.1 time: 0.156659 Aug 25 05:36:04.914981 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 342/707] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:36:04 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:36:04.930954 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ed2e264e-7651-4bea-837f-ed9538956cb9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:04.931604 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ed2e264e-7651-4bea-837f-ed9538956cb9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:04.937447 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ed2e264e-7651-4bea-837f-ed9538956cb9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:04.937989 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ed2e264e-7651-4bea-837f-ed9538956cb9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:04.938750 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ed2e264e-7651-4bea-837f-ed9538956cb9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:04.939173 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ed2e264e-7651-4bea-837f-ed9538956cb9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:05.064876 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ed2e264e-7651-4bea-837f-ed9538956cb9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:05.073652 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ed2e264e-7651-4bea-837f-ed9538956cb9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:05.075143 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ed2e264e-7651-4bea-837f-ed9538956cb9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:05.076298 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ed2e264e-7651-4bea-837f-ed9538956cb9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1796 microversion: 2.20 time: 0.151070 Aug 25 05:36:05.077876 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 366/708] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:36:04 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1796 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:36:05.932139 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e48c1724-8c4d-4e89-ab22-f4c455ac8146 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:05.932710 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e48c1724-8c4d-4e89-ab22-f4c455ac8146 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:05.939855 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e48c1724-8c4d-4e89-ab22-f4c455ac8146 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:05.940302 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e48c1724-8c4d-4e89-ab22-f4c455ac8146 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:05.941085 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e48c1724-8c4d-4e89-ab22-f4c455ac8146 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:05.941518 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e48c1724-8c4d-4e89-ab22-f4c455ac8146 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:06.071713 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e48c1724-8c4d-4e89-ab22-f4c455ac8146 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:06.079872 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e48c1724-8c4d-4e89-ab22-f4c455ac8146 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1319 microversion: 2.1 time: 0.151634 Aug 25 05:36:06.080446 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 343/709] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:36:05 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:36:07.096478 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9fa50ff3-d794-4101-aa47-c06e0494221f tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:07.097069 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9fa50ff3-d794-4101-aa47-c06e0494221f tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:07.103230 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9fa50ff3-d794-4101-aa47-c06e0494221f tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:07.103661 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9fa50ff3-d794-4101-aa47-c06e0494221f tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:07.104411 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9fa50ff3-d794-4101-aa47-c06e0494221f tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:07.104831 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9fa50ff3-d794-4101-aa47-c06e0494221f tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:07.235101 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-9fa50ff3-d794-4101-aa47-c06e0494221f tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:07.242665 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9fa50ff3-d794-4101-aa47-c06e0494221f tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1319 microversion: 2.1 time: 0.150435 Aug 25 05:36:07.243229 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 367/710] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:36:07 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:36:08.260032 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-16843dc5-bd95-4ebd-94a9-8a04ddfc5b9f tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:08.260809 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-16843dc5-bd95-4ebd-94a9-8a04ddfc5b9f tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:08.267578 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-16843dc5-bd95-4ebd-94a9-8a04ddfc5b9f tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:08.268059 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-16843dc5-bd95-4ebd-94a9-8a04ddfc5b9f tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:08.268897 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-16843dc5-bd95-4ebd-94a9-8a04ddfc5b9f tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:08.269343 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-16843dc5-bd95-4ebd-94a9-8a04ddfc5b9f tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:08.399510 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-16843dc5-bd95-4ebd-94a9-8a04ddfc5b9f tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:08.406758 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-16843dc5-bd95-4ebd-94a9-8a04ddfc5b9f tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1319 microversion: 2.1 time: 0.150424 Aug 25 05:36:08.407349 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 344/711] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:36:08 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:36:09.425015 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c9b9b30d-bab7-4e3f-94b6-c39af8dc5b37 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:09.425644 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c9b9b30d-bab7-4e3f-94b6-c39af8dc5b37 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:09.431603 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c9b9b30d-bab7-4e3f-94b6-c39af8dc5b37 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:09.432043 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c9b9b30d-bab7-4e3f-94b6-c39af8dc5b37 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:09.432808 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c9b9b30d-bab7-4e3f-94b6-c39af8dc5b37 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:09.433232 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c9b9b30d-bab7-4e3f-94b6-c39af8dc5b37 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:09.571045 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-c9b9b30d-bab7-4e3f-94b6-c39af8dc5b37 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:09.578545 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c9b9b30d-bab7-4e3f-94b6-c39af8dc5b37 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1319 microversion: 2.1 time: 0.157915 Aug 25 05:36:09.579737 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 368/712] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:36:09 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:36:10.595964 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6a5ca774-a80c-4b4c-9f1a-8f49ea1e9f41 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:10.596580 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6a5ca774-a80c-4b4c-9f1a-8f49ea1e9f41 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:10.603186 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6a5ca774-a80c-4b4c-9f1a-8f49ea1e9f41 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:10.603637 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6a5ca774-a80c-4b4c-9f1a-8f49ea1e9f41 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:10.604409 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6a5ca774-a80c-4b4c-9f1a-8f49ea1e9f41 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:10.604851 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6a5ca774-a80c-4b4c-9f1a-8f49ea1e9f41 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:10.755402 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6a5ca774-a80c-4b4c-9f1a-8f49ea1e9f41 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:10.763221 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6a5ca774-a80c-4b4c-9f1a-8f49ea1e9f41 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1319 microversion: 2.1 time: 0.170893 Aug 25 05:36:10.763785 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 345/713] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:36:10 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:36:11.649180 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [req-0b1091ca-c2f4-46b4-a1e3-0d6f35e0141d req-56fd56c9-426c-4793-8230-16851ee40c6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e74fcd5-99b3-4716-b064-182c7db61275", "name": "network-vif-plugged", "status": "completed", "tag": "595c1454-355d-4c8f-85d4-ca230e7a0a3c"}]} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:36:11.650923 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:36:11.650923 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: warnings.warn(msg) Aug 25 05:36:11.657972 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-0b1091ca-c2f4-46b4-a1e3-0d6f35e0141d req-56fd56c9-426c-4793-8230-16851ee40c6e service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:11.658469 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-0b1091ca-c2f4-46b4-a1e3-0d6f35e0141d req-56fd56c9-426c-4793-8230-16851ee40c6e service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:11.669579 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.compute.server_external_events [req-0b1091ca-c2f4-46b4-a1e3-0d6f35e0141d req-56fd56c9-426c-4793-8230-16851ee40c6e service nova] Creating event network-vif-plugged:595c1454-355d-4c8f-85d4-ca230e7a0a3c for instance 8e74fcd5-99b3-4716-b064-182c7db61275 on hv-cinder-78662 Aug 25 05:36:11.674598 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [req-0b1091ca-c2f4-46b4-a1e3-0d6f35e0141d req-56fd56c9-426c-4793-8230-16851ee40c6e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029211 Aug 25 05:36:11.675706 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 369/714] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:36:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:36:11.781745 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-cbfd920e-23b5-4f13-b357-6b08498f0cc8 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:11.783557 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-cbfd920e-23b5-4f13-b357-6b08498f0cc8 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:11.788771 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cbfd920e-23b5-4f13-b357-6b08498f0cc8 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:11.789223 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cbfd920e-23b5-4f13-b357-6b08498f0cc8 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:11.790045 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cbfd920e-23b5-4f13-b357-6b08498f0cc8 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:11.790484 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cbfd920e-23b5-4f13-b357-6b08498f0cc8 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:11.926526 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-cbfd920e-23b5-4f13-b357-6b08498f0cc8 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:11.934061 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-cbfd920e-23b5-4f13-b357-6b08498f0cc8 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1319 microversion: 2.1 time: 0.157700 Aug 25 05:36:11.934631 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 346/715] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:36:11 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:36:12.951429 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-64d80db8-53fe-464f-a184-4b860fedd17a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:12.952124 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-64d80db8-53fe-464f-a184-4b860fedd17a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:12.958323 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-64d80db8-53fe-464f-a184-4b860fedd17a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:12.958766 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-64d80db8-53fe-464f-a184-4b860fedd17a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:12.959537 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-64d80db8-53fe-464f-a184-4b860fedd17a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:12.959968 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-64d80db8-53fe-464f-a184-4b860fedd17a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:13.092847 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-64d80db8-53fe-464f-a184-4b860fedd17a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:13.101069 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-64d80db8-53fe-464f-a184-4b860fedd17a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1319 microversion: 2.1 time: 0.153635 Aug 25 05:36:13.101648 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 370/716] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:36:12 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:36:14.118704 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d9800e5f-57ef-4d6f-9368-3c2f7f5eb022 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:14.119405 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-d9800e5f-57ef-4d6f-9368-3c2f7f5eb022 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:14.125823 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d9800e5f-57ef-4d6f-9368-3c2f7f5eb022 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:14.126286 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d9800e5f-57ef-4d6f-9368-3c2f7f5eb022 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:14.127068 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d9800e5f-57ef-4d6f-9368-3c2f7f5eb022 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:14.127832 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d9800e5f-57ef-4d6f-9368-3c2f7f5eb022 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:14.258448 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-d9800e5f-57ef-4d6f-9368-3c2f7f5eb022 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:14.265685 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d9800e5f-57ef-4d6f-9368-3c2f7f5eb022 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1319 microversion: 2.1 time: 0.150828 Aug 25 05:36:14.266261 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 347/717] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:36:14 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:36:15.283277 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-632ab889-f575-47e6-98ed-54e6cb183996 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:15.283875 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-632ab889-f575-47e6-98ed-54e6cb183996 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:15.290197 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-632ab889-f575-47e6-98ed-54e6cb183996 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:15.290638 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-632ab889-f575-47e6-98ed-54e6cb183996 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:15.291383 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-632ab889-f575-47e6-98ed-54e6cb183996 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:15.291808 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-632ab889-f575-47e6-98ed-54e6cb183996 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:15.410769 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-632ab889-f575-47e6-98ed-54e6cb183996 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:15.418157 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-632ab889-f575-47e6-98ed-54e6cb183996 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1508 microversion: 2.1 time: 0.138426 Aug 25 05:36:15.418798 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 371/718] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:36:15 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1508 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:36:15.435211 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-9a00a598-e87a-4e79-8af7-698b1ddc31a0 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7512b19a-ad25-4d1b-be97-721fbaf90bba", "device": "/dev/sdb"}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:36:15.436460 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-9a00a598-e87a-4e79-8af7-698b1ddc31a0 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:15.442045 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9a00a598-e87a-4e79-8af7-698b1ddc31a0 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:15.442492 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9a00a598-e87a-4e79-8af7-698b1ddc31a0 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:15.443258 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9a00a598-e87a-4e79-8af7-698b1ddc31a0 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:15.444378 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9a00a598-e87a-4e79-8af7-698b1ddc31a0 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:16.112960 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-9a00a598-e87a-4e79-8af7-698b1ddc31a0 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "POST /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.681126 Aug 25 05:36:16.113687 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 348/719] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 25 05:36:15 2021] POST /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275/os-volume_attachments => generated 194 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:36:29.156767 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-0541e61a-aa39-424d-b952-fa10b4ee5412 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2087663823", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-313165443", "security_groups": [{"name": "tempest-secgroup-smoke-587456594"}], "networks": [{"uuid": "16c1934a-aecb-4cbc-baf9-3808c329e6ee"}], "block_device_mapping_v2": [{"uuid": "6553bf2c-4a66-4896-a184-bc8b7eac2cf4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:36:29.262690 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.network.neutron [None req-0541e61a-aa39-424d-b952-fa10b4ee5412 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] validate_networks() for [('16c1934a-aecb-4cbc-baf9-3808c329e6ee', None, None, None, None, None)] {{(pid=108885) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 25 05:36:29.768610 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-0541e61a-aa39-424d-b952-fa10b4ee5412 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Flavor limits 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 05:36:29.769032 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-0541e61a-aa39-424d-b952-fa10b4ee5412 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Image limits 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 05:36:29.769501 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-0541e61a-aa39-424d-b952-fa10b4ee5412 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Flavor pref 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 05:36:29.769970 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-0541e61a-aa39-424d-b952-fa10b4ee5412 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Image pref 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 05:36:29.770380 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-0541e61a-aa39-424d-b952-fa10b4ee5412 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 05:36:29.780034 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0541e61a-aa39-424d-b952-fa10b4ee5412 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:29.780471 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0541e61a-aa39-424d-b952-fa10b4ee5412 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:29.781263 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0541e61a-aa39-424d-b952-fa10b4ee5412 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:29.781731 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0541e61a-aa39-424d-b952-fa10b4ee5412 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:29.800346 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.quota [None req-0541e61a-aa39-424d-b952-fa10b4ee5412 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Getting quotas for project 918ce72498a1413285a0c33ca0325419. Resources: {'ram', 'cores', 'instances'} {{(pid=108885) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 05:36:29.804943 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.quota [None req-0541e61a-aa39-424d-b952-fa10b4ee5412 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Getting quotas for user abd9f0ff74ab430e8b718b7671242716 and project 918ce72498a1413285a0c33ca0325419. Resources: {'ram', 'cores', 'instances'} {{(pid=108885) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 05:36:29.880205 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-0541e61a-aa39-424d-b952-fa10b4ee5412 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Going to run 1 instances... {{(pid=108885) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 25 05:36:29.883491 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-0541e61a-aa39-424d-b952-fa10b4ee5412 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6553bf2c-4a66-4896-a184-bc8b7eac2cf4',volume_size=None,volume_type=None)] {{(pid=108885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 25 05:36:30.438753 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-0541e61a-aa39-424d-b952-fa10b4ee5412 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.285392 Aug 25 05:36:30.439781 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 372/720] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 25 05:36:29 2021] POST /compute/v2.1/servers => generated 405 bytes in 1287 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 05:36:30.453998 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-daa3b73a-ee7a-4868-8029-a42436c4fea8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:30.456190 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-daa3b73a-ee7a-4868-8029-a42436c4fea8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:30.548109 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-daa3b73a-ee7a-4868-8029-a42436c4fea8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:30.556589 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-daa3b73a-ee7a-4868-8029-a42436c4fea8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1088 microversion: 2.1 time: 0.107810 Aug 25 05:36:30.557250 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 349/721] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:36:30 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1088 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:36:31.573320 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-af4ab5ad-39c9-43f2-80ba-f9e5baa58d1a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:31.575477 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-af4ab5ad-39c9-43f2-80ba-f9e5baa58d1a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:31.580041 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-af4ab5ad-39c9-43f2-80ba-f9e5baa58d1a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:31.580499 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-af4ab5ad-39c9-43f2-80ba-f9e5baa58d1a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:31.581251 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-af4ab5ad-39c9-43f2-80ba-f9e5baa58d1a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:31.581705 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-af4ab5ad-39c9-43f2-80ba-f9e5baa58d1a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:31.640406 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-af4ab5ad-39c9-43f2-80ba-f9e5baa58d1a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:31.648447 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-af4ab5ad-39c9-43f2-80ba-f9e5baa58d1a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1138 microversion: 2.1 time: 0.079618 Aug 25 05:36:31.649015 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 373/722] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:36:31 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1138 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:36:32.664923 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e8270089-f08e-4b51-b831-657fdb18882f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:32.669247 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e8270089-f08e-4b51-b831-657fdb18882f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:32.672476 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e8270089-f08e-4b51-b831-657fdb18882f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:32.672923 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e8270089-f08e-4b51-b831-657fdb18882f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:32.673723 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e8270089-f08e-4b51-b831-657fdb18882f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:32.674158 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e8270089-f08e-4b51-b831-657fdb18882f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:32.735851 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e8270089-f08e-4b51-b831-657fdb18882f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:32.744008 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e8270089-f08e-4b51-b831-657fdb18882f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1138 microversion: 2.1 time: 0.083299 Aug 25 05:36:32.744586 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 350/723] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:36:32 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1138 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:36:33.763216 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7b2163df-1aa8-450c-92fd-6a6b02494877 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:33.763816 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-7b2163df-1aa8-450c-92fd-6a6b02494877 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:33.769723 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7b2163df-1aa8-450c-92fd-6a6b02494877 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:33.770160 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7b2163df-1aa8-450c-92fd-6a6b02494877 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:33.770936 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7b2163df-1aa8-450c-92fd-6a6b02494877 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:33.771356 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7b2163df-1aa8-450c-92fd-6a6b02494877 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:33.833475 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-7b2163df-1aa8-450c-92fd-6a6b02494877 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:33.842013 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-7b2163df-1aa8-450c-92fd-6a6b02494877 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1138 microversion: 2.1 time: 0.082471 Aug 25 05:36:33.842623 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 374/724] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:36:33 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1138 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:36:34.858219 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6d30a5a9-9766-4dee-94af-d02284c2c7a2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:34.858839 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6d30a5a9-9766-4dee-94af-d02284c2c7a2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:34.864949 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6d30a5a9-9766-4dee-94af-d02284c2c7a2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:34.865496 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6d30a5a9-9766-4dee-94af-d02284c2c7a2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:34.866494 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6d30a5a9-9766-4dee-94af-d02284c2c7a2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:34.866934 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6d30a5a9-9766-4dee-94af-d02284c2c7a2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:34.928761 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6d30a5a9-9766-4dee-94af-d02284c2c7a2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:34.936152 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6d30a5a9-9766-4dee-94af-d02284c2c7a2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1130 microversion: 2.1 time: 0.081592 Aug 25 05:36:34.936714 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 351/725] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:36:34 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1130 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:36:35.952017 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-41aafdf2-026c-492b-97d9-69544523dfd6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:35.962085 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-41aafdf2-026c-492b-97d9-69544523dfd6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:35.962085 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-41aafdf2-026c-492b-97d9-69544523dfd6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:35.962085 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-41aafdf2-026c-492b-97d9-69544523dfd6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:35.962085 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-41aafdf2-026c-492b-97d9-69544523dfd6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:35.962659 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-41aafdf2-026c-492b-97d9-69544523dfd6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:36.045066 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-41aafdf2-026c-492b-97d9-69544523dfd6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:36.057438 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-41aafdf2-026c-492b-97d9-69544523dfd6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1186 microversion: 2.1 time: 0.109121 Aug 25 05:36:36.058101 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 375/726] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:36:35 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1186 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:36:36.690789 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6e53d39c-6dc4-4882-9957-437cda86ce97 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:36.691326 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6e53d39c-6dc4-4882-9957-437cda86ce97 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:36.705484 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6e53d39c-6dc4-4882-9957-437cda86ce97 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:36.705953 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6e53d39c-6dc4-4882-9957-437cda86ce97 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:36.706996 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6e53d39c-6dc4-4882-9957-437cda86ce97 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:36.707604 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6e53d39c-6dc4-4882-9957-437cda86ce97 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:37.077773 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c21b8b5f-4952-4e35-8ee5-72fc6f5a73cf tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:37.078422 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c21b8b5f-4952-4e35-8ee5-72fc6f5a73cf tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:37.085724 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c21b8b5f-4952-4e35-8ee5-72fc6f5a73cf tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:37.086179 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c21b8b5f-4952-4e35-8ee5-72fc6f5a73cf tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:37.086973 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c21b8b5f-4952-4e35-8ee5-72fc6f5a73cf tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:37.087438 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c21b8b5f-4952-4e35-8ee5-72fc6f5a73cf tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:37.113653 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.objects.instance [None req-6e53d39c-6dc4-4882-9957-437cda86ce97 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lazy-loading 'services' on Instance uuid 4c438716-186a-4b29-b29e-e9c6a71a5a27 {{(pid=108884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 05:36:37.259258 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-c21b8b5f-4952-4e35-8ee5-72fc6f5a73cf tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:37.267512 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c21b8b5f-4952-4e35-8ee5-72fc6f5a73cf tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1271 microversion: 2.1 time: 0.195542 Aug 25 05:36:37.268423 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 376/727] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:36:37 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1271 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:36:37.392234 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6e53d39c-6dc4-4882-9957-437cda86ce97 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments/d0e72902-9f29-47b6-a3f4-dc9d4ddabdc6" status: 202 len: 0 microversion: 2.1 time: 0.909312 Aug 25 05:36:37.392817 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 352/728] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 25 05:36:36 2021] DELETE /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments/d0e72902-9f29-47b6-a3f4-dc9d4ddabdc6 => generated 0 bytes in 911 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:36:38.034414 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [req-45cf0b92-5113-4f4d-bd8f-b7b0a17392e8 req-2e850f01-0169-42f4-9429-43af913bdfea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30a141ef-390c-4d75-94ba-c3112c06bc39", "tag": "b5e81396-e117-425e-887b-37001fc73ed9"}]} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:36:38.038826 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:36:38.038826 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: warnings.warn(msg) Aug 25 05:36:38.047594 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-45cf0b92-5113-4f4d-bd8f-b7b0a17392e8 req-2e850f01-0169-42f4-9429-43af913bdfea service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:38.048133 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-45cf0b92-5113-4f4d-bd8f-b7b0a17392e8 req-2e850f01-0169-42f4-9429-43af913bdfea service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:38.061466 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.compute.server_external_events [req-45cf0b92-5113-4f4d-bd8f-b7b0a17392e8 req-2e850f01-0169-42f4-9429-43af913bdfea service nova] Creating event network-changed:b5e81396-e117-425e-887b-37001fc73ed9 for instance 30a141ef-390c-4d75-94ba-c3112c06bc39 on hv-cinder-78662 Aug 25 05:36:38.066769 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [req-45cf0b92-5113-4f4d-bd8f-b7b0a17392e8 req-2e850f01-0169-42f4-9429-43af913bdfea service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129096 Aug 25 05:36:38.067431 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 377/729] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:36:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:36:38.285358 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b757eb44-35b4-4f0e-8c9d-1ffbf23f6543 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:38.286083 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b757eb44-35b4-4f0e-8c9d-1ffbf23f6543 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:38.292529 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b757eb44-35b4-4f0e-8c9d-1ffbf23f6543 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:38.292989 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b757eb44-35b4-4f0e-8c9d-1ffbf23f6543 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:38.293789 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b757eb44-35b4-4f0e-8c9d-1ffbf23f6543 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:38.294248 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b757eb44-35b4-4f0e-8c9d-1ffbf23f6543 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:38.429655 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-b757eb44-35b4-4f0e-8c9d-1ffbf23f6543 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:38.437004 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b757eb44-35b4-4f0e-8c9d-1ffbf23f6543 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.156133 Aug 25 05:36:38.437759 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 353/730] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:36:38 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:36:39.454392 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a2997441-9d9d-4d53-97c4-6f906fd88953 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:39.455072 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a2997441-9d9d-4d53-97c4-6f906fd88953 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:39.461798 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a2997441-9d9d-4d53-97c4-6f906fd88953 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:39.462239 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a2997441-9d9d-4d53-97c4-6f906fd88953 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:39.462989 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a2997441-9d9d-4d53-97c4-6f906fd88953 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:39.463412 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a2997441-9d9d-4d53-97c4-6f906fd88953 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:39.594420 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-a2997441-9d9d-4d53-97c4-6f906fd88953 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:39.602174 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a2997441-9d9d-4d53-97c4-6f906fd88953 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.151773 Aug 25 05:36:39.602732 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 378/731] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:36:39 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:36:40.618309 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-68386e09-ae2e-4bce-b99e-5f6822545dc6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:40.618922 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-68386e09-ae2e-4bce-b99e-5f6822545dc6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:40.624739 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-68386e09-ae2e-4bce-b99e-5f6822545dc6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:40.625185 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-68386e09-ae2e-4bce-b99e-5f6822545dc6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:40.625977 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-68386e09-ae2e-4bce-b99e-5f6822545dc6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:40.626405 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-68386e09-ae2e-4bce-b99e-5f6822545dc6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:40.751685 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-68386e09-ae2e-4bce-b99e-5f6822545dc6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:40.760333 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-68386e09-ae2e-4bce-b99e-5f6822545dc6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.145763 Aug 25 05:36:40.760933 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 354/732] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:36:40 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:36:41.778561 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-35b484c2-04ea-4c84-bd6c-49f6d89d844e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:41.779156 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-35b484c2-04ea-4c84-bd6c-49f6d89d844e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:41.785175 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-35b484c2-04ea-4c84-bd6c-49f6d89d844e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:41.785641 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-35b484c2-04ea-4c84-bd6c-49f6d89d844e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:41.786441 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-35b484c2-04ea-4c84-bd6c-49f6d89d844e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:41.786817 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-35b484c2-04ea-4c84-bd6c-49f6d89d844e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:41.907938 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-35b484c2-04ea-4c84-bd6c-49f6d89d844e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:41.916250 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-35b484c2-04ea-4c84-bd6c-49f6d89d844e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.141336 Aug 25 05:36:41.916811 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 379/733] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:36:41 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:36:42.932496 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-36739fc3-1c3f-4107-9914-ec0aecd885d1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:42.933098 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-36739fc3-1c3f-4107-9914-ec0aecd885d1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:42.938961 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-36739fc3-1c3f-4107-9914-ec0aecd885d1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:42.939402 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-36739fc3-1c3f-4107-9914-ec0aecd885d1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:42.940158 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-36739fc3-1c3f-4107-9914-ec0aecd885d1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:42.940588 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-36739fc3-1c3f-4107-9914-ec0aecd885d1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:43.061402 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-36739fc3-1c3f-4107-9914-ec0aecd885d1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:43.069244 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-36739fc3-1c3f-4107-9914-ec0aecd885d1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.140373 Aug 25 05:36:43.069840 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 355/734] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:36:42 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:36:44.086558 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-52c08881-fcb3-4121-90f5-d3384304fa6a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:44.087166 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-52c08881-fcb3-4121-90f5-d3384304fa6a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:44.092937 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-52c08881-fcb3-4121-90f5-d3384304fa6a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:44.093380 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-52c08881-fcb3-4121-90f5-d3384304fa6a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:44.094167 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-52c08881-fcb3-4121-90f5-d3384304fa6a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:44.094596 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-52c08881-fcb3-4121-90f5-d3384304fa6a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:44.219163 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-52c08881-fcb3-4121-90f5-d3384304fa6a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:44.226771 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-52c08881-fcb3-4121-90f5-d3384304fa6a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.144958 Aug 25 05:36:44.227347 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 380/735] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:36:44 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:36:45.243360 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-20bc475c-41ac-4a93-a89d-90f129d7a6bf tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:45.243973 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-20bc475c-41ac-4a93-a89d-90f129d7a6bf tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:45.250400 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-20bc475c-41ac-4a93-a89d-90f129d7a6bf tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:45.250863 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-20bc475c-41ac-4a93-a89d-90f129d7a6bf tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:45.251632 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-20bc475c-41ac-4a93-a89d-90f129d7a6bf tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:45.252127 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-20bc475c-41ac-4a93-a89d-90f129d7a6bf tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:45.376762 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-20bc475c-41ac-4a93-a89d-90f129d7a6bf tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:45.385187 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-20bc475c-41ac-4a93-a89d-90f129d7a6bf tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.145566 Aug 25 05:36:45.385766 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 356/736] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:36:45 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:36:46.399030 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: ERROR oslo.messaging._drivers.impl_rabbit [-] [024c7946-b47b-4a06-aa5e-7d5b6a13301d] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 25 05:36:46.402264 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-8bf7ba26-8335-47cb-8b76-3127aef86eeb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:46.402939 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-8bf7ba26-8335-47cb-8b76-3127aef86eeb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:46.408637 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8bf7ba26-8335-47cb-8b76-3127aef86eeb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:46.409071 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8bf7ba26-8335-47cb-8b76-3127aef86eeb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:46.410139 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8bf7ba26-8335-47cb-8b76-3127aef86eeb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:46.410566 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8bf7ba26-8335-47cb-8b76-3127aef86eeb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:46.530074 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-8bf7ba26-8335-47cb-8b76-3127aef86eeb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:46.538212 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-8bf7ba26-8335-47cb-8b76-3127aef86eeb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.140558 Aug 25 05:36:46.538791 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 381/737] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:36:46 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:36:47.556086 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-da0ab4b4-ba79-4426-b0fc-3b3980a1969b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:47.556699 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-da0ab4b4-ba79-4426-b0fc-3b3980a1969b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:47.563737 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-da0ab4b4-ba79-4426-b0fc-3b3980a1969b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:47.564184 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-da0ab4b4-ba79-4426-b0fc-3b3980a1969b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:47.565107 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-da0ab4b4-ba79-4426-b0fc-3b3980a1969b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:47.565875 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-da0ab4b4-ba79-4426-b0fc-3b3980a1969b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:47.687508 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-da0ab4b4-ba79-4426-b0fc-3b3980a1969b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:47.694612 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-da0ab4b4-ba79-4426-b0fc-3b3980a1969b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.143412 Aug 25 05:36:47.695177 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 357/738] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:36:47 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:36:48.712521 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-37ee9147-037e-46a3-b952-e8d79ae3cddc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:48.713357 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-37ee9147-037e-46a3-b952-e8d79ae3cddc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:48.730394 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-37ee9147-037e-46a3-b952-e8d79ae3cddc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:48.730838 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-37ee9147-037e-46a3-b952-e8d79ae3cddc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:48.731607 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-37ee9147-037e-46a3-b952-e8d79ae3cddc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:48.732037 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-37ee9147-037e-46a3-b952-e8d79ae3cddc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:48.737946 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO oslo.messaging._drivers.impl_rabbit [-] [024c7946-b47b-4a06-aa5e-7d5b6a13301d] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 33230. Aug 25 05:36:48.860028 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-37ee9147-037e-46a3-b952-e8d79ae3cddc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:48.867138 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-37ee9147-037e-46a3-b952-e8d79ae3cddc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.159098 Aug 25 05:36:48.867689 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 382/739] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:36:48 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:36:49.884311 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5d514aba-576f-4622-b72f-1876e33ac3d7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:49.885000 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5d514aba-576f-4622-b72f-1876e33ac3d7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:49.890841 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5d514aba-576f-4622-b72f-1876e33ac3d7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:49.891284 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5d514aba-576f-4622-b72f-1876e33ac3d7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:49.892045 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5d514aba-576f-4622-b72f-1876e33ac3d7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:49.892482 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5d514aba-576f-4622-b72f-1876e33ac3d7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:50.025457 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-5d514aba-576f-4622-b72f-1876e33ac3d7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:50.032725 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5d514aba-576f-4622-b72f-1876e33ac3d7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.152724 Aug 25 05:36:50.033285 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 358/740] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:36:49 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:36:51.049421 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-3119aa5c-1cb7-44a6-87ba-3a27474ee34c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:51.050047 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-3119aa5c-1cb7-44a6-87ba-3a27474ee34c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:51.058185 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3119aa5c-1cb7-44a6-87ba-3a27474ee34c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:51.058631 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3119aa5c-1cb7-44a6-87ba-3a27474ee34c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:51.059393 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3119aa5c-1cb7-44a6-87ba-3a27474ee34c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:51.059824 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3119aa5c-1cb7-44a6-87ba-3a27474ee34c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:51.181850 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-3119aa5c-1cb7-44a6-87ba-3a27474ee34c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:51.189595 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-3119aa5c-1cb7-44a6-87ba-3a27474ee34c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.143706 Aug 25 05:36:51.190204 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 383/741] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:36:51 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:36:52.206193 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-0e3df89d-d525-4770-b5dc-e09eb2c83e17 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:52.206841 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-0e3df89d-d525-4770-b5dc-e09eb2c83e17 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:52.213361 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0e3df89d-d525-4770-b5dc-e09eb2c83e17 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:52.216929 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0e3df89d-d525-4770-b5dc-e09eb2c83e17 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:52.216929 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0e3df89d-d525-4770-b5dc-e09eb2c83e17 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:52.216929 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0e3df89d-d525-4770-b5dc-e09eb2c83e17 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:52.342247 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-0e3df89d-d525-4770-b5dc-e09eb2c83e17 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:52.349348 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-0e3df89d-d525-4770-b5dc-e09eb2c83e17 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.146823 Aug 25 05:36:52.349941 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 359/742] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:36:52 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:36:53.366149 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-19f8b558-e1af-4b0a-b65b-a27c0bd4a0f4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:53.366758 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-19f8b558-e1af-4b0a-b65b-a27c0bd4a0f4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:53.374373 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-19f8b558-e1af-4b0a-b65b-a27c0bd4a0f4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:53.375254 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-19f8b558-e1af-4b0a-b65b-a27c0bd4a0f4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:53.376030 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-19f8b558-e1af-4b0a-b65b-a27c0bd4a0f4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:53.376858 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-19f8b558-e1af-4b0a-b65b-a27c0bd4a0f4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:53.501909 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-19f8b558-e1af-4b0a-b65b-a27c0bd4a0f4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:53.509274 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-19f8b558-e1af-4b0a-b65b-a27c0bd4a0f4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.147182 Aug 25 05:36:53.509918 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 384/743] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:36:53 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:36:54.525818 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3916f5a3-3c96-4eb1-bffd-cf113e8b8a1b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:54.526423 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3916f5a3-3c96-4eb1-bffd-cf113e8b8a1b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:54.532295 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3916f5a3-3c96-4eb1-bffd-cf113e8b8a1b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:54.532741 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3916f5a3-3c96-4eb1-bffd-cf113e8b8a1b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:54.533512 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3916f5a3-3c96-4eb1-bffd-cf113e8b8a1b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:54.534225 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3916f5a3-3c96-4eb1-bffd-cf113e8b8a1b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:54.661722 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-3916f5a3-3c96-4eb1-bffd-cf113e8b8a1b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:54.669404 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3916f5a3-3c96-4eb1-bffd-cf113e8b8a1b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.147237 Aug 25 05:36:54.670396 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 360/744] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:36:54 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:36:55.686723 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-8892170c-5c1b-4ad3-89c1-8175ed8556e9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:55.687347 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-8892170c-5c1b-4ad3-89c1-8175ed8556e9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:55.693071 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8892170c-5c1b-4ad3-89c1-8175ed8556e9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:55.693506 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8892170c-5c1b-4ad3-89c1-8175ed8556e9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:55.694448 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8892170c-5c1b-4ad3-89c1-8175ed8556e9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:55.694871 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8892170c-5c1b-4ad3-89c1-8175ed8556e9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:55.822900 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-8892170c-5c1b-4ad3-89c1-8175ed8556e9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:55.830622 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-8892170c-5c1b-4ad3-89c1-8175ed8556e9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.147563 Aug 25 05:36:55.831176 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 385/745] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:36:55 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:36:56.846472 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-f07a9a83-3160-4b1a-a669-1b0c8e528ef7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:56.847073 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-f07a9a83-3160-4b1a-a669-1b0c8e528ef7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:56.853514 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f07a9a83-3160-4b1a-a669-1b0c8e528ef7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:56.853994 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f07a9a83-3160-4b1a-a669-1b0c8e528ef7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:56.854744 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f07a9a83-3160-4b1a-a669-1b0c8e528ef7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:56.855168 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f07a9a83-3160-4b1a-a669-1b0c8e528ef7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:56.978732 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-f07a9a83-3160-4b1a-a669-1b0c8e528ef7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:56.986185 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-f07a9a83-3160-4b1a-a669-1b0c8e528ef7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.143301 Aug 25 05:36:56.986757 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 361/746] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:36:56 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:36:58.002728 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2553e0fd-6556-43e8-b424-69577666e1cc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:58.007309 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2553e0fd-6556-43e8-b424-69577666e1cc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:58.009370 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2553e0fd-6556-43e8-b424-69577666e1cc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:58.009845 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2553e0fd-6556-43e8-b424-69577666e1cc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:58.010617 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2553e0fd-6556-43e8-b424-69577666e1cc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:58.011048 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2553e0fd-6556-43e8-b424-69577666e1cc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:58.148566 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-2553e0fd-6556-43e8-b424-69577666e1cc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:58.157071 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2553e0fd-6556-43e8-b424-69577666e1cc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.158030 Aug 25 05:36:58.157653 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 386/747] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:36:57 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:36:59.176768 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b15d3401-60bd-40cb-8c16-77327da2e10c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:36:59.177317 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b15d3401-60bd-40cb-8c16-77327da2e10c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:36:59.184106 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b15d3401-60bd-40cb-8c16-77327da2e10c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:59.186904 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b15d3401-60bd-40cb-8c16-77327da2e10c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:59.186904 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b15d3401-60bd-40cb-8c16-77327da2e10c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:36:59.186904 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b15d3401-60bd-40cb-8c16-77327da2e10c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:36:59.316428 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-b15d3401-60bd-40cb-8c16-77327da2e10c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:36:59.323992 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b15d3401-60bd-40cb-8c16-77327da2e10c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.150985 Aug 25 05:36:59.324569 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 362/748] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:36:59 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:37:00.340497 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-8732d441-8524-4db1-9513-9b38e03fa4d6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:00.341133 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-8732d441-8524-4db1-9513-9b38e03fa4d6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:00.347048 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8732d441-8524-4db1-9513-9b38e03fa4d6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:00.347496 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8732d441-8524-4db1-9513-9b38e03fa4d6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:00.348261 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8732d441-8524-4db1-9513-9b38e03fa4d6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:00.348698 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8732d441-8524-4db1-9513-9b38e03fa4d6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:00.469130 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-8732d441-8524-4db1-9513-9b38e03fa4d6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:37:00.476307 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-8732d441-8524-4db1-9513-9b38e03fa4d6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.139715 Aug 25 05:37:00.476868 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 387/749] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:37:00 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:37:01.492073 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-95fab1d1-ee2b-4dfc-a582-8a4ca2035919 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:01.492678 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-95fab1d1-ee2b-4dfc-a582-8a4ca2035919 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:01.499359 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-95fab1d1-ee2b-4dfc-a582-8a4ca2035919 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:01.499806 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-95fab1d1-ee2b-4dfc-a582-8a4ca2035919 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:01.500579 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-95fab1d1-ee2b-4dfc-a582-8a4ca2035919 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:01.501007 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-95fab1d1-ee2b-4dfc-a582-8a4ca2035919 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:01.623155 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-95fab1d1-ee2b-4dfc-a582-8a4ca2035919 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:37:01.630418 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-95fab1d1-ee2b-4dfc-a582-8a4ca2035919 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.142009 Aug 25 05:37:01.630984 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 363/750] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:37:01 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:37:02.647148 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5feb7feb-9c6e-4483-a6a3-96ab354e3efe tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:02.647759 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5feb7feb-9c6e-4483-a6a3-96ab354e3efe tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:02.653870 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5feb7feb-9c6e-4483-a6a3-96ab354e3efe tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:02.654319 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5feb7feb-9c6e-4483-a6a3-96ab354e3efe tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:02.655086 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5feb7feb-9c6e-4483-a6a3-96ab354e3efe tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:02.655521 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5feb7feb-9c6e-4483-a6a3-96ab354e3efe tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:02.783094 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-5feb7feb-9c6e-4483-a6a3-96ab354e3efe tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:37:02.794119 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5feb7feb-9c6e-4483-a6a3-96ab354e3efe tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.148403 Aug 25 05:37:02.794119 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 388/751] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:37:02 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:37:03.810197 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7f6b1c43-a414-4d7f-aa43-09d3e09314c8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:03.810746 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7f6b1c43-a414-4d7f-aa43-09d3e09314c8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:03.816906 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7f6b1c43-a414-4d7f-aa43-09d3e09314c8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:03.817347 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7f6b1c43-a414-4d7f-aa43-09d3e09314c8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:03.818143 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7f6b1c43-a414-4d7f-aa43-09d3e09314c8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:03.818575 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7f6b1c43-a414-4d7f-aa43-09d3e09314c8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:03.941688 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-7f6b1c43-a414-4d7f-aa43-09d3e09314c8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:37:03.949951 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7f6b1c43-a414-4d7f-aa43-09d3e09314c8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.143617 Aug 25 05:37:03.950517 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 364/752] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:37:03 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:37:04.967044 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6da476da-983c-4af6-97ed-34f375668bc1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:04.967752 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6da476da-983c-4af6-97ed-34f375668bc1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:04.973432 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6da476da-983c-4af6-97ed-34f375668bc1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:04.973907 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6da476da-983c-4af6-97ed-34f375668bc1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:04.974773 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6da476da-983c-4af6-97ed-34f375668bc1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:04.975105 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6da476da-983c-4af6-97ed-34f375668bc1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:05.097931 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-6da476da-983c-4af6-97ed-34f375668bc1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:37:05.105098 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6da476da-983c-4af6-97ed-34f375668bc1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.142116 Aug 25 05:37:05.105675 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 389/753] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:37:04 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:37:06.121925 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-201b7a1a-7821-4311-aa9b-cdedb8bb985b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:06.122453 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-201b7a1a-7821-4311-aa9b-cdedb8bb985b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:06.128363 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-201b7a1a-7821-4311-aa9b-cdedb8bb985b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:06.128798 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-201b7a1a-7821-4311-aa9b-cdedb8bb985b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:06.129572 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-201b7a1a-7821-4311-aa9b-cdedb8bb985b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:06.130002 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-201b7a1a-7821-4311-aa9b-cdedb8bb985b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:06.260400 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-201b7a1a-7821-4311-aa9b-cdedb8bb985b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:37:06.267670 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-201b7a1a-7821-4311-aa9b-cdedb8bb985b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.150258 Aug 25 05:37:06.268231 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 365/754] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:37:06 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:37:07.286033 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-66e2a0f6-0271-4123-8423-89498abc5ad7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:07.286662 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-66e2a0f6-0271-4123-8423-89498abc5ad7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:07.293165 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-66e2a0f6-0271-4123-8423-89498abc5ad7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:07.293681 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-66e2a0f6-0271-4123-8423-89498abc5ad7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:07.294435 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-66e2a0f6-0271-4123-8423-89498abc5ad7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:07.294857 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-66e2a0f6-0271-4123-8423-89498abc5ad7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:07.426972 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-66e2a0f6-0271-4123-8423-89498abc5ad7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:37:07.434829 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-66e2a0f6-0271-4123-8423-89498abc5ad7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.152867 Aug 25 05:37:07.435385 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 390/755] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:37:07 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:37:08.451620 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8a769879-a68f-4ecc-b95e-5fda0a47d91b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:08.452311 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8a769879-a68f-4ecc-b95e-5fda0a47d91b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:08.458098 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8a769879-a68f-4ecc-b95e-5fda0a47d91b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:08.458539 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8a769879-a68f-4ecc-b95e-5fda0a47d91b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:08.459310 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8a769879-a68f-4ecc-b95e-5fda0a47d91b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:08.459735 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8a769879-a68f-4ecc-b95e-5fda0a47d91b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:08.581906 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-8a769879-a68f-4ecc-b95e-5fda0a47d91b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:37:08.589262 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8a769879-a68f-4ecc-b95e-5fda0a47d91b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.141810 Aug 25 05:37:08.589883 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 366/756] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:37:08 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:37:09.605957 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-253ebefd-33bf-4a1b-84b7-18ecc1787d8a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:09.606609 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-253ebefd-33bf-4a1b-84b7-18ecc1787d8a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:09.612563 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-253ebefd-33bf-4a1b-84b7-18ecc1787d8a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:09.612999 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-253ebefd-33bf-4a1b-84b7-18ecc1787d8a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:09.613791 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-253ebefd-33bf-4a1b-84b7-18ecc1787d8a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:09.614218 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-253ebefd-33bf-4a1b-84b7-18ecc1787d8a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:09.736417 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-253ebefd-33bf-4a1b-84b7-18ecc1787d8a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:37:09.744377 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-253ebefd-33bf-4a1b-84b7-18ecc1787d8a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.142214 Aug 25 05:37:09.745022 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 391/757] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:37:09 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:37:10.761454 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-88d0fc04-3279-4e8d-b061-dc0acfe7cf4c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:10.762054 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-88d0fc04-3279-4e8d-b061-dc0acfe7cf4c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:10.768093 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-88d0fc04-3279-4e8d-b061-dc0acfe7cf4c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:10.768521 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-88d0fc04-3279-4e8d-b061-dc0acfe7cf4c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:10.769291 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-88d0fc04-3279-4e8d-b061-dc0acfe7cf4c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:10.769754 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-88d0fc04-3279-4e8d-b061-dc0acfe7cf4c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:10.892996 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-88d0fc04-3279-4e8d-b061-dc0acfe7cf4c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:37:10.900152 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-88d0fc04-3279-4e8d-b061-dc0acfe7cf4c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.142862 Aug 25 05:37:10.901447 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 367/758] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:37:10 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:37:11.918000 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d7addd1a-abb0-42dd-97b9-365759ac9207 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:11.918616 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d7addd1a-abb0-42dd-97b9-365759ac9207 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:11.924626 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d7addd1a-abb0-42dd-97b9-365759ac9207 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:11.925069 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d7addd1a-abb0-42dd-97b9-365759ac9207 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:11.925852 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d7addd1a-abb0-42dd-97b9-365759ac9207 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:11.926283 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d7addd1a-abb0-42dd-97b9-365759ac9207 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:12.045375 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d7addd1a-abb0-42dd-97b9-365759ac9207 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:37:12.052693 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d7addd1a-abb0-42dd-97b9-365759ac9207 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.139225 Aug 25 05:37:12.057843 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 392/759] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:37:11 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:37:13.071835 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-2da74822-7493-4917-93b3-9b0283290cc2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:13.072533 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-2da74822-7493-4917-93b3-9b0283290cc2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:13.079538 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2da74822-7493-4917-93b3-9b0283290cc2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:13.079983 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2da74822-7493-4917-93b3-9b0283290cc2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:13.080763 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2da74822-7493-4917-93b3-9b0283290cc2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:13.081202 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2da74822-7493-4917-93b3-9b0283290cc2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:13.205286 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-2da74822-7493-4917-93b3-9b0283290cc2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:37:13.212612 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-2da74822-7493-4917-93b3-9b0283290cc2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.144362 Aug 25 05:37:13.213166 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 368/760] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:37:13 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:37:14.231830 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-737e0701-5e12-452e-9d74-ae538815fa78 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:14.234201 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-737e0701-5e12-452e-9d74-ae538815fa78 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:14.245926 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-737e0701-5e12-452e-9d74-ae538815fa78 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:14.246674 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-737e0701-5e12-452e-9d74-ae538815fa78 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:14.247111 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-737e0701-5e12-452e-9d74-ae538815fa78 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:14.247535 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-737e0701-5e12-452e-9d74-ae538815fa78 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:14.379709 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-737e0701-5e12-452e-9d74-ae538815fa78 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:37:14.388091 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-737e0701-5e12-452e-9d74-ae538815fa78 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.162103 Aug 25 05:37:14.388685 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 393/761] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:37:14 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:37:15.069620 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-30b03600-7c8d-4bb6-a0a7-fd6eebfdf92c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:15.070197 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-30b03600-7c8d-4bb6-a0a7-fd6eebfdf92c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:15.076785 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-30b03600-7c8d-4bb6-a0a7-fd6eebfdf92c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:15.077217 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-30b03600-7c8d-4bb6-a0a7-fd6eebfdf92c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:15.078007 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-30b03600-7c8d-4bb6-a0a7-fd6eebfdf92c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:15.078434 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-30b03600-7c8d-4bb6-a0a7-fd6eebfdf92c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:15.108268 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-30b03600-7c8d-4bb6-a0a7-fd6eebfdf92c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments/0cc795f2-71c7-4a92-b053-54fa85cbf2e0" status: 200 len: 194 microversion: 2.20 time: 0.042371 Aug 25 05:37:15.108882 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 369/762] 10.222.0.42 () {60 vars in 1454 bytes} [Wed Aug 25 05:37:15 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments/0cc795f2-71c7-4a92-b053-54fa85cbf2e0 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:37:15.174189 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-74599b0d-0584-4b80-9707-0f77facf58ad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:15.174693 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-74599b0d-0584-4b80-9707-0f77facf58ad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:15.180462 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-74599b0d-0584-4b80-9707-0f77facf58ad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:15.180902 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-74599b0d-0584-4b80-9707-0f77facf58ad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:15.181712 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-74599b0d-0584-4b80-9707-0f77facf58ad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:15.182724 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-74599b0d-0584-4b80-9707-0f77facf58ad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:15.266528 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.objects.instance [None req-74599b0d-0584-4b80-9707-0f77facf58ad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lazy-loading 'services' on Instance uuid 4cb635d4-76ba-4143-8f4d-a64c720966da {{(pid=108885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 05:37:15.405005 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-80abaf3d-79a4-4ee7-8364-d24136e8da77 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:15.405547 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-80abaf3d-79a4-4ee7-8364-d24136e8da77 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:15.411693 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-80abaf3d-79a4-4ee7-8364-d24136e8da77 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:15.412132 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-80abaf3d-79a4-4ee7-8364-d24136e8da77 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:15.412882 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-80abaf3d-79a4-4ee7-8364-d24136e8da77 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:15.413310 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-80abaf3d-79a4-4ee7-8364-d24136e8da77 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:15.511900 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-74599b0d-0584-4b80-9707-0f77facf58ad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments/0cc795f2-71c7-4a92-b053-54fa85cbf2e0" status: 202 len: 0 microversion: 2.20 time: 0.340343 Aug 25 05:37:15.512885 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 394/763] 10.222.0.42 () {60 vars in 1457 bytes} [Wed Aug 25 05:37:15 2021] DELETE /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments/0cc795f2-71c7-4a92-b053-54fa85cbf2e0 => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 05:37:15.523191 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7a348fc2-c500-4818-b96b-04c4a55c1092 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:15.526625 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-7a348fc2-c500-4818-b96b-04c4a55c1092 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:15.532509 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7a348fc2-c500-4818-b96b-04c4a55c1092 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:15.532959 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7a348fc2-c500-4818-b96b-04c4a55c1092 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:15.534029 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7a348fc2-c500-4818-b96b-04c4a55c1092 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:15.534461 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7a348fc2-c500-4818-b96b-04c4a55c1092 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:15.553395 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-80abaf3d-79a4-4ee7-8364-d24136e8da77 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:37:15.560160 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-80abaf3d-79a4-4ee7-8364-d24136e8da77 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.159286 Aug 25 05:37:15.564455 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 370/764] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:37:15 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:37:15.569282 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-7a348fc2-c500-4818-b96b-04c4a55c1092 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052016 Aug 25 05:37:15.569873 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 395/765] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:15 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:37:16.576987 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5e67bdd4-482c-49b7-ba2b-efcfa042aabc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:16.577635 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5e67bdd4-482c-49b7-ba2b-efcfa042aabc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:16.581509 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-8c3f6ac4-3431-471d-b2be-ee8c0db3787d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:16.582579 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-8c3f6ac4-3431-471d-b2be-ee8c0db3787d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:16.583935 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5e67bdd4-482c-49b7-ba2b-efcfa042aabc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:16.584392 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5e67bdd4-482c-49b7-ba2b-efcfa042aabc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:16.585170 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5e67bdd4-482c-49b7-ba2b-efcfa042aabc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:16.585649 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5e67bdd4-482c-49b7-ba2b-efcfa042aabc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:16.590603 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8c3f6ac4-3431-471d-b2be-ee8c0db3787d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:16.590603 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8c3f6ac4-3431-471d-b2be-ee8c0db3787d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:16.590603 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8c3f6ac4-3431-471d-b2be-ee8c0db3787d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:16.590951 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8c3f6ac4-3431-471d-b2be-ee8c0db3787d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:16.621630 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-8c3f6ac4-3431-471d-b2be-ee8c0db3787d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043757 Aug 25 05:37:16.622399 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 396/766] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:16 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:37:16.713056 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-5e67bdd4-482c-49b7-ba2b-efcfa042aabc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:37:16.721506 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5e67bdd4-482c-49b7-ba2b-efcfa042aabc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.148958 Aug 25 05:37:16.722107 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 371/767] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:37:16 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:37:17.633085 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-20b18dbb-87dc-41ff-8436-eeef6db512aa tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:17.633987 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-20b18dbb-87dc-41ff-8436-eeef6db512aa tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:17.640525 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-20b18dbb-87dc-41ff-8436-eeef6db512aa tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:17.640970 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-20b18dbb-87dc-41ff-8436-eeef6db512aa tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:17.641767 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-20b18dbb-87dc-41ff-8436-eeef6db512aa tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:17.642199 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-20b18dbb-87dc-41ff-8436-eeef6db512aa tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:17.671283 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-20b18dbb-87dc-41ff-8436-eeef6db512aa tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041993 Aug 25 05:37:17.671849 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 397/768] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:17 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:37:17.739986 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e8caa6df-28b0-4a21-9522-d92dffa6d755 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:17.747961 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e8caa6df-28b0-4a21-9522-d92dffa6d755 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:17.747961 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e8caa6df-28b0-4a21-9522-d92dffa6d755 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:17.747961 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e8caa6df-28b0-4a21-9522-d92dffa6d755 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:17.748592 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e8caa6df-28b0-4a21-9522-d92dffa6d755 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:17.749032 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e8caa6df-28b0-4a21-9522-d92dffa6d755 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:17.872884 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e8caa6df-28b0-4a21-9522-d92dffa6d755 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:37:17.880634 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e8caa6df-28b0-4a21-9522-d92dffa6d755 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.144367 Aug 25 05:37:17.881192 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 372/769] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:37:17 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:37:18.682774 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-690b0147-1dd0-40b6-96ef-08a6d42c5a21 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:18.683671 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-690b0147-1dd0-40b6-96ef-08a6d42c5a21 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:18.689971 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-690b0147-1dd0-40b6-96ef-08a6d42c5a21 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:18.690415 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-690b0147-1dd0-40b6-96ef-08a6d42c5a21 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:18.691173 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-690b0147-1dd0-40b6-96ef-08a6d42c5a21 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:18.691612 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-690b0147-1dd0-40b6-96ef-08a6d42c5a21 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:18.722665 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-690b0147-1dd0-40b6-96ef-08a6d42c5a21 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043484 Aug 25 05:37:18.723445 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 398/770] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:18 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:37:18.897226 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ffd1e12f-410c-44ee-9398-c106c453c5fd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:18.897772 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ffd1e12f-410c-44ee-9398-c106c453c5fd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:18.903436 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ffd1e12f-410c-44ee-9398-c106c453c5fd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:18.903878 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ffd1e12f-410c-44ee-9398-c106c453c5fd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:18.904761 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ffd1e12f-410c-44ee-9398-c106c453c5fd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:18.905183 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ffd1e12f-410c-44ee-9398-c106c453c5fd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:19.025665 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ffd1e12f-410c-44ee-9398-c106c453c5fd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:37:19.032776 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ffd1e12f-410c-44ee-9398-c106c453c5fd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.139291 Aug 25 05:37:19.033628 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 373/771] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:37:18 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:37:19.734498 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-4f5d7001-9151-4784-9abf-2c2fd6ddf92b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:19.735393 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-4f5d7001-9151-4784-9abf-2c2fd6ddf92b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:19.741318 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4f5d7001-9151-4784-9abf-2c2fd6ddf92b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:19.741791 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4f5d7001-9151-4784-9abf-2c2fd6ddf92b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:19.742539 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4f5d7001-9151-4784-9abf-2c2fd6ddf92b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:19.742969 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4f5d7001-9151-4784-9abf-2c2fd6ddf92b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:19.772290 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-4f5d7001-9151-4784-9abf-2c2fd6ddf92b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041616 Aug 25 05:37:19.772971 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 399/772] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:19 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:37:20.049769 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-96e1e294-4d48-4371-9c5c-1bc21eaf93f3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:20.050294 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-96e1e294-4d48-4371-9c5c-1bc21eaf93f3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:20.056064 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-96e1e294-4d48-4371-9c5c-1bc21eaf93f3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:20.056502 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-96e1e294-4d48-4371-9c5c-1bc21eaf93f3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:20.057319 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-96e1e294-4d48-4371-9c5c-1bc21eaf93f3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:20.057858 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-96e1e294-4d48-4371-9c5c-1bc21eaf93f3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:20.182126 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-96e1e294-4d48-4371-9c5c-1bc21eaf93f3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:37:20.189686 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-96e1e294-4d48-4371-9c5c-1bc21eaf93f3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.143717 Aug 25 05:37:20.190252 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 374/773] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:37:20 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:37:20.784662 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-74997c4e-d905-4d2e-b2c4-ffe16ead6a67 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:20.785590 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-74997c4e-d905-4d2e-b2c4-ffe16ead6a67 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:20.791459 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-74997c4e-d905-4d2e-b2c4-ffe16ead6a67 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:20.792472 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-74997c4e-d905-4d2e-b2c4-ffe16ead6a67 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:20.793244 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-74997c4e-d905-4d2e-b2c4-ffe16ead6a67 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:20.793815 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-74997c4e-d905-4d2e-b2c4-ffe16ead6a67 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:20.824045 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-74997c4e-d905-4d2e-b2c4-ffe16ead6a67 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043087 Aug 25 05:37:20.824615 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 400/774] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:20 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:37:21.206988 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1e2ec260-9fac-4980-a3a6-19968370e0d2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:21.207532 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1e2ec260-9fac-4980-a3a6-19968370e0d2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:21.213430 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1e2ec260-9fac-4980-a3a6-19968370e0d2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:21.214413 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1e2ec260-9fac-4980-a3a6-19968370e0d2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:21.215190 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1e2ec260-9fac-4980-a3a6-19968370e0d2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:21.215617 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1e2ec260-9fac-4980-a3a6-19968370e0d2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:21.347066 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-1e2ec260-9fac-4980-a3a6-19968370e0d2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:37:21.355324 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1e2ec260-9fac-4980-a3a6-19968370e0d2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.152229 Aug 25 05:37:21.355964 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 375/775] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:37:21 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:37:21.835935 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-19eb5c2c-08f5-433a-8526-e8ef023217f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:21.836776 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-19eb5c2c-08f5-433a-8526-e8ef023217f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:21.845217 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-19eb5c2c-08f5-433a-8526-e8ef023217f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:21.845698 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-19eb5c2c-08f5-433a-8526-e8ef023217f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:21.846469 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-19eb5c2c-08f5-433a-8526-e8ef023217f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:21.846903 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-19eb5c2c-08f5-433a-8526-e8ef023217f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:21.877245 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-19eb5c2c-08f5-433a-8526-e8ef023217f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046145 Aug 25 05:37:21.877842 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 401/776] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:21 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:37:22.376986 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-4c8dc10e-e7d3-47e9-9d75-0ccb5a2afebc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:22.377615 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-4c8dc10e-e7d3-47e9-9d75-0ccb5a2afebc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:22.383458 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4c8dc10e-e7d3-47e9-9d75-0ccb5a2afebc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:22.383904 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4c8dc10e-e7d3-47e9-9d75-0ccb5a2afebc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:22.384668 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4c8dc10e-e7d3-47e9-9d75-0ccb5a2afebc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:22.385099 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4c8dc10e-e7d3-47e9-9d75-0ccb5a2afebc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:22.510196 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-4c8dc10e-e7d3-47e9-9d75-0ccb5a2afebc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:37:22.518456 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-4c8dc10e-e7d3-47e9-9d75-0ccb5a2afebc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.150541 Aug 25 05:37:22.519034 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 376/777] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:37:22 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:37:22.889173 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-4e480128-c4a6-4788-973c-bb2cc6c928e4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:22.890019 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-4e480128-c4a6-4788-973c-bb2cc6c928e4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:22.895863 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4e480128-c4a6-4788-973c-bb2cc6c928e4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:22.896302 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4e480128-c4a6-4788-973c-bb2cc6c928e4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:22.897053 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4e480128-c4a6-4788-973c-bb2cc6c928e4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:22.897484 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4e480128-c4a6-4788-973c-bb2cc6c928e4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:22.928236 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-4e480128-c4a6-4788-973c-bb2cc6c928e4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043156 Aug 25 05:37:22.928801 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 402/778] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:22 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:37:23.535258 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-dbc7588e-0d57-4b32-9954-32e2a33db4ed tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:23.535790 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-dbc7588e-0d57-4b32-9954-32e2a33db4ed tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:23.541784 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dbc7588e-0d57-4b32-9954-32e2a33db4ed tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:23.542306 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dbc7588e-0d57-4b32-9954-32e2a33db4ed tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:23.543173 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dbc7588e-0d57-4b32-9954-32e2a33db4ed tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:23.543603 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dbc7588e-0d57-4b32-9954-32e2a33db4ed tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:23.667364 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-dbc7588e-0d57-4b32-9954-32e2a33db4ed tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:37:23.674617 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-dbc7588e-0d57-4b32-9954-32e2a33db4ed tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.143599 Aug 25 05:37:23.675182 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 377/779] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:37:23 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:37:23.939507 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c9dfc8bd-1d2d-48bf-a60c-9cc603a7f166 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:23.940343 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c9dfc8bd-1d2d-48bf-a60c-9cc603a7f166 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:23.946135 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c9dfc8bd-1d2d-48bf-a60c-9cc603a7f166 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:23.946573 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c9dfc8bd-1d2d-48bf-a60c-9cc603a7f166 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:23.947322 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c9dfc8bd-1d2d-48bf-a60c-9cc603a7f166 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:23.948408 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c9dfc8bd-1d2d-48bf-a60c-9cc603a7f166 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:23.977101 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c9dfc8bd-1d2d-48bf-a60c-9cc603a7f166 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041515 Aug 25 05:37:23.977987 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 403/780] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:23 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:37:24.691834 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5034fee5-9cbe-48e8-bb9e-b8b02960d6b5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:24.692383 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5034fee5-9cbe-48e8-bb9e-b8b02960d6b5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:24.698191 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5034fee5-9cbe-48e8-bb9e-b8b02960d6b5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:24.698740 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5034fee5-9cbe-48e8-bb9e-b8b02960d6b5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:24.699565 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5034fee5-9cbe-48e8-bb9e-b8b02960d6b5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:24.699993 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5034fee5-9cbe-48e8-bb9e-b8b02960d6b5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:24.822173 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-5034fee5-9cbe-48e8-bb9e-b8b02960d6b5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:37:24.830056 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5034fee5-9cbe-48e8-bb9e-b8b02960d6b5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.141984 Aug 25 05:37:24.830615 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 378/781] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:37:24 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:37:24.989174 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c340baf8-83ae-434c-a76f-993ef7eb94c3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:24.990019 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c340baf8-83ae-434c-a76f-993ef7eb94c3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:24.996621 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c340baf8-83ae-434c-a76f-993ef7eb94c3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:24.997103 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c340baf8-83ae-434c-a76f-993ef7eb94c3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:24.997940 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c340baf8-83ae-434c-a76f-993ef7eb94c3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:24.998374 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c340baf8-83ae-434c-a76f-993ef7eb94c3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:25.028907 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c340baf8-83ae-434c-a76f-993ef7eb94c3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043549 Aug 25 05:37:25.029565 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 404/782] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:24 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:37:25.847464 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-15790ded-97ee-4a6c-b4ce-3ae97141584d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:25.848016 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-15790ded-97ee-4a6c-b4ce-3ae97141584d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:25.853817 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-15790ded-97ee-4a6c-b4ce-3ae97141584d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:25.854257 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-15790ded-97ee-4a6c-b4ce-3ae97141584d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:25.855755 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-15790ded-97ee-4a6c-b4ce-3ae97141584d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:25.856206 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-15790ded-97ee-4a6c-b4ce-3ae97141584d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:25.975630 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-15790ded-97ee-4a6c-b4ce-3ae97141584d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:37:25.982856 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-15790ded-97ee-4a6c-b4ce-3ae97141584d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.139342 Aug 25 05:37:25.983417 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 379/783] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:37:25 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:37:26.040227 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a9b5ce28-5c2a-4d1d-896d-eb2a8d8d3ed2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:26.041124 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a9b5ce28-5c2a-4d1d-896d-eb2a8d8d3ed2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:26.047386 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a9b5ce28-5c2a-4d1d-896d-eb2a8d8d3ed2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:26.047829 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a9b5ce28-5c2a-4d1d-896d-eb2a8d8d3ed2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:26.048595 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a9b5ce28-5c2a-4d1d-896d-eb2a8d8d3ed2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:26.049032 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a9b5ce28-5c2a-4d1d-896d-eb2a8d8d3ed2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:26.078530 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a9b5ce28-5c2a-4d1d-896d-eb2a8d8d3ed2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042062 Aug 25 05:37:26.079087 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 405/784] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:26 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:37:26.999105 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-fd182f74-31df-412a-bdc6-d30c9e1c36fe tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:26.999685 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-fd182f74-31df-412a-bdc6-d30c9e1c36fe tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:27.005595 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fd182f74-31df-412a-bdc6-d30c9e1c36fe tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:27.006047 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fd182f74-31df-412a-bdc6-d30c9e1c36fe tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:27.006825 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fd182f74-31df-412a-bdc6-d30c9e1c36fe tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:27.007248 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fd182f74-31df-412a-bdc6-d30c9e1c36fe tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:27.091142 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6e3f92c5-bb17-441c-aa66-c1ca7793e0cc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:27.092601 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6e3f92c5-bb17-441c-aa66-c1ca7793e0cc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:27.098614 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6e3f92c5-bb17-441c-aa66-c1ca7793e0cc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:27.099093 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6e3f92c5-bb17-441c-aa66-c1ca7793e0cc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:27.099812 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6e3f92c5-bb17-441c-aa66-c1ca7793e0cc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:27.100236 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6e3f92c5-bb17-441c-aa66-c1ca7793e0cc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:27.147508 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6e3f92c5-bb17-441c-aa66-c1ca7793e0cc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061449 Aug 25 05:37:27.151322 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 406/785] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:27 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:37:27.154892 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-fd182f74-31df-412a-bdc6-d30c9e1c36fe tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:37:27.162651 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-fd182f74-31df-412a-bdc6-d30c9e1c36fe tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.167485 Aug 25 05:37:27.167894 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 380/786] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:37:26 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:37:28.159992 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-46f61c50-2fa4-49bc-8895-210ed204cfdc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:28.160900 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-46f61c50-2fa4-49bc-8895-210ed204cfdc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:28.166785 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-46f61c50-2fa4-49bc-8895-210ed204cfdc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:28.167239 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-46f61c50-2fa4-49bc-8895-210ed204cfdc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:28.168004 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-46f61c50-2fa4-49bc-8895-210ed204cfdc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:28.169235 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-46f61c50-2fa4-49bc-8895-210ed204cfdc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:28.182873 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a49f959a-0217-4dc4-ba6a-9792d745a156 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:28.183527 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a49f959a-0217-4dc4-ba6a-9792d745a156 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:28.189922 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a49f959a-0217-4dc4-ba6a-9792d745a156 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:28.190432 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a49f959a-0217-4dc4-ba6a-9792d745a156 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:28.191352 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a49f959a-0217-4dc4-ba6a-9792d745a156 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:28.191843 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a49f959a-0217-4dc4-ba6a-9792d745a156 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:28.198618 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-46f61c50-2fa4-49bc-8895-210ed204cfdc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042680 Aug 25 05:37:28.199189 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 407/787] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:28 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:37:28.327459 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-a49f959a-0217-4dc4-ba6a-9792d745a156 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:37:28.334869 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a49f959a-0217-4dc4-ba6a-9792d745a156 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.156029 Aug 25 05:37:28.335434 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 381/788] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:37:28 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:37:29.211688 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-688848d6-f824-4617-8c49-0113045a7970 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:29.212521 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-688848d6-f824-4617-8c49-0113045a7970 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:29.219175 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-688848d6-f824-4617-8c49-0113045a7970 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:29.221950 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-688848d6-f824-4617-8c49-0113045a7970 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:29.221950 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-688848d6-f824-4617-8c49-0113045a7970 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:29.221950 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-688848d6-f824-4617-8c49-0113045a7970 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:29.251929 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-688848d6-f824-4617-8c49-0113045a7970 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044066 Aug 25 05:37:29.252505 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 408/789] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:29 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:37:29.352630 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d0650dab-791e-403b-8c20-a306c75f5b62 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:29.353237 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-d0650dab-791e-403b-8c20-a306c75f5b62 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:29.359875 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d0650dab-791e-403b-8c20-a306c75f5b62 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:29.360313 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d0650dab-791e-403b-8c20-a306c75f5b62 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:29.361070 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d0650dab-791e-403b-8c20-a306c75f5b62 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:29.361497 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d0650dab-791e-403b-8c20-a306c75f5b62 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:29.484303 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-d0650dab-791e-403b-8c20-a306c75f5b62 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:37:29.491708 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d0650dab-791e-403b-8c20-a306c75f5b62 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.142714 Aug 25 05:37:29.492273 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 382/790] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:37:29 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:37:30.265626 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ce0340fb-767f-4135-b328-74eb941ada71 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:30.266570 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ce0340fb-767f-4135-b328-74eb941ada71 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:30.272427 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ce0340fb-767f-4135-b328-74eb941ada71 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:30.272864 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ce0340fb-767f-4135-b328-74eb941ada71 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:30.273662 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ce0340fb-767f-4135-b328-74eb941ada71 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:30.274212 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ce0340fb-767f-4135-b328-74eb941ada71 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:30.307698 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ce0340fb-767f-4135-b328-74eb941ada71 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046582 Aug 25 05:37:30.308260 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 409/791] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:30 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:37:30.507702 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6866bd09-3e0b-44b5-a13e-830557ae9364 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:30.509051 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6866bd09-3e0b-44b5-a13e-830557ae9364 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:30.515288 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6866bd09-3e0b-44b5-a13e-830557ae9364 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:30.515740 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6866bd09-3e0b-44b5-a13e-830557ae9364 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:30.516545 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6866bd09-3e0b-44b5-a13e-830557ae9364 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:30.516933 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6866bd09-3e0b-44b5-a13e-830557ae9364 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:30.650785 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6866bd09-3e0b-44b5-a13e-830557ae9364 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:37:30.659926 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6866bd09-3e0b-44b5-a13e-830557ae9364 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.154683 Aug 25 05:37:30.660726 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 383/792] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:37:30 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:37:31.320140 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c51fba34-4368-445d-aa1b-7ca65a9c8dbb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:31.321074 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c51fba34-4368-445d-aa1b-7ca65a9c8dbb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:31.327607 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c51fba34-4368-445d-aa1b-7ca65a9c8dbb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:31.328053 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c51fba34-4368-445d-aa1b-7ca65a9c8dbb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:31.328813 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c51fba34-4368-445d-aa1b-7ca65a9c8dbb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:31.329246 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c51fba34-4368-445d-aa1b-7ca65a9c8dbb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:31.358265 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c51fba34-4368-445d-aa1b-7ca65a9c8dbb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041890 Aug 25 05:37:31.358815 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 410/793] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:31 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:37:31.676547 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6d1009d3-bd3a-44b6-a10d-788d8539c406 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:31.677151 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6d1009d3-bd3a-44b6-a10d-788d8539c406 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:31.682970 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6d1009d3-bd3a-44b6-a10d-788d8539c406 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:31.683406 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6d1009d3-bd3a-44b6-a10d-788d8539c406 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:31.684154 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6d1009d3-bd3a-44b6-a10d-788d8539c406 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:31.684578 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6d1009d3-bd3a-44b6-a10d-788d8539c406 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:31.806237 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6d1009d3-bd3a-44b6-a10d-788d8539c406 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:37:31.813451 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6d1009d3-bd3a-44b6-a10d-788d8539c406 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.140499 Aug 25 05:37:31.814161 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 384/794] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:37:31 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:37:32.167509 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [req-7b138227-8b9b-484d-bb56-51e475a54a19 req-cee39510-40c2-4ed8-9a71-73251efb3db9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30a141ef-390c-4d75-94ba-c3112c06bc39", "name": "network-vif-plugged", "status": "completed", "tag": "b5e81396-e117-425e-887b-37001fc73ed9"}]} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:37:32.168982 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:37:32.168982 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: warnings.warn(msg) Aug 25 05:37:32.175960 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-7b138227-8b9b-484d-bb56-51e475a54a19 req-cee39510-40c2-4ed8-9a71-73251efb3db9 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:32.176394 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-7b138227-8b9b-484d-bb56-51e475a54a19 req-cee39510-40c2-4ed8-9a71-73251efb3db9 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:32.187240 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.compute.server_external_events [req-7b138227-8b9b-484d-bb56-51e475a54a19 req-cee39510-40c2-4ed8-9a71-73251efb3db9 service nova] Creating event network-vif-plugged:b5e81396-e117-425e-887b-37001fc73ed9 for instance 30a141ef-390c-4d75-94ba-c3112c06bc39 on hv-cinder-78662 Aug 25 05:37:32.192173 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [req-7b138227-8b9b-484d-bb56-51e475a54a19 req-cee39510-40c2-4ed8-9a71-73251efb3db9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082783 Aug 25 05:37:32.192743 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 411/795] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:37:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:37:32.370150 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1b0eb56f-a4e7-4a59-88c7-ac0b3abeb6e6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:32.371008 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1b0eb56f-a4e7-4a59-88c7-ac0b3abeb6e6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:32.377689 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1b0eb56f-a4e7-4a59-88c7-ac0b3abeb6e6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:32.378134 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1b0eb56f-a4e7-4a59-88c7-ac0b3abeb6e6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:32.378953 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1b0eb56f-a4e7-4a59-88c7-ac0b3abeb6e6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:32.379380 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1b0eb56f-a4e7-4a59-88c7-ac0b3abeb6e6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:32.409330 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1b0eb56f-a4e7-4a59-88c7-ac0b3abeb6e6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043328 Aug 25 05:37:32.410158 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 385/796] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:32 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:37:32.830552 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b9e136da-a639-471e-ad91-c4f8c6fb085b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:32.831228 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b9e136da-a639-471e-ad91-c4f8c6fb085b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:32.837516 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b9e136da-a639-471e-ad91-c4f8c6fb085b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:32.838005 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b9e136da-a639-471e-ad91-c4f8c6fb085b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:32.838764 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b9e136da-a639-471e-ad91-c4f8c6fb085b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:32.839194 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b9e136da-a639-471e-ad91-c4f8c6fb085b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:32.962515 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-b9e136da-a639-471e-ad91-c4f8c6fb085b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:37:32.970337 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b9e136da-a639-471e-ad91-c4f8c6fb085b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.143813 Aug 25 05:37:32.970900 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 412/797] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:37:32 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:37:33.421650 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c416d4b0-262f-45f9-8dcf-5d91da11032e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:33.422616 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c416d4b0-262f-45f9-8dcf-5d91da11032e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:33.428400 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c416d4b0-262f-45f9-8dcf-5d91da11032e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:33.428869 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c416d4b0-262f-45f9-8dcf-5d91da11032e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:33.429641 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c416d4b0-262f-45f9-8dcf-5d91da11032e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:33.430069 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c416d4b0-262f-45f9-8dcf-5d91da11032e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:33.458966 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c416d4b0-262f-45f9-8dcf-5d91da11032e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041332 Aug 25 05:37:33.459519 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 386/798] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:33 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:37:33.986602 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b60b5ba3-ac98-440a-8226-38627f021973 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:33.987180 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b60b5ba3-ac98-440a-8226-38627f021973 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:33.992829 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b60b5ba3-ac98-440a-8226-38627f021973 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:33.993263 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b60b5ba3-ac98-440a-8226-38627f021973 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:33.994073 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b60b5ba3-ac98-440a-8226-38627f021973 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:33.994502 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b60b5ba3-ac98-440a-8226-38627f021973 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:34.118177 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-b60b5ba3-ac98-440a-8226-38627f021973 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:37:34.126477 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b60b5ba3-ac98-440a-8226-38627f021973 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1259 microversion: 2.1 time: 0.143534 Aug 25 05:37:34.127050 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 413/799] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:37:33 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1259 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:37:34.470483 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ce29fa0b-ff57-45f1-8c03-27352d35a540 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:34.471378 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ce29fa0b-ff57-45f1-8c03-27352d35a540 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:34.477139 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ce29fa0b-ff57-45f1-8c03-27352d35a540 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:34.477604 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ce29fa0b-ff57-45f1-8c03-27352d35a540 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:34.478381 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ce29fa0b-ff57-45f1-8c03-27352d35a540 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:34.478809 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ce29fa0b-ff57-45f1-8c03-27352d35a540 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:34.508099 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ce29fa0b-ff57-45f1-8c03-27352d35a540 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041421 Aug 25 05:37:34.508670 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 387/800] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:34 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:37:35.143431 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7e04e6ef-b19b-4ba4-bdac-64b26929f113 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:35.144028 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-7e04e6ef-b19b-4ba4-bdac-64b26929f113 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:35.149824 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7e04e6ef-b19b-4ba4-bdac-64b26929f113 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:35.150261 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7e04e6ef-b19b-4ba4-bdac-64b26929f113 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:35.151004 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7e04e6ef-b19b-4ba4-bdac-64b26929f113 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:35.151427 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7e04e6ef-b19b-4ba4-bdac-64b26929f113 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:35.280358 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-7e04e6ef-b19b-4ba4-bdac-64b26929f113 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:37:35.287963 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-7e04e6ef-b19b-4ba4-bdac-64b26929f113 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1443 microversion: 2.1 time: 0.148240 Aug 25 05:37:35.288895 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 414/801] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:37:35 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1443 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:37:35.304595 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1c589722-70a7-4e7c-a439-869503bf601e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:35.305208 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1c589722-70a7-4e7c-a439-869503bf601e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:35.311470 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1c589722-70a7-4e7c-a439-869503bf601e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:35.311922 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1c589722-70a7-4e7c-a439-869503bf601e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:35.312687 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1c589722-70a7-4e7c-a439-869503bf601e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:35.313121 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1c589722-70a7-4e7c-a439-869503bf601e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:35.431529 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-1c589722-70a7-4e7c-a439-869503bf601e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:37:35.438899 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1c589722-70a7-4e7c-a439-869503bf601e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1443 microversion: 2.1 time: 0.137941 Aug 25 05:37:35.439482 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 388/802] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:37:35 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1443 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:37:35.524519 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-0868eccf-158e-4468-be93-6eaf6d68a231 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:35.525477 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-0868eccf-158e-4468-be93-6eaf6d68a231 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:35.535872 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0868eccf-158e-4468-be93-6eaf6d68a231 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:35.537119 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0868eccf-158e-4468-be93-6eaf6d68a231 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:35.537424 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0868eccf-158e-4468-be93-6eaf6d68a231 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:35.537877 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0868eccf-158e-4468-be93-6eaf6d68a231 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:35.572937 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-0868eccf-158e-4468-be93-6eaf6d68a231 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052068 Aug 25 05:37:35.573499 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 415/803] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:35 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:37:36.584223 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3a9bebbd-01c5-4f05-ae37-fdc4f8d4ae49 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:36.585284 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3a9bebbd-01c5-4f05-ae37-fdc4f8d4ae49 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:36.591276 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3a9bebbd-01c5-4f05-ae37-fdc4f8d4ae49 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:36.592323 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3a9bebbd-01c5-4f05-ae37-fdc4f8d4ae49 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:36.593094 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3a9bebbd-01c5-4f05-ae37-fdc4f8d4ae49 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:36.593589 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3a9bebbd-01c5-4f05-ae37-fdc4f8d4ae49 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:36.621976 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3a9bebbd-01c5-4f05-ae37-fdc4f8d4ae49 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041484 Aug 25 05:37:36.622527 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 389/804] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:36 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:37:37.590135 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [req-9d6b4c27-4bb4-4c3e-8d24-b132b1003a26 req-4c656553-88d9-4f9b-8304-145666a4bafc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30a141ef-390c-4d75-94ba-c3112c06bc39", "tag": "b5e81396-e117-425e-887b-37001fc73ed9"}]} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:37:37.592225 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:37:37.592225 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: warnings.warn(msg) Aug 25 05:37:37.599492 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-9d6b4c27-4bb4-4c3e-8d24-b132b1003a26 req-4c656553-88d9-4f9b-8304-145666a4bafc service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:37.599930 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-9d6b4c27-4bb4-4c3e-8d24-b132b1003a26 req-4c656553-88d9-4f9b-8304-145666a4bafc service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:37.611940 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.compute.server_external_events [req-9d6b4c27-4bb4-4c3e-8d24-b132b1003a26 req-4c656553-88d9-4f9b-8304-145666a4bafc service nova] Creating event network-changed:b5e81396-e117-425e-887b-37001fc73ed9 for instance 30a141ef-390c-4d75-94ba-c3112c06bc39 on hv-cinder-78662 Aug 25 05:37:37.617421 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [req-9d6b4c27-4bb4-4c3e-8d24-b132b1003a26 req-4c656553-88d9-4f9b-8304-145666a4bafc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091594 Aug 25 05:37:37.618116 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 416/805] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:37:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:37:37.635361 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a178c29c-098b-4b92-a897-e4076ea6b9e0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:37.636313 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a178c29c-098b-4b92-a897-e4076ea6b9e0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:37.642648 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a178c29c-098b-4b92-a897-e4076ea6b9e0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:37.643090 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a178c29c-098b-4b92-a897-e4076ea6b9e0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:37.643863 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a178c29c-098b-4b92-a897-e4076ea6b9e0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:37.644489 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a178c29c-098b-4b92-a897-e4076ea6b9e0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:37.677284 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a178c29c-098b-4b92-a897-e4076ea6b9e0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045922 Aug 25 05:37:37.677806 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 390/806] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:37 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:37:38.689770 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-482c1935-7cc7-4920-80be-3c01c7ebe65d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:38.690782 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-482c1935-7cc7-4920-80be-3c01c7ebe65d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:38.697404 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-482c1935-7cc7-4920-80be-3c01c7ebe65d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:38.697866 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-482c1935-7cc7-4920-80be-3c01c7ebe65d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:38.698625 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-482c1935-7cc7-4920-80be-3c01c7ebe65d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:38.699047 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-482c1935-7cc7-4920-80be-3c01c7ebe65d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:38.730685 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-482c1935-7cc7-4920-80be-3c01c7ebe65d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045182 Aug 25 05:37:38.731242 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 417/807] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:38 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:37:39.742755 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-2710ce2b-3dff-468a-a82e-ae07af8ee59f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:39.743600 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-2710ce2b-3dff-468a-a82e-ae07af8ee59f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:39.750312 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2710ce2b-3dff-468a-a82e-ae07af8ee59f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:39.750756 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2710ce2b-3dff-468a-a82e-ae07af8ee59f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:39.751519 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2710ce2b-3dff-468a-a82e-ae07af8ee59f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:39.751952 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2710ce2b-3dff-468a-a82e-ae07af8ee59f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:39.781617 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-2710ce2b-3dff-468a-a82e-ae07af8ee59f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042597 Aug 25 05:37:39.782127 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 391/808] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:39 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:37:40.793461 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7c0e0484-6096-447e-84a0-a605df14301f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:40.794384 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-7c0e0484-6096-447e-84a0-a605df14301f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:40.800976 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7c0e0484-6096-447e-84a0-a605df14301f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:40.801409 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7c0e0484-6096-447e-84a0-a605df14301f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:40.802890 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7c0e0484-6096-447e-84a0-a605df14301f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:40.803498 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7c0e0484-6096-447e-84a0-a605df14301f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:40.834365 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-7c0e0484-6096-447e-84a0-a605df14301f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044638 Aug 25 05:37:40.834947 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 418/809] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:40 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:37:41.846128 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-96c59b37-f7aa-4097-ac28-f099ed84e5df tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:41.846942 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-96c59b37-f7aa-4097-ac28-f099ed84e5df tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:41.852771 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-96c59b37-f7aa-4097-ac28-f099ed84e5df tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:41.853212 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-96c59b37-f7aa-4097-ac28-f099ed84e5df tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:41.854005 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-96c59b37-f7aa-4097-ac28-f099ed84e5df tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:41.854437 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-96c59b37-f7aa-4097-ac28-f099ed84e5df tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:41.884089 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-96c59b37-f7aa-4097-ac28-f099ed84e5df tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041827 Aug 25 05:37:41.884640 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 392/810] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:41 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:37:42.896507 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-da0e4209-2212-4aad-9e5f-3fcf8bc8a9e7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:42.897357 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-da0e4209-2212-4aad-9e5f-3fcf8bc8a9e7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:42.903198 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-da0e4209-2212-4aad-9e5f-3fcf8bc8a9e7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:42.903634 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-da0e4209-2212-4aad-9e5f-3fcf8bc8a9e7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:42.904390 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-da0e4209-2212-4aad-9e5f-3fcf8bc8a9e7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:42.904822 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-da0e4209-2212-4aad-9e5f-3fcf8bc8a9e7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:42.933198 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-da0e4209-2212-4aad-9e5f-3fcf8bc8a9e7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040523 Aug 25 05:37:42.933779 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 419/811] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:42 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:37:43.143876 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 05:37:43.144038 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: Wed Aug 25 05:37:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 05:37:43.944780 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5be914b8-967b-4846-a24d-0594366cb5d8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:43.945723 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5be914b8-967b-4846-a24d-0594366cb5d8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:43.951552 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5be914b8-967b-4846-a24d-0594366cb5d8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:43.952013 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5be914b8-967b-4846-a24d-0594366cb5d8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:43.952755 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5be914b8-967b-4846-a24d-0594366cb5d8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:43.953819 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5be914b8-967b-4846-a24d-0594366cb5d8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:43.982585 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5be914b8-967b-4846-a24d-0594366cb5d8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041588 Aug 25 05:37:43.983136 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 393/812] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:43 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:37:44.994447 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-02c5befe-1394-47f2-877a-961f23d30344 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:44.995274 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-02c5befe-1394-47f2-877a-961f23d30344 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:45.001511 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-02c5befe-1394-47f2-877a-961f23d30344 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:45.001981 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-02c5befe-1394-47f2-877a-961f23d30344 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:45.002752 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-02c5befe-1394-47f2-877a-961f23d30344 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:45.003188 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-02c5befe-1394-47f2-877a-961f23d30344 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:45.032513 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-02c5befe-1394-47f2-877a-961f23d30344 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041072 Aug 25 05:37:45.033066 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 420/813] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:44 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:37:46.044121 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-de2f8c52-e2c1-4f49-ba6a-719181272803 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:46.045026 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-de2f8c52-e2c1-4f49-ba6a-719181272803 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:46.051281 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-de2f8c52-e2c1-4f49-ba6a-719181272803 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:46.051734 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-de2f8c52-e2c1-4f49-ba6a-719181272803 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:46.052513 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-de2f8c52-e2c1-4f49-ba6a-719181272803 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:46.052954 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-de2f8c52-e2c1-4f49-ba6a-719181272803 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:46.089630 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-de2f8c52-e2c1-4f49-ba6a-719181272803 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049240 Aug 25 05:37:46.090213 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 394/814] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:46 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:37:47.102558 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-0f9ff0dc-1378-4d88-9ae2-0e101193019b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:47.103462 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-0f9ff0dc-1378-4d88-9ae2-0e101193019b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:47.109927 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0f9ff0dc-1378-4d88-9ae2-0e101193019b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:47.110518 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0f9ff0dc-1378-4d88-9ae2-0e101193019b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:47.111301 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0f9ff0dc-1378-4d88-9ae2-0e101193019b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:47.111734 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0f9ff0dc-1378-4d88-9ae2-0e101193019b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:47.143395 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-0f9ff0dc-1378-4d88-9ae2-0e101193019b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045226 Aug 25 05:37:47.143968 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 421/815] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:47 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:37:48.158281 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-49785190-809e-42f6-8bd5-a4d461fe9e08 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:48.159126 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-49785190-809e-42f6-8bd5-a4d461fe9e08 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:48.165096 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-49785190-809e-42f6-8bd5-a4d461fe9e08 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:48.165548 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-49785190-809e-42f6-8bd5-a4d461fe9e08 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:48.166332 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-49785190-809e-42f6-8bd5-a4d461fe9e08 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:48.166755 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-49785190-809e-42f6-8bd5-a4d461fe9e08 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:48.196863 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-49785190-809e-42f6-8bd5-a4d461fe9e08 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045457 Aug 25 05:37:48.197633 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 395/816] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:48 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:37:49.208652 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b7dca17a-1719-48d7-9e9c-58f9e7600433 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:49.209570 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b7dca17a-1719-48d7-9e9c-58f9e7600433 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:49.217244 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b7dca17a-1719-48d7-9e9c-58f9e7600433 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:49.217763 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b7dca17a-1719-48d7-9e9c-58f9e7600433 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:49.218575 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b7dca17a-1719-48d7-9e9c-58f9e7600433 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:49.219114 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b7dca17a-1719-48d7-9e9c-58f9e7600433 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:49.249825 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b7dca17a-1719-48d7-9e9c-58f9e7600433 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045004 Aug 25 05:37:49.251096 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 422/817] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:49 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:37:50.261820 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c5ac37c4-b712-4a87-a1ce-951a0b286ded tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:50.266414 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c5ac37c4-b712-4a87-a1ce-951a0b286ded tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:50.273724 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c5ac37c4-b712-4a87-a1ce-951a0b286ded tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:50.274171 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c5ac37c4-b712-4a87-a1ce-951a0b286ded tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:50.274936 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c5ac37c4-b712-4a87-a1ce-951a0b286ded tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:50.275368 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c5ac37c4-b712-4a87-a1ce-951a0b286ded tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:50.305717 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c5ac37c4-b712-4a87-a1ce-951a0b286ded tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047751 Aug 25 05:37:50.306275 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 396/818] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:50 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:37:51.317948 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e38a6e49-a6ac-4d31-87d1-04caa72e3117 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:51.318952 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e38a6e49-a6ac-4d31-87d1-04caa72e3117 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:51.325304 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e38a6e49-a6ac-4d31-87d1-04caa72e3117 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:51.326076 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e38a6e49-a6ac-4d31-87d1-04caa72e3117 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:51.326935 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e38a6e49-a6ac-4d31-87d1-04caa72e3117 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:51.327079 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e38a6e49-a6ac-4d31-87d1-04caa72e3117 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:51.355375 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e38a6e49-a6ac-4d31-87d1-04caa72e3117 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042385 Aug 25 05:37:51.355902 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 423/819] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:51 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:37:52.367166 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8b2af0fd-db61-40fd-90ca-be765e304f3f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:52.368072 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8b2af0fd-db61-40fd-90ca-be765e304f3f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:52.374102 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8b2af0fd-db61-40fd-90ca-be765e304f3f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:52.374544 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8b2af0fd-db61-40fd-90ca-be765e304f3f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:52.375310 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8b2af0fd-db61-40fd-90ca-be765e304f3f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:52.375746 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8b2af0fd-db61-40fd-90ca-be765e304f3f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:52.406283 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8b2af0fd-db61-40fd-90ca-be765e304f3f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042869 Aug 25 05:37:52.407091 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 397/820] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:52 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:37:53.418367 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6e799023-61ab-49f3-a31a-656bd9a427d7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:53.419264 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6e799023-61ab-49f3-a31a-656bd9a427d7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:53.425675 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6e799023-61ab-49f3-a31a-656bd9a427d7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:53.426119 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6e799023-61ab-49f3-a31a-656bd9a427d7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:53.426904 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6e799023-61ab-49f3-a31a-656bd9a427d7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:53.427346 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6e799023-61ab-49f3-a31a-656bd9a427d7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:53.459234 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6e799023-61ab-49f3-a31a-656bd9a427d7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044589 Aug 25 05:37:53.459802 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 424/821] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:53 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:37:54.470870 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a8337a6c-e85a-4574-aea5-95caa5aaf48c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:54.471990 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a8337a6c-e85a-4574-aea5-95caa5aaf48c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:54.477979 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a8337a6c-e85a-4574-aea5-95caa5aaf48c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:54.478428 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a8337a6c-e85a-4574-aea5-95caa5aaf48c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:54.479202 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a8337a6c-e85a-4574-aea5-95caa5aaf48c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:54.479640 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a8337a6c-e85a-4574-aea5-95caa5aaf48c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:54.509158 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a8337a6c-e85a-4574-aea5-95caa5aaf48c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042907 Aug 25 05:37:54.509757 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 398/822] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:54 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:37:55.520603 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-46621510-a8c8-446d-a5a2-66c8a4939886 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:55.521738 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-46621510-a8c8-446d-a5a2-66c8a4939886 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:55.527665 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-46621510-a8c8-446d-a5a2-66c8a4939886 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:55.528102 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-46621510-a8c8-446d-a5a2-66c8a4939886 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:55.528914 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-46621510-a8c8-446d-a5a2-66c8a4939886 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:55.531396 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-46621510-a8c8-446d-a5a2-66c8a4939886 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:55.567861 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-46621510-a8c8-446d-a5a2-66c8a4939886 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050960 Aug 25 05:37:55.568343 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 425/823] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:55 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:37:56.579220 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1916f3f3-4c34-4a0e-925f-3c619cd9f65b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:56.580439 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1916f3f3-4c34-4a0e-925f-3c619cd9f65b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:56.586381 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1916f3f3-4c34-4a0e-925f-3c619cd9f65b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:56.586827 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1916f3f3-4c34-4a0e-925f-3c619cd9f65b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:56.587682 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1916f3f3-4c34-4a0e-925f-3c619cd9f65b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:56.588114 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1916f3f3-4c34-4a0e-925f-3c619cd9f65b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:56.616997 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1916f3f3-4c34-4a0e-925f-3c619cd9f65b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041625 Aug 25 05:37:56.617565 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 399/824] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:56 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:37:57.629964 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ba3ac997-90e7-4f42-81f1-57e6a9f96e16 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:57.630783 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ba3ac997-90e7-4f42-81f1-57e6a9f96e16 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:57.636652 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ba3ac997-90e7-4f42-81f1-57e6a9f96e16 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:57.637099 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ba3ac997-90e7-4f42-81f1-57e6a9f96e16 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:57.637899 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ba3ac997-90e7-4f42-81f1-57e6a9f96e16 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:57.638397 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ba3ac997-90e7-4f42-81f1-57e6a9f96e16 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:57.671375 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ba3ac997-90e7-4f42-81f1-57e6a9f96e16 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045990 Aug 25 05:37:57.671925 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 426/825] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:57 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:37:58.683166 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-2ffa190f-29fc-45b2-aa36-f862a5875693 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:58.684065 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-2ffa190f-29fc-45b2-aa36-f862a5875693 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:58.690365 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2ffa190f-29fc-45b2-aa36-f862a5875693 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:58.690922 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2ffa190f-29fc-45b2-aa36-f862a5875693 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:58.691674 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2ffa190f-29fc-45b2-aa36-f862a5875693 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:58.692106 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2ffa190f-29fc-45b2-aa36-f862a5875693 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:58.723259 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-2ffa190f-29fc-45b2-aa36-f862a5875693 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043839 Aug 25 05:37:58.723820 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 400/826] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:58 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:37:59.734739 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-32c6038c-af8a-444b-90cc-9edf51280c3d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:37:59.735550 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-32c6038c-af8a-444b-90cc-9edf51280c3d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:37:59.742036 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-32c6038c-af8a-444b-90cc-9edf51280c3d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:59.742489 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-32c6038c-af8a-444b-90cc-9edf51280c3d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:59.743235 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-32c6038c-af8a-444b-90cc-9edf51280c3d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:37:59.743666 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-32c6038c-af8a-444b-90cc-9edf51280c3d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:37:59.772179 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-32c6038c-af8a-444b-90cc-9edf51280c3d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041354 Aug 25 05:37:59.772717 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 427/827] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:37:59 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:00.783935 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-55d9238b-2eb9-4042-8025-1eebece3e0e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:00.785013 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-55d9238b-2eb9-4042-8025-1eebece3e0e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:00.790914 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-55d9238b-2eb9-4042-8025-1eebece3e0e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:00.791298 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-55d9238b-2eb9-4042-8025-1eebece3e0e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:00.792059 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-55d9238b-2eb9-4042-8025-1eebece3e0e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:00.792488 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-55d9238b-2eb9-4042-8025-1eebece3e0e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:00.820771 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-55d9238b-2eb9-4042-8025-1eebece3e0e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040856 Aug 25 05:38:00.821318 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 401/828] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:00 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:01.832942 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-420f59df-8971-47bc-972a-ae763c960330 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:01.833925 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-420f59df-8971-47bc-972a-ae763c960330 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:01.839759 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-420f59df-8971-47bc-972a-ae763c960330 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:01.840201 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-420f59df-8971-47bc-972a-ae763c960330 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:01.840968 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-420f59df-8971-47bc-972a-ae763c960330 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:01.841401 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-420f59df-8971-47bc-972a-ae763c960330 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:01.871164 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-420f59df-8971-47bc-972a-ae763c960330 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042663 Aug 25 05:38:01.871728 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 428/829] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:01 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:02.883444 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-715765e2-f72b-4234-bc4f-658ad0dd6a17 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:02.884332 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-715765e2-f72b-4234-bc4f-658ad0dd6a17 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:02.893241 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-715765e2-f72b-4234-bc4f-658ad0dd6a17 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:02.893241 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-715765e2-f72b-4234-bc4f-658ad0dd6a17 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:02.893241 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-715765e2-f72b-4234-bc4f-658ad0dd6a17 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:02.893241 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-715765e2-f72b-4234-bc4f-658ad0dd6a17 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:02.922286 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-715765e2-f72b-4234-bc4f-658ad0dd6a17 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043299 Aug 25 05:38:02.922854 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 402/830] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:02 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:03.934284 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-4110c4ac-ef4c-41f7-b353-9d2cc8575432 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:03.935105 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-4110c4ac-ef4c-41f7-b353-9d2cc8575432 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:03.940948 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4110c4ac-ef4c-41f7-b353-9d2cc8575432 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:03.941389 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4110c4ac-ef4c-41f7-b353-9d2cc8575432 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:03.942230 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4110c4ac-ef4c-41f7-b353-9d2cc8575432 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:03.942666 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4110c4ac-ef4c-41f7-b353-9d2cc8575432 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:03.971027 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-4110c4ac-ef4c-41f7-b353-9d2cc8575432 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040645 Aug 25 05:38:03.971568 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 429/831] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:03 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:04.983578 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ba049606-8362-4892-b510-ea784480d29f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:04.984419 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ba049606-8362-4892-b510-ea784480d29f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:04.990867 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ba049606-8362-4892-b510-ea784480d29f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:04.991297 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ba049606-8362-4892-b510-ea784480d29f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:04.992046 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ba049606-8362-4892-b510-ea784480d29f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:04.992472 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ba049606-8362-4892-b510-ea784480d29f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:05.020419 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ba049606-8362-4892-b510-ea784480d29f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040886 Aug 25 05:38:05.020961 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 403/832] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:04 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:06.032216 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-36b6209f-735b-4298-a1bf-37b41bfadda1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:06.033114 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-36b6209f-735b-4298-a1bf-37b41bfadda1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:06.039826 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-36b6209f-735b-4298-a1bf-37b41bfadda1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:06.040267 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-36b6209f-735b-4298-a1bf-37b41bfadda1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:06.041025 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-36b6209f-735b-4298-a1bf-37b41bfadda1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:06.041453 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-36b6209f-735b-4298-a1bf-37b41bfadda1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:06.069796 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-36b6209f-735b-4298-a1bf-37b41bfadda1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041531 Aug 25 05:38:06.070342 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 430/833] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:06 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:07.081145 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-249feb4e-ebe4-4f8f-933c-c5363777994a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:07.082068 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-249feb4e-ebe4-4f8f-933c-c5363777994a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:07.088031 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-249feb4e-ebe4-4f8f-933c-c5363777994a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:07.088473 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-249feb4e-ebe4-4f8f-933c-c5363777994a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:07.089223 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-249feb4e-ebe4-4f8f-933c-c5363777994a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:07.089751 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-249feb4e-ebe4-4f8f-933c-c5363777994a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:07.117894 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-249feb4e-ebe4-4f8f-933c-c5363777994a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040581 Aug 25 05:38:07.118439 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 404/834] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:07 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:08.129708 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-02b95c59-5767-4469-b481-7efbb7a693e8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:08.130640 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-02b95c59-5767-4469-b481-7efbb7a693e8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:08.136422 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-02b95c59-5767-4469-b481-7efbb7a693e8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:08.136860 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-02b95c59-5767-4469-b481-7efbb7a693e8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:08.137650 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-02b95c59-5767-4469-b481-7efbb7a693e8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:08.138081 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-02b95c59-5767-4469-b481-7efbb7a693e8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:08.167341 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-02b95c59-5767-4469-b481-7efbb7a693e8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041672 Aug 25 05:38:08.167903 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 431/835] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:08 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:09.178221 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-9af925e1-bc8d-4052-a030-11910bda9700 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:09.179258 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-9af925e1-bc8d-4052-a030-11910bda9700 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:09.185067 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9af925e1-bc8d-4052-a030-11910bda9700 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:09.185509 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9af925e1-bc8d-4052-a030-11910bda9700 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:09.186285 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9af925e1-bc8d-4052-a030-11910bda9700 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:09.186710 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9af925e1-bc8d-4052-a030-11910bda9700 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:09.217804 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-9af925e1-bc8d-4052-a030-11910bda9700 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043374 Aug 25 05:38:09.218374 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 405/836] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:09 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:10.229774 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7508397d-954b-4bae-901b-bab2a2a539bc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:10.230668 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-7508397d-954b-4bae-901b-bab2a2a539bc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:10.236478 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7508397d-954b-4bae-901b-bab2a2a539bc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:10.236922 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7508397d-954b-4bae-901b-bab2a2a539bc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:10.237714 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7508397d-954b-4bae-901b-bab2a2a539bc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:10.238859 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7508397d-954b-4bae-901b-bab2a2a539bc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:10.267493 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-7508397d-954b-4bae-901b-bab2a2a539bc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041590 Aug 25 05:38:10.268046 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 432/837] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:10 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:11.280690 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-49190130-b7ac-4e76-96ce-213a07b6ae64 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:11.281888 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-49190130-b7ac-4e76-96ce-213a07b6ae64 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:11.288271 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-49190130-b7ac-4e76-96ce-213a07b6ae64 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:11.288719 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-49190130-b7ac-4e76-96ce-213a07b6ae64 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:11.289496 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-49190130-b7ac-4e76-96ce-213a07b6ae64 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:11.290023 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-49190130-b7ac-4e76-96ce-213a07b6ae64 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:11.322111 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-49190130-b7ac-4e76-96ce-213a07b6ae64 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045126 Aug 25 05:38:11.322691 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 406/838] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:11 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:12.334266 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1e97e4fc-7886-4302-af48-a652910f8896 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:12.335164 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1e97e4fc-7886-4302-af48-a652910f8896 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:12.341011 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1e97e4fc-7886-4302-af48-a652910f8896 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:12.341454 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1e97e4fc-7886-4302-af48-a652910f8896 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:12.342237 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1e97e4fc-7886-4302-af48-a652910f8896 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:12.342668 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1e97e4fc-7886-4302-af48-a652910f8896 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:12.371982 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1e97e4fc-7886-4302-af48-a652910f8896 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041770 Aug 25 05:38:12.372620 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 433/839] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:12 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:13.383960 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-28de820c-faea-4723-bf41-a5c4503bfa13 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:13.384868 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-28de820c-faea-4723-bf41-a5c4503bfa13 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:13.390871 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-28de820c-faea-4723-bf41-a5c4503bfa13 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:13.391322 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-28de820c-faea-4723-bf41-a5c4503bfa13 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:13.392143 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-28de820c-faea-4723-bf41-a5c4503bfa13 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:13.392568 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-28de820c-faea-4723-bf41-a5c4503bfa13 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:13.423803 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-28de820c-faea-4723-bf41-a5c4503bfa13 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044267 Aug 25 05:38:13.424376 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 407/840] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:13 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:14.435107 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-269b2ae0-e696-42c0-a019-650717b3f5ac tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:14.435990 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-269b2ae0-e696-42c0-a019-650717b3f5ac tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:14.442317 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-269b2ae0-e696-42c0-a019-650717b3f5ac tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:14.443059 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-269b2ae0-e696-42c0-a019-650717b3f5ac tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:14.444336 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-269b2ae0-e696-42c0-a019-650717b3f5ac tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:14.445057 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-269b2ae0-e696-42c0-a019-650717b3f5ac tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:14.482713 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-269b2ae0-e696-42c0-a019-650717b3f5ac tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051237 Aug 25 05:38:14.483286 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 434/841] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:14 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:15.494341 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ddcf0a30-db42-446d-bfd7-be4d93040568 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:15.495234 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ddcf0a30-db42-446d-bfd7-be4d93040568 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:15.501059 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ddcf0a30-db42-446d-bfd7-be4d93040568 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:15.501496 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ddcf0a30-db42-446d-bfd7-be4d93040568 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:15.502269 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ddcf0a30-db42-446d-bfd7-be4d93040568 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:15.502696 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ddcf0a30-db42-446d-bfd7-be4d93040568 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:15.531328 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ddcf0a30-db42-446d-bfd7-be4d93040568 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040498 Aug 25 05:38:15.531892 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 408/842] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:15 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:16.542679 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-39c63c9d-1b85-449c-821f-40ae9778ca0b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:16.543585 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-39c63c9d-1b85-449c-821f-40ae9778ca0b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:16.549428 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-39c63c9d-1b85-449c-821f-40ae9778ca0b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:16.549922 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-39c63c9d-1b85-449c-821f-40ae9778ca0b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:16.550693 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-39c63c9d-1b85-449c-821f-40ae9778ca0b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:16.551128 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-39c63c9d-1b85-449c-821f-40ae9778ca0b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:16.580023 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-39c63c9d-1b85-449c-821f-40ae9778ca0b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041123 Aug 25 05:38:16.580573 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 435/843] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:16 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:17.592281 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6a8963d8-435c-4ffb-9969-527ecde4b85c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:17.593092 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6a8963d8-435c-4ffb-9969-527ecde4b85c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:17.599063 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6a8963d8-435c-4ffb-9969-527ecde4b85c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:17.599500 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6a8963d8-435c-4ffb-9969-527ecde4b85c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:17.600248 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6a8963d8-435c-4ffb-9969-527ecde4b85c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:17.600673 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6a8963d8-435c-4ffb-9969-527ecde4b85c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:17.628687 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6a8963d8-435c-4ffb-9969-527ecde4b85c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040237 Aug 25 05:38:17.629218 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 409/844] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:17 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:18.640458 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-dcfab010-a7d1-420c-888b-c88ec6ee54e8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:18.641373 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-dcfab010-a7d1-420c-888b-c88ec6ee54e8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:18.647624 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-dcfab010-a7d1-420c-888b-c88ec6ee54e8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:18.648057 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-dcfab010-a7d1-420c-888b-c88ec6ee54e8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:18.648806 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-dcfab010-a7d1-420c-888b-c88ec6ee54e8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:18.649230 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-dcfab010-a7d1-420c-888b-c88ec6ee54e8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:18.677918 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-dcfab010-a7d1-420c-888b-c88ec6ee54e8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041209 Aug 25 05:38:18.678452 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 436/845] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:18 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:19.689590 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-452d759d-8efc-4f50-a500-145ebd9520e9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:19.690396 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-452d759d-8efc-4f50-a500-145ebd9520e9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:19.696880 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-452d759d-8efc-4f50-a500-145ebd9520e9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:19.697357 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-452d759d-8efc-4f50-a500-145ebd9520e9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:19.698150 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-452d759d-8efc-4f50-a500-145ebd9520e9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:19.698580 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-452d759d-8efc-4f50-a500-145ebd9520e9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:19.727302 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-452d759d-8efc-4f50-a500-145ebd9520e9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041575 Aug 25 05:38:19.727860 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 410/846] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:19 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:20.743139 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c1803493-9d54-4529-ac91-29fc24402f54 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:20.744559 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c1803493-9d54-4529-ac91-29fc24402f54 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:20.754663 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c1803493-9d54-4529-ac91-29fc24402f54 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:20.755436 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c1803493-9d54-4529-ac91-29fc24402f54 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:20.756801 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c1803493-9d54-4529-ac91-29fc24402f54 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:20.757521 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c1803493-9d54-4529-ac91-29fc24402f54 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:20.800615 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c1803493-9d54-4529-ac91-29fc24402f54 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063942 Aug 25 05:38:20.801123 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 437/847] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:20 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:21.812570 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-60eb43c8-3161-4b1f-8659-7d16214fef01 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:21.813391 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-60eb43c8-3161-4b1f-8659-7d16214fef01 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:21.819757 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-60eb43c8-3161-4b1f-8659-7d16214fef01 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:21.820201 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-60eb43c8-3161-4b1f-8659-7d16214fef01 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:21.820955 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-60eb43c8-3161-4b1f-8659-7d16214fef01 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:21.821386 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-60eb43c8-3161-4b1f-8659-7d16214fef01 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:21.850995 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-60eb43c8-3161-4b1f-8659-7d16214fef01 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042320 Aug 25 05:38:21.851532 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 411/848] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:21 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:22.862593 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-36926eab-1c61-4552-8f97-521615cffb8a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:22.863509 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-36926eab-1c61-4552-8f97-521615cffb8a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:22.871734 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-36926eab-1c61-4552-8f97-521615cffb8a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:22.872271 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-36926eab-1c61-4552-8f97-521615cffb8a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:22.873048 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-36926eab-1c61-4552-8f97-521615cffb8a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:22.873760 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-36926eab-1c61-4552-8f97-521615cffb8a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:22.906163 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-36926eab-1c61-4552-8f97-521615cffb8a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046838 Aug 25 05:38:22.906985 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 438/849] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:22 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:23.919548 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-cb234a53-33b2-412d-8cc7-2bbb3eb85fde tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:23.920356 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-cb234a53-33b2-412d-8cc7-2bbb3eb85fde tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:23.926803 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cb234a53-33b2-412d-8cc7-2bbb3eb85fde tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:23.927246 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cb234a53-33b2-412d-8cc7-2bbb3eb85fde tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:23.928007 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cb234a53-33b2-412d-8cc7-2bbb3eb85fde tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:23.928430 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cb234a53-33b2-412d-8cc7-2bbb3eb85fde tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:23.956776 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-cb234a53-33b2-412d-8cc7-2bbb3eb85fde tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041167 Aug 25 05:38:23.957865 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 412/850] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:23 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:24.968976 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e3bfdc28-de51-48ee-9efd-76a5226bf4c6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:24.969894 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e3bfdc28-de51-48ee-9efd-76a5226bf4c6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:24.976048 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e3bfdc28-de51-48ee-9efd-76a5226bf4c6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:24.976484 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e3bfdc28-de51-48ee-9efd-76a5226bf4c6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:24.977233 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e3bfdc28-de51-48ee-9efd-76a5226bf4c6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:24.977697 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e3bfdc28-de51-48ee-9efd-76a5226bf4c6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:25.006655 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e3bfdc28-de51-48ee-9efd-76a5226bf4c6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041453 Aug 25 05:38:25.007182 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 439/851] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:24 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:26.018381 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-73eebae0-89e7-4075-930a-3c1f037d9176 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:26.019507 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-73eebae0-89e7-4075-930a-3c1f037d9176 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:26.027172 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-73eebae0-89e7-4075-930a-3c1f037d9176 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:26.027660 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-73eebae0-89e7-4075-930a-3c1f037d9176 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:26.028465 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-73eebae0-89e7-4075-930a-3c1f037d9176 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:26.028943 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-73eebae0-89e7-4075-930a-3c1f037d9176 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:26.058646 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-73eebae0-89e7-4075-930a-3c1f037d9176 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044148 Aug 25 05:38:26.059201 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 413/852] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:26 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:38:27.070855 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-36085453-ba00-4ece-9d93-382f3183afe5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:27.071761 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-36085453-ba00-4ece-9d93-382f3183afe5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:27.078463 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-36085453-ba00-4ece-9d93-382f3183afe5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:27.078908 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-36085453-ba00-4ece-9d93-382f3183afe5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:27.079936 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-36085453-ba00-4ece-9d93-382f3183afe5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:27.080515 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-36085453-ba00-4ece-9d93-382f3183afe5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:27.110289 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-36085453-ba00-4ece-9d93-382f3183afe5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043244 Aug 25 05:38:27.110289 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 440/853] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:27 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:38:28.122616 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-82d68fe5-fe52-441c-a64d-a1cbd43ab446 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:28.123507 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-82d68fe5-fe52-441c-a64d-a1cbd43ab446 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:28.129791 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-82d68fe5-fe52-441c-a64d-a1cbd43ab446 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:28.130235 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-82d68fe5-fe52-441c-a64d-a1cbd43ab446 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:28.130991 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-82d68fe5-fe52-441c-a64d-a1cbd43ab446 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:28.131423 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-82d68fe5-fe52-441c-a64d-a1cbd43ab446 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:28.160450 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-82d68fe5-fe52-441c-a64d-a1cbd43ab446 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041694 Aug 25 05:38:28.161005 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 414/854] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:28 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:29.172228 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c1aecbf8-63d2-4662-bac9-7d63baf80a3b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:29.173042 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c1aecbf8-63d2-4662-bac9-7d63baf80a3b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:29.178990 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c1aecbf8-63d2-4662-bac9-7d63baf80a3b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:29.179432 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c1aecbf8-63d2-4662-bac9-7d63baf80a3b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:29.180261 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c1aecbf8-63d2-4662-bac9-7d63baf80a3b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:29.180750 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c1aecbf8-63d2-4662-bac9-7d63baf80a3b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:29.210765 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c1aecbf8-63d2-4662-bac9-7d63baf80a3b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042340 Aug 25 05:38:29.211313 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 441/855] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:29 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:30.222230 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-f2deec16-1839-4f97-b58b-e7f75c62228f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:30.223481 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-f2deec16-1839-4f97-b58b-e7f75c62228f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:30.229326 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f2deec16-1839-4f97-b58b-e7f75c62228f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:30.229801 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f2deec16-1839-4f97-b58b-e7f75c62228f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:30.230563 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f2deec16-1839-4f97-b58b-e7f75c62228f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:30.230991 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f2deec16-1839-4f97-b58b-e7f75c62228f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:30.260768 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-f2deec16-1839-4f97-b58b-e7f75c62228f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042407 Aug 25 05:38:30.261321 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 415/856] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:30 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:31.273798 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1480f78f-469e-4137-91fe-428619e8e16d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:31.275064 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1480f78f-469e-4137-91fe-428619e8e16d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:31.281162 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1480f78f-469e-4137-91fe-428619e8e16d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:31.281632 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1480f78f-469e-4137-91fe-428619e8e16d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:31.282404 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1480f78f-469e-4137-91fe-428619e8e16d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:31.282883 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1480f78f-469e-4137-91fe-428619e8e16d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:31.318051 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1480f78f-469e-4137-91fe-428619e8e16d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048174 Aug 25 05:38:31.318890 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 442/857] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:31 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:32.329033 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c38c84ac-0b5d-4621-b72f-a94556799f28 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:32.329970 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c38c84ac-0b5d-4621-b72f-a94556799f28 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:32.333055 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4945947b-868a-4594-a167-64b475d876a3] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 25 05:38:32.337767 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c38c84ac-0b5d-4621-b72f-a94556799f28 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:32.338213 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c38c84ac-0b5d-4621-b72f-a94556799f28 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:32.338983 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c38c84ac-0b5d-4621-b72f-a94556799f28 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:32.339427 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c38c84ac-0b5d-4621-b72f-a94556799f28 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:32.368971 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c38c84ac-0b5d-4621-b72f-a94556799f28 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043769 Aug 25 05:38:32.369641 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 416/858] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:32 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:33.379896 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5a5df58b-38c1-4999-9df8-bc234be140c3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:33.380918 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5a5df58b-38c1-4999-9df8-bc234be140c3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:33.386740 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5a5df58b-38c1-4999-9df8-bc234be140c3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:33.388286 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5a5df58b-38c1-4999-9df8-bc234be140c3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:33.388286 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5a5df58b-38c1-4999-9df8-bc234be140c3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:33.388649 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5a5df58b-38c1-4999-9df8-bc234be140c3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:33.418608 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5a5df58b-38c1-4999-9df8-bc234be140c3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042643 Aug 25 05:38:33.419162 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 443/859] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:33 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:34.431306 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3ef4fd22-fa59-4f32-9032-731666693431 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:34.432207 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3ef4fd22-fa59-4f32-9032-731666693431 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:34.449563 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3ef4fd22-fa59-4f32-9032-731666693431 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:34.449999 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3ef4fd22-fa59-4f32-9032-731666693431 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:34.450778 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3ef4fd22-fa59-4f32-9032-731666693431 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:34.451207 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3ef4fd22-fa59-4f32-9032-731666693431 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:34.455948 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [-] [4945947b-868a-4594-a167-64b475d876a3] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 34126. Aug 25 05:38:34.482927 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3ef4fd22-fa59-4f32-9032-731666693431 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055854 Aug 25 05:38:34.483473 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 417/860] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:34 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:35.497357 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-21feeaf5-7257-4d5c-be6f-b931aa26534d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:35.498327 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-21feeaf5-7257-4d5c-be6f-b931aa26534d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:35.504865 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-21feeaf5-7257-4d5c-be6f-b931aa26534d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:35.505332 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-21feeaf5-7257-4d5c-be6f-b931aa26534d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:35.506122 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-21feeaf5-7257-4d5c-be6f-b931aa26534d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:35.506543 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-21feeaf5-7257-4d5c-be6f-b931aa26534d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:35.542770 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-21feeaf5-7257-4d5c-be6f-b931aa26534d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051560 Aug 25 05:38:35.543352 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 444/861] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:35 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:36.555046 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-675d7df3-2f2e-4556-85a9-4def205dad96 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:36.556193 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-675d7df3-2f2e-4556-85a9-4def205dad96 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:36.561966 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-675d7df3-2f2e-4556-85a9-4def205dad96 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:36.562419 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-675d7df3-2f2e-4556-85a9-4def205dad96 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:36.563184 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-675d7df3-2f2e-4556-85a9-4def205dad96 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:36.563623 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-675d7df3-2f2e-4556-85a9-4def205dad96 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:36.602336 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-675d7df3-2f2e-4556-85a9-4def205dad96 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051562 Aug 25 05:38:36.602902 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 418/862] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:36 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:37.614553 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c92c5762-c091-48d0-a6bb-ed1cdf785a12 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:37.615352 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c92c5762-c091-48d0-a6bb-ed1cdf785a12 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:37.621775 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c92c5762-c091-48d0-a6bb-ed1cdf785a12 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:37.622224 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c92c5762-c091-48d0-a6bb-ed1cdf785a12 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:37.623003 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c92c5762-c091-48d0-a6bb-ed1cdf785a12 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:37.623440 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c92c5762-c091-48d0-a6bb-ed1cdf785a12 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:37.654784 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c92c5762-c091-48d0-a6bb-ed1cdf785a12 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044291 Aug 25 05:38:37.655042 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 445/863] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:37 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:38.668110 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c49fbba3-d43e-4bdb-863d-44a40ec07ee3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:38.669018 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c49fbba3-d43e-4bdb-863d-44a40ec07ee3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:38.675109 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c49fbba3-d43e-4bdb-863d-44a40ec07ee3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:38.675556 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c49fbba3-d43e-4bdb-863d-44a40ec07ee3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:38.676468 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c49fbba3-d43e-4bdb-863d-44a40ec07ee3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:38.676939 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c49fbba3-d43e-4bdb-863d-44a40ec07ee3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:38.710504 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c49fbba3-d43e-4bdb-863d-44a40ec07ee3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045937 Aug 25 05:38:38.711437 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 419/864] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:38 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:38:39.724227 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-3ca803a1-926c-423a-aaaa-ddae5659f06b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:39.725161 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-3ca803a1-926c-423a-aaaa-ddae5659f06b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:39.731297 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3ca803a1-926c-423a-aaaa-ddae5659f06b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:39.731737 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3ca803a1-926c-423a-aaaa-ddae5659f06b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:39.732491 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3ca803a1-926c-423a-aaaa-ddae5659f06b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:39.733399 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3ca803a1-926c-423a-aaaa-ddae5659f06b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:39.762957 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-3ca803a1-926c-423a-aaaa-ddae5659f06b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042807 Aug 25 05:38:39.763503 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 446/865] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:39 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:40.774980 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-67478259-9266-472b-a2a7-d20bbf531731 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:40.775920 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-67478259-9266-472b-a2a7-d20bbf531731 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:40.782116 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-67478259-9266-472b-a2a7-d20bbf531731 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:40.782557 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-67478259-9266-472b-a2a7-d20bbf531731 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:40.783340 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-67478259-9266-472b-a2a7-d20bbf531731 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:40.783747 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-67478259-9266-472b-a2a7-d20bbf531731 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:40.813866 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-67478259-9266-472b-a2a7-d20bbf531731 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042543 Aug 25 05:38:40.814311 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 420/866] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:40 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:38:41.826231 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-939cf5ae-62c2-4800-8b96-d829f04e3c18 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:41.827080 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-939cf5ae-62c2-4800-8b96-d829f04e3c18 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:41.833707 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-939cf5ae-62c2-4800-8b96-d829f04e3c18 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:41.834151 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-939cf5ae-62c2-4800-8b96-d829f04e3c18 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:41.834940 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-939cf5ae-62c2-4800-8b96-d829f04e3c18 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:41.835361 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-939cf5ae-62c2-4800-8b96-d829f04e3c18 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:41.864503 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-939cf5ae-62c2-4800-8b96-d829f04e3c18 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042287 Aug 25 05:38:41.865108 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 447/867] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:41 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:38:42.876075 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-934ac435-aefa-4283-81cd-b54779a005ad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:42.876971 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-934ac435-aefa-4283-81cd-b54779a005ad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:42.882921 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-934ac435-aefa-4283-81cd-b54779a005ad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:42.883354 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-934ac435-aefa-4283-81cd-b54779a005ad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:42.884111 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-934ac435-aefa-4283-81cd-b54779a005ad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:42.884537 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-934ac435-aefa-4283-81cd-b54779a005ad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:42.914123 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-934ac435-aefa-4283-81cd-b54779a005ad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041797 Aug 25 05:38:42.914682 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 421/868] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:42 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:43.926220 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-8dec9890-ee42-4512-9eeb-ca16352440c2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:43.927917 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-8dec9890-ee42-4512-9eeb-ca16352440c2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:43.933561 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8dec9890-ee42-4512-9eeb-ca16352440c2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:43.934005 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8dec9890-ee42-4512-9eeb-ca16352440c2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:43.934763 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8dec9890-ee42-4512-9eeb-ca16352440c2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:43.935189 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8dec9890-ee42-4512-9eeb-ca16352440c2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:43.964470 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-8dec9890-ee42-4512-9eeb-ca16352440c2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042091 Aug 25 05:38:43.965021 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 448/869] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:43 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:44.976479 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-84038364-898f-4575-bf75-bb6575955d85 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:44.977377 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-84038364-898f-4575-bf75-bb6575955d85 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:44.983177 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-84038364-898f-4575-bf75-bb6575955d85 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:44.983620 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-84038364-898f-4575-bf75-bb6575955d85 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:44.984377 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-84038364-898f-4575-bf75-bb6575955d85 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:44.984808 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-84038364-898f-4575-bf75-bb6575955d85 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:45.014249 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-84038364-898f-4575-bf75-bb6575955d85 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042046 Aug 25 05:38:45.014800 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 422/870] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:44 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:46.026554 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6d024eec-d574-4fa3-8c46-24433ed01a3e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:46.027368 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6d024eec-d574-4fa3-8c46-24433ed01a3e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:46.033641 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6d024eec-d574-4fa3-8c46-24433ed01a3e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:46.034153 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6d024eec-d574-4fa3-8c46-24433ed01a3e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:46.034938 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6d024eec-d574-4fa3-8c46-24433ed01a3e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:46.035377 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6d024eec-d574-4fa3-8c46-24433ed01a3e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:46.069356 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6d024eec-d574-4fa3-8c46-24433ed01a3e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047665 Aug 25 05:38:46.074688 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 449/871] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:46 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:47.084479 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e9a827be-d15a-408f-95cd-2043075fedd8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:47.085574 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e9a827be-d15a-408f-95cd-2043075fedd8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:47.091521 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e9a827be-d15a-408f-95cd-2043075fedd8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:47.091965 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e9a827be-d15a-408f-95cd-2043075fedd8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:47.092727 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e9a827be-d15a-408f-95cd-2043075fedd8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:47.093158 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e9a827be-d15a-408f-95cd-2043075fedd8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:47.123702 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e9a827be-d15a-408f-95cd-2043075fedd8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043087 Aug 25 05:38:47.127050 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 423/872] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:47 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:48.136069 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d77a8d8a-b942-480a-b7db-641cd0a4f554 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:48.136970 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d77a8d8a-b942-480a-b7db-641cd0a4f554 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:48.142863 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d77a8d8a-b942-480a-b7db-641cd0a4f554 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:48.143305 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d77a8d8a-b942-480a-b7db-641cd0a4f554 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:48.144063 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d77a8d8a-b942-480a-b7db-641cd0a4f554 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:48.144494 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d77a8d8a-b942-480a-b7db-641cd0a4f554 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:48.174311 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d77a8d8a-b942-480a-b7db-641cd0a4f554 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042722 Aug 25 05:38:48.174866 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 450/873] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:48 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:49.187650 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-07f74d3f-27a4-4be3-80bf-0471c76885ee tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:49.188749 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-07f74d3f-27a4-4be3-80bf-0471c76885ee tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:49.194540 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-07f74d3f-27a4-4be3-80bf-0471c76885ee tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:49.194998 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-07f74d3f-27a4-4be3-80bf-0471c76885ee tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:49.195903 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-07f74d3f-27a4-4be3-80bf-0471c76885ee tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:49.196351 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-07f74d3f-27a4-4be3-80bf-0471c76885ee tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:49.226088 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-07f74d3f-27a4-4be3-80bf-0471c76885ee tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042279 Aug 25 05:38:49.227373 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 424/874] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:49 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:38:50.238597 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6a8a088c-a8a4-4c02-898c-2aa79ad35d10 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:50.239471 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6a8a088c-a8a4-4c02-898c-2aa79ad35d10 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:50.245244 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6a8a088c-a8a4-4c02-898c-2aa79ad35d10 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:50.246877 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6a8a088c-a8a4-4c02-898c-2aa79ad35d10 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:50.247652 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6a8a088c-a8a4-4c02-898c-2aa79ad35d10 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:50.248093 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6a8a088c-a8a4-4c02-898c-2aa79ad35d10 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:50.276835 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6a8a088c-a8a4-4c02-898c-2aa79ad35d10 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042149 Aug 25 05:38:50.277402 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 451/875] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:50 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:51.288645 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-9f224b74-bfd0-41c7-aafb-dec33768561a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:51.289563 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-9f224b74-bfd0-41c7-aafb-dec33768561a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:51.295666 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9f224b74-bfd0-41c7-aafb-dec33768561a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:51.296115 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9f224b74-bfd0-41c7-aafb-dec33768561a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:51.296866 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9f224b74-bfd0-41c7-aafb-dec33768561a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:51.297290 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9f224b74-bfd0-41c7-aafb-dec33768561a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:51.326193 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-9f224b74-bfd0-41c7-aafb-dec33768561a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041333 Aug 25 05:38:51.327649 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 425/876] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:51 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:52.338936 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-956a0924-f2e9-44ff-afcb-781b49d13535 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:52.339797 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-956a0924-f2e9-44ff-afcb-781b49d13535 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:52.346308 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-956a0924-f2e9-44ff-afcb-781b49d13535 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:52.346741 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-956a0924-f2e9-44ff-afcb-781b49d13535 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:52.347494 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-956a0924-f2e9-44ff-afcb-781b49d13535 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:52.347920 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-956a0924-f2e9-44ff-afcb-781b49d13535 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:52.376713 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-956a0924-f2e9-44ff-afcb-781b49d13535 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041612 Aug 25 05:38:52.377278 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 452/877] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:52 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:53.387628 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-f628d230-e091-41d4-855e-57e065fa8a42 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:53.391252 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-f628d230-e091-41d4-855e-57e065fa8a42 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:53.396616 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f628d230-e091-41d4-855e-57e065fa8a42 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:53.397053 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f628d230-e091-41d4-855e-57e065fa8a42 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:53.397914 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f628d230-e091-41d4-855e-57e065fa8a42 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:53.398711 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f628d230-e091-41d4-855e-57e065fa8a42 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:53.433508 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-f628d230-e091-41d4-855e-57e065fa8a42 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049692 Aug 25 05:38:53.434087 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 426/878] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:53 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:54.444605 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-159b74a5-0ff8-41cc-ab25-2783b3a3f621 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:54.445496 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-159b74a5-0ff8-41cc-ab25-2783b3a3f621 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:54.451304 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-159b74a5-0ff8-41cc-ab25-2783b3a3f621 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:54.451742 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-159b74a5-0ff8-41cc-ab25-2783b3a3f621 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:54.452642 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-159b74a5-0ff8-41cc-ab25-2783b3a3f621 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:54.453070 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-159b74a5-0ff8-41cc-ab25-2783b3a3f621 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:54.481488 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-159b74a5-0ff8-41cc-ab25-2783b3a3f621 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040742 Aug 25 05:38:54.482061 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 453/879] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:54 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:55.494050 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6a887c75-e4f5-4c08-bfa3-b12a943c9144 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:55.494953 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6a887c75-e4f5-4c08-bfa3-b12a943c9144 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:55.501787 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6a887c75-e4f5-4c08-bfa3-b12a943c9144 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:55.502231 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6a887c75-e4f5-4c08-bfa3-b12a943c9144 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:55.502994 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6a887c75-e4f5-4c08-bfa3-b12a943c9144 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:55.503420 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6a887c75-e4f5-4c08-bfa3-b12a943c9144 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:55.533196 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6a887c75-e4f5-4c08-bfa3-b12a943c9144 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042813 Aug 25 05:38:55.533861 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 427/880] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:55 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:56.544241 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-91ec206f-2853-4d5b-9dcd-3e7e455853c3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:56.545131 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-91ec206f-2853-4d5b-9dcd-3e7e455853c3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:56.552043 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-91ec206f-2853-4d5b-9dcd-3e7e455853c3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:56.552792 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-91ec206f-2853-4d5b-9dcd-3e7e455853c3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:56.553951 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-91ec206f-2853-4d5b-9dcd-3e7e455853c3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:56.554705 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-91ec206f-2853-4d5b-9dcd-3e7e455853c3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:56.585662 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-91ec206f-2853-4d5b-9dcd-3e7e455853c3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045146 Aug 25 05:38:56.586241 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 454/881] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:56 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:57.596967 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-08a4bfa7-6e03-4996-8183-58543505d6f7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:57.597935 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-08a4bfa7-6e03-4996-8183-58543505d6f7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:57.603862 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-08a4bfa7-6e03-4996-8183-58543505d6f7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:57.604327 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-08a4bfa7-6e03-4996-8183-58543505d6f7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:57.605124 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-08a4bfa7-6e03-4996-8183-58543505d6f7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:57.605569 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-08a4bfa7-6e03-4996-8183-58543505d6f7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:57.635554 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-08a4bfa7-6e03-4996-8183-58543505d6f7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042815 Aug 25 05:38:57.636106 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 428/882] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:57 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:58.648313 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c729dae2-d8ef-47f7-8e42-9328a0ab7f09 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:58.649253 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c729dae2-d8ef-47f7-8e42-9328a0ab7f09 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:58.655396 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c729dae2-d8ef-47f7-8e42-9328a0ab7f09 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:58.655833 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c729dae2-d8ef-47f7-8e42-9328a0ab7f09 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:58.656601 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c729dae2-d8ef-47f7-8e42-9328a0ab7f09 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:58.657370 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c729dae2-d8ef-47f7-8e42-9328a0ab7f09 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:58.686935 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c729dae2-d8ef-47f7-8e42-9328a0ab7f09 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042907 Aug 25 05:38:58.687494 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 455/883] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:58 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:38:59.699006 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3d7fe53b-3f8f-43f1-a2de-b1044de742a6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:38:59.699941 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3d7fe53b-3f8f-43f1-a2de-b1044de742a6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:38:59.706740 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3d7fe53b-3f8f-43f1-a2de-b1044de742a6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:59.707185 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3d7fe53b-3f8f-43f1-a2de-b1044de742a6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:59.707952 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3d7fe53b-3f8f-43f1-a2de-b1044de742a6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:38:59.708382 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3d7fe53b-3f8f-43f1-a2de-b1044de742a6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:38:59.739293 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3d7fe53b-3f8f-43f1-a2de-b1044de742a6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044005 Aug 25 05:38:59.739854 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 429/884] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:38:59 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:00.750628 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-0e3f55c1-01d0-4df2-8b05-516224fa080e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:00.751532 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-0e3f55c1-01d0-4df2-8b05-516224fa080e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:00.757958 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0e3f55c1-01d0-4df2-8b05-516224fa080e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:00.758401 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0e3f55c1-01d0-4df2-8b05-516224fa080e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:00.759170 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0e3f55c1-01d0-4df2-8b05-516224fa080e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:00.759601 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0e3f55c1-01d0-4df2-8b05-516224fa080e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:00.790907 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-0e3f55c1-01d0-4df2-8b05-516224fa080e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043995 Aug 25 05:39:00.791379 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 456/885] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:00 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:01.803836 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ca063b0b-964b-4d29-a24b-41bdd9fde64d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:01.804734 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ca063b0b-964b-4d29-a24b-41bdd9fde64d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:01.810832 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ca063b0b-964b-4d29-a24b-41bdd9fde64d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:01.811282 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ca063b0b-964b-4d29-a24b-41bdd9fde64d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:01.812037 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ca063b0b-964b-4d29-a24b-41bdd9fde64d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:01.812466 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ca063b0b-964b-4d29-a24b-41bdd9fde64d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:01.842021 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ca063b0b-964b-4d29-a24b-41bdd9fde64d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041930 Aug 25 05:39:01.842582 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 430/886] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:01 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:02.854424 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e5f1ccc3-05f2-4f54-9db3-cea31fb7ede5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:02.855267 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e5f1ccc3-05f2-4f54-9db3-cea31fb7ede5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:02.861070 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e5f1ccc3-05f2-4f54-9db3-cea31fb7ede5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:02.861538 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e5f1ccc3-05f2-4f54-9db3-cea31fb7ede5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:02.862386 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e5f1ccc3-05f2-4f54-9db3-cea31fb7ede5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:02.862941 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e5f1ccc3-05f2-4f54-9db3-cea31fb7ede5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:02.894125 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e5f1ccc3-05f2-4f54-9db3-cea31fb7ede5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042753 Aug 25 05:39:02.894616 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 457/887] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:02 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:03.906766 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d4cac097-15cb-4bdf-bce9-7d10349712c5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:03.908217 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-d4cac097-15cb-4bdf-bce9-7d10349712c5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:03.913844 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d4cac097-15cb-4bdf-bce9-7d10349712c5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:03.914289 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d4cac097-15cb-4bdf-bce9-7d10349712c5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:03.915058 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d4cac097-15cb-4bdf-bce9-7d10349712c5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:03.915490 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d4cac097-15cb-4bdf-bce9-7d10349712c5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:03.944917 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d4cac097-15cb-4bdf-bce9-7d10349712c5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042716 Aug 25 05:39:03.945462 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 431/888] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:03 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:04.902333 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 05:39:04.902603 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: Wed Aug 25 05:39:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 05:39:04.956375 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b13ab479-a4f0-4897-840f-e1cf9cf928dd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:04.957292 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b13ab479-a4f0-4897-840f-e1cf9cf928dd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:04.963564 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b13ab479-a4f0-4897-840f-e1cf9cf928dd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:04.964113 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b13ab479-a4f0-4897-840f-e1cf9cf928dd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:04.964983 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b13ab479-a4f0-4897-840f-e1cf9cf928dd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:04.965501 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b13ab479-a4f0-4897-840f-e1cf9cf928dd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:04.995952 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b13ab479-a4f0-4897-840f-e1cf9cf928dd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043320 Aug 25 05:39:04.996518 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 458/889] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:04 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:39:06.007891 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-39b6ea47-6b2f-4c63-bbd3-2e1fe71436ef tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:06.008706 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-39b6ea47-6b2f-4c63-bbd3-2e1fe71436ef tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:06.014600 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-39b6ea47-6b2f-4c63-bbd3-2e1fe71436ef tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:06.015044 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-39b6ea47-6b2f-4c63-bbd3-2e1fe71436ef tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:06.015818 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-39b6ea47-6b2f-4c63-bbd3-2e1fe71436ef tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:06.016245 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-39b6ea47-6b2f-4c63-bbd3-2e1fe71436ef tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:06.045158 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-39b6ea47-6b2f-4c63-bbd3-2e1fe71436ef tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041378 Aug 25 05:39:06.045730 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 432/890] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:06 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:07.056871 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-fd49cee0-f173-4c6b-bd4f-53eb925fe0c4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:07.057802 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-fd49cee0-f173-4c6b-bd4f-53eb925fe0c4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:07.063684 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fd49cee0-f173-4c6b-bd4f-53eb925fe0c4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:07.064135 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fd49cee0-f173-4c6b-bd4f-53eb925fe0c4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:07.064904 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fd49cee0-f173-4c6b-bd4f-53eb925fe0c4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:07.065334 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fd49cee0-f173-4c6b-bd4f-53eb925fe0c4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:07.094583 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-fd49cee0-f173-4c6b-bd4f-53eb925fe0c4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041741 Aug 25 05:39:07.095134 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 459/891] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:07 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:08.106438 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-182b0ff2-5d69-4136-9046-01f2952a815e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:08.107342 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-182b0ff2-5d69-4136-9046-01f2952a815e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:08.113145 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-182b0ff2-5d69-4136-9046-01f2952a815e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:08.113615 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-182b0ff2-5d69-4136-9046-01f2952a815e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:08.114392 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-182b0ff2-5d69-4136-9046-01f2952a815e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:08.114826 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-182b0ff2-5d69-4136-9046-01f2952a815e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:08.143978 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-182b0ff2-5d69-4136-9046-01f2952a815e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041335 Aug 25 05:39:08.144523 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 433/892] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:08 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:09.156839 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-92b36dd3-51d7-4b29-9a8f-6a677f8c8e98 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:09.157763 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-92b36dd3-51d7-4b29-9a8f-6a677f8c8e98 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:09.164754 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-92b36dd3-51d7-4b29-9a8f-6a677f8c8e98 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:09.165195 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-92b36dd3-51d7-4b29-9a8f-6a677f8c8e98 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:09.165987 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-92b36dd3-51d7-4b29-9a8f-6a677f8c8e98 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:09.166443 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-92b36dd3-51d7-4b29-9a8f-6a677f8c8e98 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:09.195949 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-92b36dd3-51d7-4b29-9a8f-6a677f8c8e98 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043106 Aug 25 05:39:09.196510 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 460/893] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:09 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:10.207775 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-92f950e2-0226-43bc-850e-5f2f49c01049 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:10.208586 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-92f950e2-0226-43bc-850e-5f2f49c01049 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:10.215090 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-92f950e2-0226-43bc-850e-5f2f49c01049 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:10.215529 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-92f950e2-0226-43bc-850e-5f2f49c01049 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:10.216288 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-92f950e2-0226-43bc-850e-5f2f49c01049 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:10.216745 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-92f950e2-0226-43bc-850e-5f2f49c01049 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:10.247512 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-92f950e2-0226-43bc-850e-5f2f49c01049 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043519 Aug 25 05:39:10.248058 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 434/894] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:10 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:11.259395 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-0e908f16-1882-43ba-bbe9-cfc488327eab tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:11.260214 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-0e908f16-1882-43ba-bbe9-cfc488327eab tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:11.266057 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0e908f16-1882-43ba-bbe9-cfc488327eab tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:11.266492 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0e908f16-1882-43ba-bbe9-cfc488327eab tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:11.267247 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0e908f16-1882-43ba-bbe9-cfc488327eab tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:11.267675 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0e908f16-1882-43ba-bbe9-cfc488327eab tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:11.297537 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-0e908f16-1882-43ba-bbe9-cfc488327eab tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042103 Aug 25 05:39:11.298112 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 461/895] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:11 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:12.309703 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-0682357d-7896-46ee-b0b4-22ff114f89e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:12.310608 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-0682357d-7896-46ee-b0b4-22ff114f89e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:12.316449 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0682357d-7896-46ee-b0b4-22ff114f89e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:12.316892 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0682357d-7896-46ee-b0b4-22ff114f89e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:12.317686 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0682357d-7896-46ee-b0b4-22ff114f89e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:12.318119 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0682357d-7896-46ee-b0b4-22ff114f89e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:12.347807 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-0682357d-7896-46ee-b0b4-22ff114f89e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042655 Aug 25 05:39:12.348356 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 435/896] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:12 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:13.359937 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e482d730-a235-45b9-987f-addac59b8254 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:13.360829 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e482d730-a235-45b9-987f-addac59b8254 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:13.366628 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e482d730-a235-45b9-987f-addac59b8254 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:13.367066 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e482d730-a235-45b9-987f-addac59b8254 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:13.367841 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e482d730-a235-45b9-987f-addac59b8254 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:13.368270 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e482d730-a235-45b9-987f-addac59b8254 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:13.398116 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e482d730-a235-45b9-987f-addac59b8254 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041909 Aug 25 05:39:13.400954 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 462/897] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:13 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:14.410211 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-381eb09a-0f4d-45d7-bdaf-0d7c13ca1ac5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:14.411144 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-381eb09a-0f4d-45d7-bdaf-0d7c13ca1ac5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:14.418130 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-381eb09a-0f4d-45d7-bdaf-0d7c13ca1ac5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:14.418581 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-381eb09a-0f4d-45d7-bdaf-0d7c13ca1ac5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:14.419352 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-381eb09a-0f4d-45d7-bdaf-0d7c13ca1ac5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:14.419791 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-381eb09a-0f4d-45d7-bdaf-0d7c13ca1ac5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:14.448218 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-381eb09a-0f4d-45d7-bdaf-0d7c13ca1ac5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041818 Aug 25 05:39:14.448755 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 436/898] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:14 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:15.459850 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-8c7f78b3-e368-498b-8d8a-2f91ef02565f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:15.460755 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-8c7f78b3-e368-498b-8d8a-2f91ef02565f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:15.468004 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8c7f78b3-e368-498b-8d8a-2f91ef02565f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:15.468448 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8c7f78b3-e368-498b-8d8a-2f91ef02565f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:15.469212 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8c7f78b3-e368-498b-8d8a-2f91ef02565f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:15.469721 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8c7f78b3-e368-498b-8d8a-2f91ef02565f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:15.499794 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-8c7f78b3-e368-498b-8d8a-2f91ef02565f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043856 Aug 25 05:39:15.500353 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 463/899] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:15 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:16.512030 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8d94e31f-1cba-4369-84f7-61fcd2680ab7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:16.512841 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8d94e31f-1cba-4369-84f7-61fcd2680ab7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:16.518821 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8d94e31f-1cba-4369-84f7-61fcd2680ab7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:16.519266 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8d94e31f-1cba-4369-84f7-61fcd2680ab7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:16.520057 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8d94e31f-1cba-4369-84f7-61fcd2680ab7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:16.520505 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8d94e31f-1cba-4369-84f7-61fcd2680ab7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:16.551852 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8d94e31f-1cba-4369-84f7-61fcd2680ab7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044223 Aug 25 05:39:16.552396 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 437/900] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:16 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:17.563696 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9933132f-c092-43ea-a362-ae7e8c837545 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:17.564596 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9933132f-c092-43ea-a362-ae7e8c837545 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:17.570648 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9933132f-c092-43ea-a362-ae7e8c837545 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:17.571094 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9933132f-c092-43ea-a362-ae7e8c837545 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:17.571859 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9933132f-c092-43ea-a362-ae7e8c837545 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:17.572981 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9933132f-c092-43ea-a362-ae7e8c837545 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:17.602046 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9933132f-c092-43ea-a362-ae7e8c837545 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042146 Aug 25 05:39:17.602594 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 464/901] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:17 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:18.613611 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-88fd8392-80ea-4eb9-91e7-93612bf41635 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:18.614511 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-88fd8392-80ea-4eb9-91e7-93612bf41635 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:18.620698 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-88fd8392-80ea-4eb9-91e7-93612bf41635 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:18.621142 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-88fd8392-80ea-4eb9-91e7-93612bf41635 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:18.621925 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-88fd8392-80ea-4eb9-91e7-93612bf41635 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:18.622361 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-88fd8392-80ea-4eb9-91e7-93612bf41635 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:18.651818 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-88fd8392-80ea-4eb9-91e7-93612bf41635 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042067 Aug 25 05:39:18.652362 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 438/902] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:18 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:19.663532 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7cf53d4f-f355-4d7f-9319-ea56ecdf5f6a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:19.664350 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-7cf53d4f-f355-4d7f-9319-ea56ecdf5f6a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:19.670919 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7cf53d4f-f355-4d7f-9319-ea56ecdf5f6a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:19.671360 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7cf53d4f-f355-4d7f-9319-ea56ecdf5f6a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:19.672120 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7cf53d4f-f355-4d7f-9319-ea56ecdf5f6a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:19.672550 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7cf53d4f-f355-4d7f-9319-ea56ecdf5f6a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:19.703182 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-7cf53d4f-f355-4d7f-9319-ea56ecdf5f6a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043481 Aug 25 05:39:19.703738 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 465/903] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:19 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:20.714747 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-fa4f7356-48b7-491f-bb74-5be2c4a49adc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:20.715884 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-fa4f7356-48b7-491f-bb74-5be2c4a49adc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:20.722470 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fa4f7356-48b7-491f-bb74-5be2c4a49adc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:20.722911 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fa4f7356-48b7-491f-bb74-5be2c4a49adc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:20.723670 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fa4f7356-48b7-491f-bb74-5be2c4a49adc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:20.724097 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fa4f7356-48b7-491f-bb74-5be2c4a49adc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:20.754279 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-fa4f7356-48b7-491f-bb74-5be2c4a49adc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043296 Aug 25 05:39:20.754833 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 439/904] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:20 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:21.766477 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e50589ba-40ea-480a-b859-10dcdd830025 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:21.767283 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e50589ba-40ea-480a-b859-10dcdd830025 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:21.773303 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e50589ba-40ea-480a-b859-10dcdd830025 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:21.773774 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e50589ba-40ea-480a-b859-10dcdd830025 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:21.774533 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e50589ba-40ea-480a-b859-10dcdd830025 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:21.774961 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e50589ba-40ea-480a-b859-10dcdd830025 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:21.805239 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e50589ba-40ea-480a-b859-10dcdd830025 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042776 Aug 25 05:39:21.805880 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 466/905] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:21 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:22.817510 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-29b3f77a-8047-4bd8-8b92-b1b664576e05 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:22.818475 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-29b3f77a-8047-4bd8-8b92-b1b664576e05 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:22.824628 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-29b3f77a-8047-4bd8-8b92-b1b664576e05 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:22.825079 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-29b3f77a-8047-4bd8-8b92-b1b664576e05 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:22.825888 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-29b3f77a-8047-4bd8-8b92-b1b664576e05 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:22.827065 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-29b3f77a-8047-4bd8-8b92-b1b664576e05 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:22.855183 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-29b3f77a-8047-4bd8-8b92-b1b664576e05 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041454 Aug 25 05:39:22.855788 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 440/906] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:22 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:23.867670 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1bf3e694-879f-4607-ac15-cb7f02bdddca tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:23.868465 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1bf3e694-879f-4607-ac15-cb7f02bdddca tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:23.875061 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1bf3e694-879f-4607-ac15-cb7f02bdddca tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:23.875492 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1bf3e694-879f-4607-ac15-cb7f02bdddca tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:23.876243 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1bf3e694-879f-4607-ac15-cb7f02bdddca tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:23.876667 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1bf3e694-879f-4607-ac15-cb7f02bdddca tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:23.905552 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1bf3e694-879f-4607-ac15-cb7f02bdddca tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041737 Aug 25 05:39:23.907024 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 467/907] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:23 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:24.916253 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-dc552573-61b3-40ce-a30d-4ae99d755c7c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:24.917071 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-dc552573-61b3-40ce-a30d-4ae99d755c7c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:24.922951 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dc552573-61b3-40ce-a30d-4ae99d755c7c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:24.923390 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dc552573-61b3-40ce-a30d-4ae99d755c7c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:24.924143 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dc552573-61b3-40ce-a30d-4ae99d755c7c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:24.924564 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dc552573-61b3-40ce-a30d-4ae99d755c7c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:24.952678 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-dc552573-61b3-40ce-a30d-4ae99d755c7c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040257 Aug 25 05:39:24.953222 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 441/908] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:24 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:25.963796 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-31fff78b-9218-4d2e-85bf-a2c740b6ef29 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:25.964680 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-31fff78b-9218-4d2e-85bf-a2c740b6ef29 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:25.970973 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-31fff78b-9218-4d2e-85bf-a2c740b6ef29 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:25.971415 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-31fff78b-9218-4d2e-85bf-a2c740b6ef29 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:25.972176 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-31fff78b-9218-4d2e-85bf-a2c740b6ef29 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:25.972606 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-31fff78b-9218-4d2e-85bf-a2c740b6ef29 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:26.001696 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-31fff78b-9218-4d2e-85bf-a2c740b6ef29 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041692 Aug 25 05:39:26.002251 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 468/909] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:25 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:27.012285 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6266db87-a044-4ec5-926d-5aa9984b3909 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:27.013217 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6266db87-a044-4ec5-926d-5aa9984b3909 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:27.019356 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6266db87-a044-4ec5-926d-5aa9984b3909 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:27.019802 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6266db87-a044-4ec5-926d-5aa9984b3909 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:27.020565 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6266db87-a044-4ec5-926d-5aa9984b3909 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:27.020999 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6266db87-a044-4ec5-926d-5aa9984b3909 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:27.051322 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6266db87-a044-4ec5-926d-5aa9984b3909 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042658 Aug 25 05:39:27.051808 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 442/910] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:27 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:28.063325 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e42fe672-f6c4-4c9c-98b9-06fe84e749f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:28.064129 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e42fe672-f6c4-4c9c-98b9-06fe84e749f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:28.069976 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e42fe672-f6c4-4c9c-98b9-06fe84e749f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:28.070417 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e42fe672-f6c4-4c9c-98b9-06fe84e749f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:28.071178 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e42fe672-f6c4-4c9c-98b9-06fe84e749f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:28.071609 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e42fe672-f6c4-4c9c-98b9-06fe84e749f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:28.102231 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e42fe672-f6c4-4c9c-98b9-06fe84e749f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043167 Aug 25 05:39:28.102785 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 469/911] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:28 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:28.330906 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 05:39:28.331117 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: Wed Aug 25 05:39:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 05:39:29.114364 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-46e126bd-2249-4f82-8de8-e1c6052228f6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:29.115253 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-46e126bd-2249-4f82-8de8-e1c6052228f6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:29.121058 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-46e126bd-2249-4f82-8de8-e1c6052228f6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:29.121498 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-46e126bd-2249-4f82-8de8-e1c6052228f6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:29.122289 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-46e126bd-2249-4f82-8de8-e1c6052228f6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:29.122715 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-46e126bd-2249-4f82-8de8-e1c6052228f6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:29.150993 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-46e126bd-2249-4f82-8de8-e1c6052228f6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040363 Aug 25 05:39:29.151534 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 443/912] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:29 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:30.162869 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-8a1fe2bf-d8a3-40ea-af14-5c0ca58e29c5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:30.163717 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-8a1fe2bf-d8a3-40ea-af14-5c0ca58e29c5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:30.169746 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8a1fe2bf-d8a3-40ea-af14-5c0ca58e29c5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:30.170180 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8a1fe2bf-d8a3-40ea-af14-5c0ca58e29c5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:30.170938 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8a1fe2bf-d8a3-40ea-af14-5c0ca58e29c5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:30.171363 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8a1fe2bf-d8a3-40ea-af14-5c0ca58e29c5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:30.201787 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-8a1fe2bf-d8a3-40ea-af14-5c0ca58e29c5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042739 Aug 25 05:39:30.202332 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 470/913] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:30 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:31.214313 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-2c65008c-8695-4447-94b1-6f6f58ee4be9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:31.215275 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-2c65008c-8695-4447-94b1-6f6f58ee4be9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:31.221938 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2c65008c-8695-4447-94b1-6f6f58ee4be9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:31.222384 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2c65008c-8695-4447-94b1-6f6f58ee4be9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:31.223147 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2c65008c-8695-4447-94b1-6f6f58ee4be9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:31.223579 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2c65008c-8695-4447-94b1-6f6f58ee4be9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:31.252562 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-2c65008c-8695-4447-94b1-6f6f58ee4be9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042337 Aug 25 05:39:31.253119 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 444/914] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:31 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:32.264577 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ec23c4b3-f9d0-4106-98e1-8f5b8c95f806 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:32.265503 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ec23c4b3-f9d0-4106-98e1-8f5b8c95f806 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:32.271809 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ec23c4b3-f9d0-4106-98e1-8f5b8c95f806 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:32.272260 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ec23c4b3-f9d0-4106-98e1-8f5b8c95f806 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:32.276085 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ec23c4b3-f9d0-4106-98e1-8f5b8c95f806 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:32.276085 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ec23c4b3-f9d0-4106-98e1-8f5b8c95f806 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:32.308561 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ec23c4b3-f9d0-4106-98e1-8f5b8c95f806 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047556 Aug 25 05:39:32.309138 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 471/915] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:32 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:33.320589 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-f1ba5aa9-11ad-4825-a5c6-3fe0e713648d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:33.321484 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-f1ba5aa9-11ad-4825-a5c6-3fe0e713648d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:33.327330 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f1ba5aa9-11ad-4825-a5c6-3fe0e713648d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:33.328592 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f1ba5aa9-11ad-4825-a5c6-3fe0e713648d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:33.329751 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f1ba5aa9-11ad-4825-a5c6-3fe0e713648d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:33.330187 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f1ba5aa9-11ad-4825-a5c6-3fe0e713648d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:33.358921 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-f1ba5aa9-11ad-4825-a5c6-3fe0e713648d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042128 Aug 25 05:39:33.360064 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 445/916] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:33 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:34.370853 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-cbaba9ae-4a96-4665-bdb0-e1da7633829a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:34.371746 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-cbaba9ae-4a96-4665-bdb0-e1da7633829a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:34.377683 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cbaba9ae-4a96-4665-bdb0-e1da7633829a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:34.378120 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cbaba9ae-4a96-4665-bdb0-e1da7633829a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:34.378871 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cbaba9ae-4a96-4665-bdb0-e1da7633829a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:34.379296 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cbaba9ae-4a96-4665-bdb0-e1da7633829a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:34.408811 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-cbaba9ae-4a96-4665-bdb0-e1da7633829a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041553 Aug 25 05:39:34.409274 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 472/917] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:34 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:35.420168 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-51e07e59-5e7d-41f8-a437-abb0d4fea540 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:35.421094 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-51e07e59-5e7d-41f8-a437-abb0d4fea540 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:35.428156 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-51e07e59-5e7d-41f8-a437-abb0d4fea540 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:35.428600 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-51e07e59-5e7d-41f8-a437-abb0d4fea540 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:35.429360 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-51e07e59-5e7d-41f8-a437-abb0d4fea540 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:35.429822 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-51e07e59-5e7d-41f8-a437-abb0d4fea540 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:35.459702 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-51e07e59-5e7d-41f8-a437-abb0d4fea540 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043140 Aug 25 05:39:35.460190 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 446/918] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:35 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:36.471191 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c4d94960-daff-4dc0-9b73-bd82ff1c2117 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:36.472079 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c4d94960-daff-4dc0-9b73-bd82ff1c2117 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:36.477873 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c4d94960-daff-4dc0-9b73-bd82ff1c2117 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:36.478306 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c4d94960-daff-4dc0-9b73-bd82ff1c2117 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:36.479050 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c4d94960-daff-4dc0-9b73-bd82ff1c2117 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:36.479523 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c4d94960-daff-4dc0-9b73-bd82ff1c2117 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:36.508060 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c4d94960-daff-4dc0-9b73-bd82ff1c2117 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040751 Aug 25 05:39:36.508596 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 473/919] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:36 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:37.520614 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-4294feb4-035e-4d45-ad48-eff1be74279e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:37.521512 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-4294feb4-035e-4d45-ad48-eff1be74279e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:37.527288 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4294feb4-035e-4d45-ad48-eff1be74279e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:37.527726 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4294feb4-035e-4d45-ad48-eff1be74279e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:37.528480 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4294feb4-035e-4d45-ad48-eff1be74279e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:37.529184 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4294feb4-035e-4d45-ad48-eff1be74279e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:37.558677 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-4294feb4-035e-4d45-ad48-eff1be74279e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042732 Aug 25 05:39:37.559223 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 447/920] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:37 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:38.570878 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b26e1ad3-6866-4024-836f-2e93a7cee76d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:38.571810 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b26e1ad3-6866-4024-836f-2e93a7cee76d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:38.577647 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b26e1ad3-6866-4024-836f-2e93a7cee76d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:38.578090 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b26e1ad3-6866-4024-836f-2e93a7cee76d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:38.578854 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b26e1ad3-6866-4024-836f-2e93a7cee76d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:38.579285 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b26e1ad3-6866-4024-836f-2e93a7cee76d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:38.609368 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b26e1ad3-6866-4024-836f-2e93a7cee76d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042354 Aug 25 05:39:38.609947 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 474/921] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:38 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:39.621149 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7eb05ba0-cad9-422b-b7d5-d89e2f4ce464 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:39.622078 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7eb05ba0-cad9-422b-b7d5-d89e2f4ce464 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:39.629116 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7eb05ba0-cad9-422b-b7d5-d89e2f4ce464 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:39.629597 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7eb05ba0-cad9-422b-b7d5-d89e2f4ce464 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:39.630383 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7eb05ba0-cad9-422b-b7d5-d89e2f4ce464 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:39.630818 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7eb05ba0-cad9-422b-b7d5-d89e2f4ce464 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:39.661625 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7eb05ba0-cad9-422b-b7d5-d89e2f4ce464 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044186 Aug 25 05:39:39.662169 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 448/922] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:39 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:40.167470 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 05:39:40.167745 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: Wed Aug 25 05:39:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 05:39:40.673365 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a4b1f886-8c03-4b74-8c01-967115825557 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:40.674319 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a4b1f886-8c03-4b74-8c01-967115825557 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:40.680550 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a4b1f886-8c03-4b74-8c01-967115825557 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:40.680989 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a4b1f886-8c03-4b74-8c01-967115825557 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:40.681789 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a4b1f886-8c03-4b74-8c01-967115825557 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:40.682259 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a4b1f886-8c03-4b74-8c01-967115825557 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:40.711581 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a4b1f886-8c03-4b74-8c01-967115825557 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042028 Aug 25 05:39:40.712127 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 475/923] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:40 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:41.722992 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8270056a-8502-466d-a672-d49fb6218766 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:41.723883 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8270056a-8502-466d-a672-d49fb6218766 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:41.729784 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8270056a-8502-466d-a672-d49fb6218766 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:41.730225 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8270056a-8502-466d-a672-d49fb6218766 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:41.730978 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8270056a-8502-466d-a672-d49fb6218766 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:41.731401 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8270056a-8502-466d-a672-d49fb6218766 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:41.760297 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8270056a-8502-466d-a672-d49fb6218766 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041522 Aug 25 05:39:41.760841 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 449/924] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:41 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:42.771730 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-fdaf05d3-2900-4d06-9bc7-2a84063d1043 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:42.772633 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-fdaf05d3-2900-4d06-9bc7-2a84063d1043 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:42.778790 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fdaf05d3-2900-4d06-9bc7-2a84063d1043 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:42.779240 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fdaf05d3-2900-4d06-9bc7-2a84063d1043 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:42.780005 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fdaf05d3-2900-4d06-9bc7-2a84063d1043 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:42.780440 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fdaf05d3-2900-4d06-9bc7-2a84063d1043 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:42.810591 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-fdaf05d3-2900-4d06-9bc7-2a84063d1043 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042616 Aug 25 05:39:42.811064 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 476/925] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:42 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:43.832385 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-754fb835-6c67-4bcc-8d50-2db0ca3f6b07 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:43.833290 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-754fb835-6c67-4bcc-8d50-2db0ca3f6b07 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:43.839881 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-754fb835-6c67-4bcc-8d50-2db0ca3f6b07 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:43.840323 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-754fb835-6c67-4bcc-8d50-2db0ca3f6b07 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:43.841088 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-754fb835-6c67-4bcc-8d50-2db0ca3f6b07 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:43.841559 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-754fb835-6c67-4bcc-8d50-2db0ca3f6b07 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:43.875031 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-754fb835-6c67-4bcc-8d50-2db0ca3f6b07 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055874 Aug 25 05:39:43.875581 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 450/926] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:43 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:44.887727 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e3d727a8-8463-492d-bc4a-38bb0d8e1c64 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:44.888813 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e3d727a8-8463-492d-bc4a-38bb0d8e1c64 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:44.895311 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e3d727a8-8463-492d-bc4a-38bb0d8e1c64 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:44.895760 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e3d727a8-8463-492d-bc4a-38bb0d8e1c64 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:44.896536 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e3d727a8-8463-492d-bc4a-38bb0d8e1c64 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:44.896970 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e3d727a8-8463-492d-bc4a-38bb0d8e1c64 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:44.927379 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e3d727a8-8463-492d-bc4a-38bb0d8e1c64 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043481 Aug 25 05:39:44.928177 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 477/927] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:44 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:45.939698 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-4c0b27b7-c866-4591-8b25-c7f415927be7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:45.940587 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-4c0b27b7-c866-4591-8b25-c7f415927be7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:45.946469 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4c0b27b7-c866-4591-8b25-c7f415927be7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:45.946905 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4c0b27b7-c866-4591-8b25-c7f415927be7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:45.947658 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4c0b27b7-c866-4591-8b25-c7f415927be7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:45.948083 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4c0b27b7-c866-4591-8b25-c7f415927be7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:45.977312 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-4c0b27b7-c866-4591-8b25-c7f415927be7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040933 Aug 25 05:39:45.978227 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 451/928] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:45 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:46.988042 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-cf3a12fc-947e-4253-b8bd-e56928e41502 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:46.988939 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-cf3a12fc-947e-4253-b8bd-e56928e41502 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:46.995244 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cf3a12fc-947e-4253-b8bd-e56928e41502 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:46.995686 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cf3a12fc-947e-4253-b8bd-e56928e41502 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:46.996444 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cf3a12fc-947e-4253-b8bd-e56928e41502 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:46.996879 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cf3a12fc-947e-4253-b8bd-e56928e41502 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:47.025316 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-cf3a12fc-947e-4253-b8bd-e56928e41502 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040965 Aug 25 05:39:47.025887 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 478/929] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:46 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:48.036583 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-66b86234-2419-4519-ae83-2950fa22751e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:48.037485 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-66b86234-2419-4519-ae83-2950fa22751e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:48.044464 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-66b86234-2419-4519-ae83-2950fa22751e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:48.044910 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-66b86234-2419-4519-ae83-2950fa22751e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:48.045714 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-66b86234-2419-4519-ae83-2950fa22751e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:48.046147 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-66b86234-2419-4519-ae83-2950fa22751e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:48.075409 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-66b86234-2419-4519-ae83-2950fa22751e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042546 Aug 25 05:39:48.075962 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 452/930] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:48 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:49.087385 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-4241a2ea-bbc2-4b31-8aad-c27a02979352 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:49.088284 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-4241a2ea-bbc2-4b31-8aad-c27a02979352 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:49.090666 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: ERROR oslo.messaging._drivers.impl_rabbit [-] [024c7946-b47b-4a06-aa5e-7d5b6a13301d] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 25 05:39:49.095005 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4241a2ea-bbc2-4b31-8aad-c27a02979352 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:49.095442 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4241a2ea-bbc2-4b31-8aad-c27a02979352 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:49.096239 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4241a2ea-bbc2-4b31-8aad-c27a02979352 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:49.096663 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4241a2ea-bbc2-4b31-8aad-c27a02979352 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:49.126160 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-4241a2ea-bbc2-4b31-8aad-c27a02979352 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042755 Aug 25 05:39:49.126714 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 479/931] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:49 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:50.139077 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a925fcfc-b1b8-4385-bf5c-eb5bef0a7cad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:50.139970 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a925fcfc-b1b8-4385-bf5c-eb5bef0a7cad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:50.145728 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a925fcfc-b1b8-4385-bf5c-eb5bef0a7cad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:50.146166 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a925fcfc-b1b8-4385-bf5c-eb5bef0a7cad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:50.146915 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a925fcfc-b1b8-4385-bf5c-eb5bef0a7cad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:50.147340 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a925fcfc-b1b8-4385-bf5c-eb5bef0a7cad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:50.175130 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a925fcfc-b1b8-4385-bf5c-eb5bef0a7cad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040393 Aug 25 05:39:50.175666 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 453/932] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:50 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:51.187339 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-59ecc1fd-2aeb-499a-9dee-6481b2862857 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:51.188231 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-59ecc1fd-2aeb-499a-9dee-6481b2862857 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:51.208615 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-59ecc1fd-2aeb-499a-9dee-6481b2862857 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:51.209054 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-59ecc1fd-2aeb-499a-9dee-6481b2862857 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:51.209846 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-59ecc1fd-2aeb-499a-9dee-6481b2862857 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:51.210272 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-59ecc1fd-2aeb-499a-9dee-6481b2862857 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:51.214671 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO oslo.messaging._drivers.impl_rabbit [-] [024c7946-b47b-4a06-aa5e-7d5b6a13301d] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 34756. Aug 25 05:39:51.239863 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-59ecc1fd-2aeb-499a-9dee-6481b2862857 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056278 Aug 25 05:39:51.240408 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 480/933] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:51 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:52.252061 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1dc85255-27ad-4bd4-8db0-81b9eccfec72 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:52.256712 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1dc85255-27ad-4bd4-8db0-81b9eccfec72 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:52.258927 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1dc85255-27ad-4bd4-8db0-81b9eccfec72 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:52.260098 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1dc85255-27ad-4bd4-8db0-81b9eccfec72 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:52.260921 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1dc85255-27ad-4bd4-8db0-81b9eccfec72 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:52.261349 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1dc85255-27ad-4bd4-8db0-81b9eccfec72 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:52.290958 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1dc85255-27ad-4bd4-8db0-81b9eccfec72 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042130 Aug 25 05:39:52.291465 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 454/934] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:52 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:53.302247 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-8e954ef8-33dd-44c6-8b7e-a638858003d4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:53.303149 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-8e954ef8-33dd-44c6-8b7e-a638858003d4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:53.309093 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8e954ef8-33dd-44c6-8b7e-a638858003d4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:53.309564 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8e954ef8-33dd-44c6-8b7e-a638858003d4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:53.310424 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8e954ef8-33dd-44c6-8b7e-a638858003d4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:53.310868 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8e954ef8-33dd-44c6-8b7e-a638858003d4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:53.339998 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-8e954ef8-33dd-44c6-8b7e-a638858003d4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041527 Aug 25 05:39:53.340541 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 481/935] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:53 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:54.351198 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-04595f44-291b-4db8-a7d7-10826e4e5f97 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:54.352101 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-04595f44-291b-4db8-a7d7-10826e4e5f97 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:54.358792 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-04595f44-291b-4db8-a7d7-10826e4e5f97 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:54.359232 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-04595f44-291b-4db8-a7d7-10826e4e5f97 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:54.359987 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-04595f44-291b-4db8-a7d7-10826e4e5f97 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:54.360414 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-04595f44-291b-4db8-a7d7-10826e4e5f97 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:54.389554 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-04595f44-291b-4db8-a7d7-10826e4e5f97 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042053 Aug 25 05:39:54.390098 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 455/936] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:54 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:55.401975 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a6f3e8d9-967c-4ae5-b042-98f743c5b54e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:55.402884 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a6f3e8d9-967c-4ae5-b042-98f743c5b54e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:55.410449 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a6f3e8d9-967c-4ae5-b042-98f743c5b54e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:55.410887 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a6f3e8d9-967c-4ae5-b042-98f743c5b54e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:55.411659 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a6f3e8d9-967c-4ae5-b042-98f743c5b54e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:55.412101 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a6f3e8d9-967c-4ae5-b042-98f743c5b54e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:55.441927 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a6f3e8d9-967c-4ae5-b042-98f743c5b54e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044833 Aug 25 05:39:55.442483 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 482/937] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:55 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:39:56.453407 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-2ca53dd2-e72d-4530-a830-3b1f5c1f9d4e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:56.454444 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-2ca53dd2-e72d-4530-a830-3b1f5c1f9d4e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:56.460279 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2ca53dd2-e72d-4530-a830-3b1f5c1f9d4e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:56.460764 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2ca53dd2-e72d-4530-a830-3b1f5c1f9d4e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:56.461574 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2ca53dd2-e72d-4530-a830-3b1f5c1f9d4e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:56.462037 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2ca53dd2-e72d-4530-a830-3b1f5c1f9d4e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:56.490579 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-2ca53dd2-e72d-4530-a830-3b1f5c1f9d4e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041048 Aug 25 05:39:56.491118 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 456/938] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:56 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:57.506372 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-467d325e-a9d8-433b-947b-61d4e962f4f9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:57.507810 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-467d325e-a9d8-433b-947b-61d4e962f4f9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:57.519963 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-467d325e-a9d8-433b-947b-61d4e962f4f9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:57.519963 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-467d325e-a9d8-433b-947b-61d4e962f4f9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:57.520490 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-467d325e-a9d8-433b-947b-61d4e962f4f9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:57.521264 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-467d325e-a9d8-433b-947b-61d4e962f4f9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:57.551646 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-467d325e-a9d8-433b-947b-61d4e962f4f9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051882 Aug 25 05:39:57.552197 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 483/939] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:57 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:58.562922 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e5543ca7-27ee-44c1-aa4d-a9612670db92 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:58.563935 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e5543ca7-27ee-44c1-aa4d-a9612670db92 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:58.569828 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e5543ca7-27ee-44c1-aa4d-a9612670db92 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:58.570267 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e5543ca7-27ee-44c1-aa4d-a9612670db92 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:58.571020 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e5543ca7-27ee-44c1-aa4d-a9612670db92 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:58.572093 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e5543ca7-27ee-44c1-aa4d-a9612670db92 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:58.600629 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e5543ca7-27ee-44c1-aa4d-a9612670db92 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041094 Aug 25 05:39:58.601180 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 457/940] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:58 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:39:59.615517 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2236bc83-fc10-4277-b903-e9942e45c515 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:39:59.616595 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2236bc83-fc10-4277-b903-e9942e45c515 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:39:59.623619 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2236bc83-fc10-4277-b903-e9942e45c515 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:59.624095 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2236bc83-fc10-4277-b903-e9942e45c515 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:59.624875 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2236bc83-fc10-4277-b903-e9942e45c515 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:39:59.625338 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2236bc83-fc10-4277-b903-e9942e45c515 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:39:59.655830 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2236bc83-fc10-4277-b903-e9942e45c515 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044083 Aug 25 05:39:59.656839 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 484/941] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:39:59 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:00.670612 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ccc0fb46-3323-45ca-9e89-107a8507cc72 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:00.671299 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ccc0fb46-3323-45ca-9e89-107a8507cc72 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:00.676997 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ccc0fb46-3323-45ca-9e89-107a8507cc72 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:00.677436 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ccc0fb46-3323-45ca-9e89-107a8507cc72 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:00.678251 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ccc0fb46-3323-45ca-9e89-107a8507cc72 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:00.678682 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ccc0fb46-3323-45ca-9e89-107a8507cc72 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:00.709055 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ccc0fb46-3323-45ca-9e89-107a8507cc72 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043473 Aug 25 05:40:00.709639 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 458/942] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:00 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:01.720733 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1168ab51-e4dc-424c-ba76-32f62b359be9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:01.721671 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1168ab51-e4dc-424c-ba76-32f62b359be9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:01.728261 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1168ab51-e4dc-424c-ba76-32f62b359be9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:01.728771 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1168ab51-e4dc-424c-ba76-32f62b359be9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:01.729571 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1168ab51-e4dc-424c-ba76-32f62b359be9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:01.730011 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1168ab51-e4dc-424c-ba76-32f62b359be9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:01.759401 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1168ab51-e4dc-424c-ba76-32f62b359be9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042251 Aug 25 05:40:01.760035 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 485/943] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:01 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:02.770055 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-14397111-bf98-42bc-bb89-84dc3d809aab tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:02.771038 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-14397111-bf98-42bc-bb89-84dc3d809aab tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:02.778805 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-14397111-bf98-42bc-bb89-84dc3d809aab tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:02.778805 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-14397111-bf98-42bc-bb89-84dc3d809aab tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:02.779615 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-14397111-bf98-42bc-bb89-84dc3d809aab tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:02.780051 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-14397111-bf98-42bc-bb89-84dc3d809aab tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:02.812012 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-14397111-bf98-42bc-bb89-84dc3d809aab tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045696 Aug 25 05:40:02.813069 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 459/944] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:02 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:03.825874 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-60931e48-d2a3-46ba-b03d-e05ad52f9ab6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:03.826892 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-60931e48-d2a3-46ba-b03d-e05ad52f9ab6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:03.832892 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-60931e48-d2a3-46ba-b03d-e05ad52f9ab6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:03.833340 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-60931e48-d2a3-46ba-b03d-e05ad52f9ab6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:03.834148 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-60931e48-d2a3-46ba-b03d-e05ad52f9ab6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:03.834588 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-60931e48-d2a3-46ba-b03d-e05ad52f9ab6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:03.865808 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-60931e48-d2a3-46ba-b03d-e05ad52f9ab6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045773 Aug 25 05:40:03.866363 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 486/945] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:03 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:04.055360 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-40612691-2b4d-43d0-99fe-420d4246ce07 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:40:04.057008 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-40612691-2b4d-43d0-99fe-420d4246ce07 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:04.062186 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-40612691-2b4d-43d0-99fe-420d4246ce07 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:04.062622 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-40612691-2b4d-43d0-99fe-420d4246ce07 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:04.063376 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-40612691-2b4d-43d0-99fe-420d4246ce07 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:04.064095 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-40612691-2b4d-43d0-99fe-420d4246ce07 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:04.085498 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.objects.instance [None req-40612691-2b4d-43d0-99fe-420d4246ce07 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lazy-loading 'flavor' on Instance uuid 30a141ef-390c-4d75-94ba-c3112c06bc39 {{(pid=108884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 05:40:04.354759 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-40612691-2b4d-43d0-99fe-420d4246ce07 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "POST /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39/action" status: 202 len: 0 microversion: 2.1 time: 0.302728 Aug 25 05:40:04.355236 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 460/946] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:40:04 2021] POST /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:40:04.364318 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-23811e35-0251-4ba1-bbb0-e18b4b96c69c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:04.364921 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-23811e35-0251-4ba1-bbb0-e18b4b96c69c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:04.371936 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-23811e35-0251-4ba1-bbb0-e18b4b96c69c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:04.372129 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-23811e35-0251-4ba1-bbb0-e18b4b96c69c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:04.373387 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-23811e35-0251-4ba1-bbb0-e18b4b96c69c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:04.373387 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-23811e35-0251-4ba1-bbb0-e18b4b96c69c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:04.498849 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-23811e35-0251-4ba1-bbb0-e18b4b96c69c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:04.506152 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-23811e35-0251-4ba1-bbb0-e18b4b96c69c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.145764 Aug 25 05:40:04.506727 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 487/947] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:04 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:40:04.877584 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-663a744a-b5aa-4d20-9498-80f279ceca30 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:04.878600 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-663a744a-b5aa-4d20-9498-80f279ceca30 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:04.885021 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-663a744a-b5aa-4d20-9498-80f279ceca30 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:04.885514 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-663a744a-b5aa-4d20-9498-80f279ceca30 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:04.886246 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-663a744a-b5aa-4d20-9498-80f279ceca30 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:04.886735 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-663a744a-b5aa-4d20-9498-80f279ceca30 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:04.917013 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-663a744a-b5aa-4d20-9498-80f279ceca30 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043643 Aug 25 05:40:04.917605 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 461/948] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:04 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:05.525562 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e43e6d55-e487-42c6-ab65-e0b200b4e90e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:05.526650 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e43e6d55-e487-42c6-ab65-e0b200b4e90e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:05.534639 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e43e6d55-e487-42c6-ab65-e0b200b4e90e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:05.535312 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e43e6d55-e487-42c6-ab65-e0b200b4e90e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:05.536498 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e43e6d55-e487-42c6-ab65-e0b200b4e90e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:05.537226 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e43e6d55-e487-42c6-ab65-e0b200b4e90e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:05.671598 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-e43e6d55-e487-42c6-ab65-e0b200b4e90e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:05.679308 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e43e6d55-e487-42c6-ab65-e0b200b4e90e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.158257 Aug 25 05:40:05.680001 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 488/949] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:05 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:40:05.928816 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ae85f8f7-df0c-46c7-a194-9ff0642e5cc7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:05.929785 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ae85f8f7-df0c-46c7-a194-9ff0642e5cc7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:05.937111 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ae85f8f7-df0c-46c7-a194-9ff0642e5cc7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:05.937680 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ae85f8f7-df0c-46c7-a194-9ff0642e5cc7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:05.938519 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ae85f8f7-df0c-46c7-a194-9ff0642e5cc7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:05.939015 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ae85f8f7-df0c-46c7-a194-9ff0642e5cc7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:05.971913 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ae85f8f7-df0c-46c7-a194-9ff0642e5cc7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047424 Aug 25 05:40:05.972545 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 462/950] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:05 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:06.696511 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-487aa4f6-4a29-49a7-ab62-a1e52e8d9727 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:06.697138 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-487aa4f6-4a29-49a7-ab62-a1e52e8d9727 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:06.703058 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-487aa4f6-4a29-49a7-ab62-a1e52e8d9727 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:06.703503 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-487aa4f6-4a29-49a7-ab62-a1e52e8d9727 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:06.704272 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-487aa4f6-4a29-49a7-ab62-a1e52e8d9727 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:06.704702 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-487aa4f6-4a29-49a7-ab62-a1e52e8d9727 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:06.834508 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-487aa4f6-4a29-49a7-ab62-a1e52e8d9727 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:06.843015 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-487aa4f6-4a29-49a7-ab62-a1e52e8d9727 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.150196 Aug 25 05:40:06.843601 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 489/951] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:06 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:40:06.985137 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8e59c1f3-fda7-41a1-8b97-ac918682e6da tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:06.986162 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8e59c1f3-fda7-41a1-8b97-ac918682e6da tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:06.992621 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8e59c1f3-fda7-41a1-8b97-ac918682e6da tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:06.992934 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8e59c1f3-fda7-41a1-8b97-ac918682e6da tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:06.993855 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8e59c1f3-fda7-41a1-8b97-ac918682e6da tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:06.994303 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8e59c1f3-fda7-41a1-8b97-ac918682e6da tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:07.026946 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8e59c1f3-fda7-41a1-8b97-ac918682e6da tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045766 Aug 25 05:40:07.027739 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 463/952] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:06 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:40:07.861846 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-baeba9e4-5b91-4d00-bedc-b8f440a5fc7a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:07.862564 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-baeba9e4-5b91-4d00-bedc-b8f440a5fc7a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:07.870968 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-baeba9e4-5b91-4d00-bedc-b8f440a5fc7a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:07.871835 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-baeba9e4-5b91-4d00-bedc-b8f440a5fc7a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:07.872751 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-baeba9e4-5b91-4d00-bedc-b8f440a5fc7a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:07.873396 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-baeba9e4-5b91-4d00-bedc-b8f440a5fc7a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:08.014930 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-baeba9e4-5b91-4d00-bedc-b8f440a5fc7a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:08.027287 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-baeba9e4-5b91-4d00-bedc-b8f440a5fc7a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.169959 Aug 25 05:40:08.028570 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 490/953] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:07 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:40:08.050126 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6ac4f3a1-e01c-4981-bfe8-b8b250827b70 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:08.052620 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6ac4f3a1-e01c-4981-bfe8-b8b250827b70 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:08.063153 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6ac4f3a1-e01c-4981-bfe8-b8b250827b70 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:08.063923 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6ac4f3a1-e01c-4981-bfe8-b8b250827b70 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:08.065276 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6ac4f3a1-e01c-4981-bfe8-b8b250827b70 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:08.066131 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6ac4f3a1-e01c-4981-bfe8-b8b250827b70 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:08.120490 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6ac4f3a1-e01c-4981-bfe8-b8b250827b70 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077151 Aug 25 05:40:08.120983 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 464/954] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:08 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:09.052518 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-0a8817a0-d6a9-421b-bd15-e2f9225f8179 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:09.053389 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-0a8817a0-d6a9-421b-bd15-e2f9225f8179 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:09.059718 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0a8817a0-d6a9-421b-bd15-e2f9225f8179 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:09.060289 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0a8817a0-d6a9-421b-bd15-e2f9225f8179 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:09.061291 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0a8817a0-d6a9-421b-bd15-e2f9225f8179 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:09.061929 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0a8817a0-d6a9-421b-bd15-e2f9225f8179 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:09.133249 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ed3e0ad6-4b77-4927-8155-177472fba679 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:09.134785 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ed3e0ad6-4b77-4927-8155-177472fba679 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:09.142558 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ed3e0ad6-4b77-4927-8155-177472fba679 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:09.143523 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ed3e0ad6-4b77-4927-8155-177472fba679 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:09.145902 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ed3e0ad6-4b77-4927-8155-177472fba679 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:09.146377 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ed3e0ad6-4b77-4927-8155-177472fba679 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:09.190286 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ed3e0ad6-4b77-4927-8155-177472fba679 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061608 Aug 25 05:40:09.191200 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 465/955] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:09 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:40:09.225130 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-0a8817a0-d6a9-421b-bd15-e2f9225f8179 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:09.233328 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-0a8817a0-d6a9-421b-bd15-e2f9225f8179 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.184623 Aug 25 05:40:09.238251 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 491/956] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:09 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:40:10.202973 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c454099d-c003-4087-afad-f0010f17905d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:10.203903 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c454099d-c003-4087-afad-f0010f17905d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:10.209862 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c454099d-c003-4087-afad-f0010f17905d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:10.210346 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c454099d-c003-4087-afad-f0010f17905d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:10.211418 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c454099d-c003-4087-afad-f0010f17905d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:10.212474 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c454099d-c003-4087-afad-f0010f17905d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:10.248696 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c454099d-c003-4087-afad-f0010f17905d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049081 Aug 25 05:40:10.253005 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 466/957] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:10 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:10.254072 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c263fc7e-ac6b-430b-8834-d03ed1dfbc53 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:10.254971 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c263fc7e-ac6b-430b-8834-d03ed1dfbc53 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:10.262551 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c263fc7e-ac6b-430b-8834-d03ed1dfbc53 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:10.262993 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c263fc7e-ac6b-430b-8834-d03ed1dfbc53 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:10.264073 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c263fc7e-ac6b-430b-8834-d03ed1dfbc53 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:10.264652 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c263fc7e-ac6b-430b-8834-d03ed1dfbc53 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:10.402346 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-c263fc7e-ac6b-430b-8834-d03ed1dfbc53 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:10.410441 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c263fc7e-ac6b-430b-8834-d03ed1dfbc53 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.160562 Aug 25 05:40:10.410999 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 492/958] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:10 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:40:11.260964 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a2a06d5f-bee4-4f33-adc2-3e07ebdb3810 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:11.261923 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a2a06d5f-bee4-4f33-adc2-3e07ebdb3810 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:11.267863 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a2a06d5f-bee4-4f33-adc2-3e07ebdb3810 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:11.268315 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a2a06d5f-bee4-4f33-adc2-3e07ebdb3810 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:11.269088 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a2a06d5f-bee4-4f33-adc2-3e07ebdb3810 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:11.269613 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a2a06d5f-bee4-4f33-adc2-3e07ebdb3810 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:11.303055 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a2a06d5f-bee4-4f33-adc2-3e07ebdb3810 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046253 Aug 25 05:40:11.303627 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 467/959] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:11 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:11.427335 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ec8a54e9-2cd0-44a5-b6d6-304a9db89363 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:11.427942 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ec8a54e9-2cd0-44a5-b6d6-304a9db89363 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:11.434295 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ec8a54e9-2cd0-44a5-b6d6-304a9db89363 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:11.434740 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ec8a54e9-2cd0-44a5-b6d6-304a9db89363 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:11.435503 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ec8a54e9-2cd0-44a5-b6d6-304a9db89363 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:11.435940 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ec8a54e9-2cd0-44a5-b6d6-304a9db89363 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:11.561253 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ec8a54e9-2cd0-44a5-b6d6-304a9db89363 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:11.568543 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ec8a54e9-2cd0-44a5-b6d6-304a9db89363 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.144892 Aug 25 05:40:11.569097 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 493/960] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:11 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:40:12.316265 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7df1862c-6453-4f1d-b395-4a7e1defdcf2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:12.317215 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7df1862c-6453-4f1d-b395-4a7e1defdcf2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:12.323580 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7df1862c-6453-4f1d-b395-4a7e1defdcf2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:12.324020 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7df1862c-6453-4f1d-b395-4a7e1defdcf2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:12.324774 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7df1862c-6453-4f1d-b395-4a7e1defdcf2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:12.325204 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7df1862c-6453-4f1d-b395-4a7e1defdcf2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:12.355493 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7df1862c-6453-4f1d-b395-4a7e1defdcf2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043072 Aug 25 05:40:12.356051 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 468/961] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:12 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:12.586119 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-947a7a42-803d-40d7-878d-56cac8eca5d3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:12.587146 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-947a7a42-803d-40d7-878d-56cac8eca5d3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:12.593080 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-947a7a42-803d-40d7-878d-56cac8eca5d3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:12.594138 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-947a7a42-803d-40d7-878d-56cac8eca5d3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:12.594834 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-947a7a42-803d-40d7-878d-56cac8eca5d3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:12.594834 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-947a7a42-803d-40d7-878d-56cac8eca5d3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:12.943707 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-947a7a42-803d-40d7-878d-56cac8eca5d3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:12.951335 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-947a7a42-803d-40d7-878d-56cac8eca5d3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.368836 Aug 25 05:40:12.951891 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 494/962] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:12 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:40:13.367048 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-40360702-7c80-4063-b26e-5c03ab0ff7eb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:13.368014 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-40360702-7c80-4063-b26e-5c03ab0ff7eb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:13.374141 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-40360702-7c80-4063-b26e-5c03ab0ff7eb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:13.374414 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-40360702-7c80-4063-b26e-5c03ab0ff7eb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:13.379720 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-40360702-7c80-4063-b26e-5c03ab0ff7eb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:13.380171 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-40360702-7c80-4063-b26e-5c03ab0ff7eb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:13.410730 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-40360702-7c80-4063-b26e-5c03ab0ff7eb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047349 Aug 25 05:40:13.411467 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 469/963] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:13 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:40:13.968703 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-115bfd9a-144f-4d45-b0fa-69f3b8eb468e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:14.015945 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-115bfd9a-144f-4d45-b0fa-69f3b8eb468e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:14.015945 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-115bfd9a-144f-4d45-b0fa-69f3b8eb468e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:14.015945 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-115bfd9a-144f-4d45-b0fa-69f3b8eb468e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:14.015945 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-115bfd9a-144f-4d45-b0fa-69f3b8eb468e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:14.016370 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-115bfd9a-144f-4d45-b0fa-69f3b8eb468e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:14.104446 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-115bfd9a-144f-4d45-b0fa-69f3b8eb468e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:14.112328 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-115bfd9a-144f-4d45-b0fa-69f3b8eb468e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.147264 Aug 25 05:40:14.112915 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 495/964] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:13 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:40:14.425605 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-98613b9f-92a0-4235-ae12-66cd2777ef60 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:14.426905 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-98613b9f-92a0-4235-ae12-66cd2777ef60 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:14.435781 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-98613b9f-92a0-4235-ae12-66cd2777ef60 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:14.436399 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-98613b9f-92a0-4235-ae12-66cd2777ef60 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:14.437545 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-98613b9f-92a0-4235-ae12-66cd2777ef60 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:14.438188 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-98613b9f-92a0-4235-ae12-66cd2777ef60 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:14.479715 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-98613b9f-92a0-4235-ae12-66cd2777ef60 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060293 Aug 25 05:40:14.480458 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 470/965] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:14 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:15.130028 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c42a800f-59fc-4747-8215-9189f5f08670 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:15.130756 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c42a800f-59fc-4747-8215-9189f5f08670 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:15.138926 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c42a800f-59fc-4747-8215-9189f5f08670 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:15.139565 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c42a800f-59fc-4747-8215-9189f5f08670 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:15.140712 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c42a800f-59fc-4747-8215-9189f5f08670 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:15.141334 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c42a800f-59fc-4747-8215-9189f5f08670 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:15.278652 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-c42a800f-59fc-4747-8215-9189f5f08670 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:15.289252 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c42a800f-59fc-4747-8215-9189f5f08670 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.162782 Aug 25 05:40:15.290195 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 496/966] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:15 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:40:15.495697 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-75965245-3fff-4304-8910-a47554f1b43f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:15.497157 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-75965245-3fff-4304-8910-a47554f1b43f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:15.505893 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-75965245-3fff-4304-8910-a47554f1b43f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:15.506333 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-75965245-3fff-4304-8910-a47554f1b43f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:15.507104 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-75965245-3fff-4304-8910-a47554f1b43f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:15.507534 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-75965245-3fff-4304-8910-a47554f1b43f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:15.544831 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-75965245-3fff-4304-8910-a47554f1b43f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055969 Aug 25 05:40:15.545469 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 471/967] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:15 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:16.308240 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ea4bb30f-351c-4dac-b0e2-76be134c01ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:16.308845 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ea4bb30f-351c-4dac-b0e2-76be134c01ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:16.314668 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ea4bb30f-351c-4dac-b0e2-76be134c01ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:16.315107 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ea4bb30f-351c-4dac-b0e2-76be134c01ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:16.315865 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ea4bb30f-351c-4dac-b0e2-76be134c01ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:16.316326 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ea4bb30f-351c-4dac-b0e2-76be134c01ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:16.442741 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ea4bb30f-351c-4dac-b0e2-76be134c01ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:16.451128 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ea4bb30f-351c-4dac-b0e2-76be134c01ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.147693 Aug 25 05:40:16.451695 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 497/968] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:16 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:40:16.557183 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c9ce7d2f-bc63-44a8-a8bf-7a6290dbd588 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:16.558379 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c9ce7d2f-bc63-44a8-a8bf-7a6290dbd588 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:16.564620 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c9ce7d2f-bc63-44a8-a8bf-7a6290dbd588 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:16.564918 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c9ce7d2f-bc63-44a8-a8bf-7a6290dbd588 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:16.565852 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c9ce7d2f-bc63-44a8-a8bf-7a6290dbd588 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:16.566306 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c9ce7d2f-bc63-44a8-a8bf-7a6290dbd588 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:16.606475 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c9ce7d2f-bc63-44a8-a8bf-7a6290dbd588 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053960 Aug 25 05:40:16.607221 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 472/969] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:16 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:17.468084 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-39de51d1-dfb0-471f-95d4-c97869c44a41 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:17.468709 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-39de51d1-dfb0-471f-95d4-c97869c44a41 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:17.474558 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-39de51d1-dfb0-471f-95d4-c97869c44a41 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:17.474978 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-39de51d1-dfb0-471f-95d4-c97869c44a41 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:17.475734 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-39de51d1-dfb0-471f-95d4-c97869c44a41 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:17.476159 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-39de51d1-dfb0-471f-95d4-c97869c44a41 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:17.604281 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-39de51d1-dfb0-471f-95d4-c97869c44a41 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:17.611811 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-39de51d1-dfb0-471f-95d4-c97869c44a41 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.147350 Aug 25 05:40:17.612349 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 498/970] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:17 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:40:17.625190 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e6f4d72c-a563-4345-8c04-bf213796a642 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:17.626169 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e6f4d72c-a563-4345-8c04-bf213796a642 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:17.632164 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e6f4d72c-a563-4345-8c04-bf213796a642 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:17.632601 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e6f4d72c-a563-4345-8c04-bf213796a642 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:17.633497 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e6f4d72c-a563-4345-8c04-bf213796a642 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:17.633961 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e6f4d72c-a563-4345-8c04-bf213796a642 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:17.663737 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e6f4d72c-a563-4345-8c04-bf213796a642 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042251 Aug 25 05:40:17.664290 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 473/971] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:17 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:18.629308 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-28032e53-4f6e-44d9-9a81-cd642041cfa8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:18.629923 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-28032e53-4f6e-44d9-9a81-cd642041cfa8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:18.637112 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-28032e53-4f6e-44d9-9a81-cd642041cfa8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:18.637574 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-28032e53-4f6e-44d9-9a81-cd642041cfa8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:18.638344 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-28032e53-4f6e-44d9-9a81-cd642041cfa8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:18.638773 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-28032e53-4f6e-44d9-9a81-cd642041cfa8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:18.676366 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-54ff86d3-3c7d-46e0-979f-f4d8e5b2bc6c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:18.677348 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-54ff86d3-3c7d-46e0-979f-f4d8e5b2bc6c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:18.684858 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-54ff86d3-3c7d-46e0-979f-f4d8e5b2bc6c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:18.685304 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-54ff86d3-3c7d-46e0-979f-f4d8e5b2bc6c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:18.686125 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-54ff86d3-3c7d-46e0-979f-f4d8e5b2bc6c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:18.686561 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-54ff86d3-3c7d-46e0-979f-f4d8e5b2bc6c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:18.723699 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-54ff86d3-3c7d-46e0-979f-f4d8e5b2bc6c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051062 Aug 25 05:40:18.724271 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 474/972] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:18 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:40:18.774351 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-28032e53-4f6e-44d9-9a81-cd642041cfa8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:18.782019 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-28032e53-4f6e-44d9-9a81-cd642041cfa8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.156289 Aug 25 05:40:18.782585 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 499/973] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:18 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:40:19.735808 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7e52be46-cb1d-419e-93e0-010e6e2f4c94 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:19.736620 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7e52be46-cb1d-419e-93e0-010e6e2f4c94 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:19.745278 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7e52be46-cb1d-419e-93e0-010e6e2f4c94 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:19.745764 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7e52be46-cb1d-419e-93e0-010e6e2f4c94 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:19.746538 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7e52be46-cb1d-419e-93e0-010e6e2f4c94 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:19.746971 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7e52be46-cb1d-419e-93e0-010e6e2f4c94 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:19.777336 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7e52be46-cb1d-419e-93e0-010e6e2f4c94 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045375 Aug 25 05:40:19.778147 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 475/974] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:19 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:19.799384 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1b456701-eafc-4fb6-98bb-8ed606be5d82 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:19.799985 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1b456701-eafc-4fb6-98bb-8ed606be5d82 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:19.806368 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1b456701-eafc-4fb6-98bb-8ed606be5d82 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:19.806798 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1b456701-eafc-4fb6-98bb-8ed606be5d82 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:19.807548 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1b456701-eafc-4fb6-98bb-8ed606be5d82 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:19.807969 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1b456701-eafc-4fb6-98bb-8ed606be5d82 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:19.934252 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-1b456701-eafc-4fb6-98bb-8ed606be5d82 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:19.944427 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1b456701-eafc-4fb6-98bb-8ed606be5d82 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.148824 Aug 25 05:40:19.944983 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 500/975] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:19 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:40:20.687077 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [req-c7c95068-f3f6-49fc-ac32-28b16f966c0c req-af8d5dd5-88f4-4635-979f-5c1a7a6b29bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30a141ef-390c-4d75-94ba-c3112c06bc39", "name": "network-vif-unplugged", "status": "completed", "tag": "b5e81396-e117-425e-887b-37001fc73ed9"}]} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:40:20.688632 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:40:20.688632 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: warnings.warn(msg) Aug 25 05:40:20.696173 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-c7c95068-f3f6-49fc-ac32-28b16f966c0c req-af8d5dd5-88f4-4635-979f-5c1a7a6b29bf service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:20.697554 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-c7c95068-f3f6-49fc-ac32-28b16f966c0c req-af8d5dd5-88f4-4635-979f-5c1a7a6b29bf service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:20.708379 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.compute.server_external_events [req-c7c95068-f3f6-49fc-ac32-28b16f966c0c req-af8d5dd5-88f4-4635-979f-5c1a7a6b29bf service nova] Creating event network-vif-unplugged:b5e81396-e117-425e-887b-37001fc73ed9 for instance 30a141ef-390c-4d75-94ba-c3112c06bc39 on hv-cinder-78662 Aug 25 05:40:20.718801 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [req-c7c95068-f3f6-49fc-ac32-28b16f966c0c req-af8d5dd5-88f4-4635-979f-5c1a7a6b29bf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030821 Aug 25 05:40:20.718801 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 476/976] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:40:20 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:40:20.788548 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-923f8b4c-1d61-4867-8756-91482e674d03 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:20.789465 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-923f8b4c-1d61-4867-8756-91482e674d03 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:20.795527 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-923f8b4c-1d61-4867-8756-91482e674d03 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:20.795967 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-923f8b4c-1d61-4867-8756-91482e674d03 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:20.796726 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-923f8b4c-1d61-4867-8756-91482e674d03 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:20.797156 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-923f8b4c-1d61-4867-8756-91482e674d03 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:20.837793 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-923f8b4c-1d61-4867-8756-91482e674d03 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052943 Aug 25 05:40:20.838407 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 501/977] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:20 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:20.962219 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-2c76126d-8250-4a5e-b445-d35a0b74125b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:20.962948 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-2c76126d-8250-4a5e-b445-d35a0b74125b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:20.969018 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2c76126d-8250-4a5e-b445-d35a0b74125b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:20.969449 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2c76126d-8250-4a5e-b445-d35a0b74125b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:20.970223 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2c76126d-8250-4a5e-b445-d35a0b74125b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:20.970691 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2c76126d-8250-4a5e-b445-d35a0b74125b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:21.095564 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-2c76126d-8250-4a5e-b445-d35a0b74125b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:21.103956 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-2c76126d-8250-4a5e-b445-d35a0b74125b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.145900 Aug 25 05:40:21.104511 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 477/978] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:20 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:40:21.849372 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2156afcf-2131-4ef8-9824-b6fd4af92dc1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:21.850330 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2156afcf-2131-4ef8-9824-b6fd4af92dc1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:21.856967 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2156afcf-2131-4ef8-9824-b6fd4af92dc1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:21.857408 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2156afcf-2131-4ef8-9824-b6fd4af92dc1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:21.858184 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2156afcf-2131-4ef8-9824-b6fd4af92dc1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:21.858609 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2156afcf-2131-4ef8-9824-b6fd4af92dc1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:21.887855 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2156afcf-2131-4ef8-9824-b6fd4af92dc1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042283 Aug 25 05:40:21.888404 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 502/979] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:21 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:22.122066 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ace6dae9-7f11-4bcc-ba22-b6f1750af52f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:22.122614 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ace6dae9-7f11-4bcc-ba22-b6f1750af52f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:22.128575 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ace6dae9-7f11-4bcc-ba22-b6f1750af52f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:22.129014 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ace6dae9-7f11-4bcc-ba22-b6f1750af52f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:22.129849 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ace6dae9-7f11-4bcc-ba22-b6f1750af52f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:22.130277 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ace6dae9-7f11-4bcc-ba22-b6f1750af52f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:22.253677 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ace6dae9-7f11-4bcc-ba22-b6f1750af52f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:22.261669 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ace6dae9-7f11-4bcc-ba22-b6f1750af52f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.144060 Aug 25 05:40:22.262227 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 478/980] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:22 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:40:22.900206 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-21532596-6c12-4e61-80e3-3ce1ab6367f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:22.901017 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-21532596-6c12-4e61-80e3-3ce1ab6367f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:22.907122 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-21532596-6c12-4e61-80e3-3ce1ab6367f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:22.907559 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-21532596-6c12-4e61-80e3-3ce1ab6367f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:22.908315 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-21532596-6c12-4e61-80e3-3ce1ab6367f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:22.908774 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-21532596-6c12-4e61-80e3-3ce1ab6367f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:22.938521 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-21532596-6c12-4e61-80e3-3ce1ab6367f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042866 Aug 25 05:40:22.939073 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 503/981] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:22 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:23.278917 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6daa697f-25c4-47ac-92ed-b54f8f5dfc35 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:23.279477 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6daa697f-25c4-47ac-92ed-b54f8f5dfc35 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:23.285300 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6daa697f-25c4-47ac-92ed-b54f8f5dfc35 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:23.285757 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6daa697f-25c4-47ac-92ed-b54f8f5dfc35 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:23.286519 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6daa697f-25c4-47ac-92ed-b54f8f5dfc35 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:23.286948 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6daa697f-25c4-47ac-92ed-b54f8f5dfc35 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:23.411850 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6daa697f-25c4-47ac-92ed-b54f8f5dfc35 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:23.420204 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6daa697f-25c4-47ac-92ed-b54f8f5dfc35 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.145450 Aug 25 05:40:23.420780 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 479/982] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:23 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:40:23.951047 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-fc76a511-d26f-49e3-b1fa-2169ef85fa91 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:23.951859 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-fc76a511-d26f-49e3-b1fa-2169ef85fa91 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:23.957748 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fc76a511-d26f-49e3-b1fa-2169ef85fa91 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:23.958198 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fc76a511-d26f-49e3-b1fa-2169ef85fa91 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:23.958963 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fc76a511-d26f-49e3-b1fa-2169ef85fa91 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:23.959398 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fc76a511-d26f-49e3-b1fa-2169ef85fa91 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:23.988919 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-fc76a511-d26f-49e3-b1fa-2169ef85fa91 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041783 Aug 25 05:40:23.989464 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 504/983] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:23 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:24.436931 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c264a36b-9466-4dec-bf2a-261956428d75 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:24.437571 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c264a36b-9466-4dec-bf2a-261956428d75 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:24.443709 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c264a36b-9466-4dec-bf2a-261956428d75 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:24.444150 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c264a36b-9466-4dec-bf2a-261956428d75 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:24.444926 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c264a36b-9466-4dec-bf2a-261956428d75 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:24.445347 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c264a36b-9466-4dec-bf2a-261956428d75 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:24.575513 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-c264a36b-9466-4dec-bf2a-261956428d75 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:24.583184 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c264a36b-9466-4dec-bf2a-261956428d75 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.149849 Aug 25 05:40:24.583756 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 480/984] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:24 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:40:25.005808 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-707e29bc-3cbe-4e96-b252-82645245fb12 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:25.007363 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-707e29bc-3cbe-4e96-b252-82645245fb12 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:25.017573 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-707e29bc-3cbe-4e96-b252-82645245fb12 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:25.018347 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-707e29bc-3cbe-4e96-b252-82645245fb12 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:25.019645 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-707e29bc-3cbe-4e96-b252-82645245fb12 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:25.020393 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-707e29bc-3cbe-4e96-b252-82645245fb12 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:25.061827 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-707e29bc-3cbe-4e96-b252-82645245fb12 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062926 Aug 25 05:40:25.062380 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 505/985] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:24 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:25.601130 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-2b9913ef-ad26-4806-a364-16a4b96cf6ac tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:25.601803 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-2b9913ef-ad26-4806-a364-16a4b96cf6ac tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:25.607744 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2b9913ef-ad26-4806-a364-16a4b96cf6ac tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:25.608208 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2b9913ef-ad26-4806-a364-16a4b96cf6ac tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:25.608966 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2b9913ef-ad26-4806-a364-16a4b96cf6ac tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:25.609391 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2b9913ef-ad26-4806-a364-16a4b96cf6ac tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:25.731452 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-2b9913ef-ad26-4806-a364-16a4b96cf6ac tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:25.738768 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-2b9913ef-ad26-4806-a364-16a4b96cf6ac tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.141281 Aug 25 05:40:25.739328 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 481/986] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:25 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:40:26.074352 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-4fe8d54c-eadf-4ff0-8be0-c4324a7175f2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:26.075671 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-4fe8d54c-eadf-4ff0-8be0-c4324a7175f2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:26.082697 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4fe8d54c-eadf-4ff0-8be0-c4324a7175f2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:26.083306 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4fe8d54c-eadf-4ff0-8be0-c4324a7175f2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:26.084311 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4fe8d54c-eadf-4ff0-8be0-c4324a7175f2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:26.084826 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4fe8d54c-eadf-4ff0-8be0-c4324a7175f2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:26.114759 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-4fe8d54c-eadf-4ff0-8be0-c4324a7175f2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044978 Aug 25 05:40:26.115312 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 506/987] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:26 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:26.755619 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e7dda4d8-972f-4169-a312-e965d4050dcd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:26.756236 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e7dda4d8-972f-4169-a312-e965d4050dcd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:26.762545 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e7dda4d8-972f-4169-a312-e965d4050dcd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:26.762996 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e7dda4d8-972f-4169-a312-e965d4050dcd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:26.763832 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e7dda4d8-972f-4169-a312-e965d4050dcd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:26.764269 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e7dda4d8-972f-4169-a312-e965d4050dcd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:26.889867 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e7dda4d8-972f-4169-a312-e965d4050dcd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:26.897701 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e7dda4d8-972f-4169-a312-e965d4050dcd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.145800 Aug 25 05:40:26.898272 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 482/988] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:26 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:40:27.126908 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f5f4895f-e5d0-44ea-9f20-2d397d3ee3cf tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:27.127756 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f5f4895f-e5d0-44ea-9f20-2d397d3ee3cf tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:27.133671 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f5f4895f-e5d0-44ea-9f20-2d397d3ee3cf tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:27.134108 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f5f4895f-e5d0-44ea-9f20-2d397d3ee3cf tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:27.134863 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f5f4895f-e5d0-44ea-9f20-2d397d3ee3cf tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:27.135285 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f5f4895f-e5d0-44ea-9f20-2d397d3ee3cf tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:27.165078 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f5f4895f-e5d0-44ea-9f20-2d397d3ee3cf tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042054 Aug 25 05:40:27.165635 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 507/989] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:27 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:27.917459 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1f1af8de-e397-43b1-81b5-83ad4b235892 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:27.918127 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1f1af8de-e397-43b1-81b5-83ad4b235892 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:27.924557 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1f1af8de-e397-43b1-81b5-83ad4b235892 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:27.925019 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1f1af8de-e397-43b1-81b5-83ad4b235892 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:27.925812 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1f1af8de-e397-43b1-81b5-83ad4b235892 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:27.926239 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1f1af8de-e397-43b1-81b5-83ad4b235892 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:28.054533 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-1f1af8de-e397-43b1-81b5-83ad4b235892 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:28.062589 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1f1af8de-e397-43b1-81b5-83ad4b235892 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.150605 Aug 25 05:40:28.063152 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 483/990] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:27 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:40:28.176903 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e8af639d-5f65-4c93-a0dd-5f905b87667d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:28.177736 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e8af639d-5f65-4c93-a0dd-5f905b87667d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:28.183903 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e8af639d-5f65-4c93-a0dd-5f905b87667d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:28.184341 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e8af639d-5f65-4c93-a0dd-5f905b87667d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:28.185089 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e8af639d-5f65-4c93-a0dd-5f905b87667d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:28.185513 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e8af639d-5f65-4c93-a0dd-5f905b87667d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:28.213343 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e8af639d-5f65-4c93-a0dd-5f905b87667d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040318 Aug 25 05:40:28.214478 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 508/991] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:28 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:29.079248 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a77f0ff4-884d-47bd-a7ad-1d16357c04bb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:29.079855 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a77f0ff4-884d-47bd-a7ad-1d16357c04bb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:29.085740 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a77f0ff4-884d-47bd-a7ad-1d16357c04bb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:29.086181 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a77f0ff4-884d-47bd-a7ad-1d16357c04bb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:29.086938 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a77f0ff4-884d-47bd-a7ad-1d16357c04bb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:29.087361 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a77f0ff4-884d-47bd-a7ad-1d16357c04bb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:29.208039 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-a77f0ff4-884d-47bd-a7ad-1d16357c04bb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:29.215871 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a77f0ff4-884d-47bd-a7ad-1d16357c04bb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.140238 Aug 25 05:40:29.216426 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 484/992] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:29 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:40:29.225245 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a5bc96f9-f5b3-4889-b318-acbadeb601fd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:29.226178 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a5bc96f9-f5b3-4889-b318-acbadeb601fd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:29.232168 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a5bc96f9-f5b3-4889-b318-acbadeb601fd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:29.232608 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a5bc96f9-f5b3-4889-b318-acbadeb601fd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:29.233367 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a5bc96f9-f5b3-4889-b318-acbadeb601fd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:29.233821 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a5bc96f9-f5b3-4889-b318-acbadeb601fd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:29.265124 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a5bc96f9-f5b3-4889-b318-acbadeb601fd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043498 Aug 25 05:40:29.266115 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 509/993] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:29 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:40:30.233479 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5fdfff9d-39e0-4b80-aebb-430d2ca627c4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:30.234172 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5fdfff9d-39e0-4b80-aebb-430d2ca627c4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:30.239920 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5fdfff9d-39e0-4b80-aebb-430d2ca627c4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:30.240366 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5fdfff9d-39e0-4b80-aebb-430d2ca627c4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:30.241131 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5fdfff9d-39e0-4b80-aebb-430d2ca627c4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:30.241593 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5fdfff9d-39e0-4b80-aebb-430d2ca627c4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:30.276323 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7744c228-14f5-41fc-ae06-0907d904f7ff tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:30.277322 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-7744c228-14f5-41fc-ae06-0907d904f7ff tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:30.283718 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7744c228-14f5-41fc-ae06-0907d904f7ff tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:30.284164 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7744c228-14f5-41fc-ae06-0907d904f7ff tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:30.284936 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7744c228-14f5-41fc-ae06-0907d904f7ff tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:30.285362 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7744c228-14f5-41fc-ae06-0907d904f7ff tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:30.315745 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-7744c228-14f5-41fc-ae06-0907d904f7ff tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043190 Aug 25 05:40:30.316335 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 510/994] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:30 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:40:30.371521 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-5fdfff9d-39e0-4b80-aebb-430d2ca627c4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:30.378735 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5fdfff9d-39e0-4b80-aebb-430d2ca627c4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.149752 Aug 25 05:40:30.379307 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 485/995] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:30 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:40:31.327435 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-91c95a51-84dc-4a6b-9502-cffd4224fb16 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:31.328241 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-91c95a51-84dc-4a6b-9502-cffd4224fb16 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:31.334102 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-91c95a51-84dc-4a6b-9502-cffd4224fb16 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:31.335839 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-91c95a51-84dc-4a6b-9502-cffd4224fb16 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:31.335839 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-91c95a51-84dc-4a6b-9502-cffd4224fb16 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:31.335839 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-91c95a51-84dc-4a6b-9502-cffd4224fb16 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:31.365719 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-91c95a51-84dc-4a6b-9502-cffd4224fb16 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042288 Aug 25 05:40:31.366267 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 511/996] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:31 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:31.395315 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d19dbb9b-f214-46e9-992a-090cf795e80b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:31.395917 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-d19dbb9b-f214-46e9-992a-090cf795e80b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:31.403051 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d19dbb9b-f214-46e9-992a-090cf795e80b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:31.403498 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d19dbb9b-f214-46e9-992a-090cf795e80b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:31.404263 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d19dbb9b-f214-46e9-992a-090cf795e80b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:31.404721 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d19dbb9b-f214-46e9-992a-090cf795e80b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:31.525091 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-d19dbb9b-f214-46e9-992a-090cf795e80b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:31.533641 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d19dbb9b-f214-46e9-992a-090cf795e80b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.141886 Aug 25 05:40:31.534222 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 486/997] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:31 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:40:32.377098 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-fd569715-03f3-4165-93c4-bf558cab335c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:32.378658 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-fd569715-03f3-4165-93c4-bf558cab335c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:32.387691 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fd569715-03f3-4165-93c4-bf558cab335c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:32.388174 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fd569715-03f3-4165-93c4-bf558cab335c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:32.389116 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fd569715-03f3-4165-93c4-bf558cab335c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:32.389554 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fd569715-03f3-4165-93c4-bf558cab335c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:32.430920 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-fd569715-03f3-4165-93c4-bf558cab335c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057747 Aug 25 05:40:32.431495 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 512/998] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:32 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:32.550811 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-9e6ec7c6-5848-417f-999a-19e71949d742 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:32.551416 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-9e6ec7c6-5848-417f-999a-19e71949d742 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:32.558029 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9e6ec7c6-5848-417f-999a-19e71949d742 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:32.558707 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9e6ec7c6-5848-417f-999a-19e71949d742 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:32.559477 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9e6ec7c6-5848-417f-999a-19e71949d742 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:32.560118 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9e6ec7c6-5848-417f-999a-19e71949d742 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:32.691510 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-9e6ec7c6-5848-417f-999a-19e71949d742 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:32.699223 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-9e6ec7c6-5848-417f-999a-19e71949d742 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.152025 Aug 25 05:40:32.699935 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 487/999] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:32 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:40:33.443542 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9b30f013-ecb1-423f-a673-fbb290697a3c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:33.444443 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9b30f013-ecb1-423f-a673-fbb290697a3c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:33.451124 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9b30f013-ecb1-423f-a673-fbb290697a3c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:33.451571 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9b30f013-ecb1-423f-a673-fbb290697a3c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:33.452347 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9b30f013-ecb1-423f-a673-fbb290697a3c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:33.452781 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9b30f013-ecb1-423f-a673-fbb290697a3c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:33.484005 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9b30f013-ecb1-423f-a673-fbb290697a3c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044215 Aug 25 05:40:33.484569 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 513/1000] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:33 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:33.720017 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-0711ec75-f932-4e71-9123-6274db80632b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:33.721705 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-0711ec75-f932-4e71-9123-6274db80632b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:33.730265 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0711ec75-f932-4e71-9123-6274db80632b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:33.730718 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0711ec75-f932-4e71-9123-6274db80632b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:33.731505 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0711ec75-f932-4e71-9123-6274db80632b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:33.731937 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0711ec75-f932-4e71-9123-6274db80632b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:33.864620 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-0711ec75-f932-4e71-9123-6274db80632b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:33.874232 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-0711ec75-f932-4e71-9123-6274db80632b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.162098 Aug 25 05:40:33.874839 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 488/1001] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:33 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:40:34.496430 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-3ccba1fc-91ac-4681-8bee-7bc1f5ca5d80 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:34.497312 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-3ccba1fc-91ac-4681-8bee-7bc1f5ca5d80 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:34.503250 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3ccba1fc-91ac-4681-8bee-7bc1f5ca5d80 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:34.503686 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3ccba1fc-91ac-4681-8bee-7bc1f5ca5d80 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:34.504444 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3ccba1fc-91ac-4681-8bee-7bc1f5ca5d80 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:34.504910 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3ccba1fc-91ac-4681-8bee-7bc1f5ca5d80 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:34.536253 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-3ccba1fc-91ac-4681-8bee-7bc1f5ca5d80 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044059 Aug 25 05:40:34.536826 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 514/1002] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:34 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:34.892024 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8bcd8dba-9ba4-4600-8545-9171be551b68 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:34.892637 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8bcd8dba-9ba4-4600-8545-9171be551b68 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:34.898786 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8bcd8dba-9ba4-4600-8545-9171be551b68 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:34.899224 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8bcd8dba-9ba4-4600-8545-9171be551b68 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:34.899986 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8bcd8dba-9ba4-4600-8545-9171be551b68 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:34.900416 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8bcd8dba-9ba4-4600-8545-9171be551b68 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:35.033298 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-8bcd8dba-9ba4-4600-8545-9171be551b68 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:35.040687 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8bcd8dba-9ba4-4600-8545-9171be551b68 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.152483 Aug 25 05:40:35.041313 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 489/1003] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:34 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:40:35.547083 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b1bde624-e939-4107-846c-a144c10b2308 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:35.547982 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b1bde624-e939-4107-846c-a144c10b2308 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:35.553836 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b1bde624-e939-4107-846c-a144c10b2308 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:35.554279 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b1bde624-e939-4107-846c-a144c10b2308 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:35.555036 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b1bde624-e939-4107-846c-a144c10b2308 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:35.555467 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b1bde624-e939-4107-846c-a144c10b2308 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:35.585324 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b1bde624-e939-4107-846c-a144c10b2308 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041975 Aug 25 05:40:35.585911 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 515/1004] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:35 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:40:36.059973 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b1f30e9c-2b36-4898-91ce-69e416dbe905 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:36.060593 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b1f30e9c-2b36-4898-91ce-69e416dbe905 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:36.066514 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b1f30e9c-2b36-4898-91ce-69e416dbe905 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:36.066959 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b1f30e9c-2b36-4898-91ce-69e416dbe905 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:36.067726 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b1f30e9c-2b36-4898-91ce-69e416dbe905 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:36.068150 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b1f30e9c-2b36-4898-91ce-69e416dbe905 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:36.197761 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-b1f30e9c-2b36-4898-91ce-69e416dbe905 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:36.206131 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b1f30e9c-2b36-4898-91ce-69e416dbe905 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.150829 Aug 25 05:40:36.206710 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 490/1005] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:36 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:40:36.597701 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5fc9cfc0-917d-4db5-95a3-8a61797a3f53 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:36.598643 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5fc9cfc0-917d-4db5-95a3-8a61797a3f53 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:36.605258 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5fc9cfc0-917d-4db5-95a3-8a61797a3f53 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:36.605737 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5fc9cfc0-917d-4db5-95a3-8a61797a3f53 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:36.606494 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5fc9cfc0-917d-4db5-95a3-8a61797a3f53 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:36.606917 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5fc9cfc0-917d-4db5-95a3-8a61797a3f53 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:36.637440 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5fc9cfc0-917d-4db5-95a3-8a61797a3f53 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043656 Aug 25 05:40:36.638251 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 516/1006] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:36 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:37.223199 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-957294a1-ac25-4683-b965-cc335cd7e67d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:37.223824 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-957294a1-ac25-4683-b965-cc335cd7e67d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:37.229753 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-957294a1-ac25-4683-b965-cc335cd7e67d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:37.230202 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-957294a1-ac25-4683-b965-cc335cd7e67d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:37.230988 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-957294a1-ac25-4683-b965-cc335cd7e67d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:37.231488 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-957294a1-ac25-4683-b965-cc335cd7e67d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:37.362177 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-957294a1-ac25-4683-b965-cc335cd7e67d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:37.369936 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-957294a1-ac25-4683-b965-cc335cd7e67d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.150259 Aug 25 05:40:37.370509 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 491/1007] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:37 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:40:37.649318 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6c154e57-e7c1-4e40-948a-01ead6b52c69 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:37.650317 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6c154e57-e7c1-4e40-948a-01ead6b52c69 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:37.656597 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6c154e57-e7c1-4e40-948a-01ead6b52c69 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:37.657044 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6c154e57-e7c1-4e40-948a-01ead6b52c69 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:37.657832 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6c154e57-e7c1-4e40-948a-01ead6b52c69 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:37.658259 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6c154e57-e7c1-4e40-948a-01ead6b52c69 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:37.689031 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6c154e57-e7c1-4e40-948a-01ead6b52c69 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043519 Aug 25 05:40:37.689610 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 517/1008] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:37 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:38.392247 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-48a67bb7-13fb-47b6-b8cf-fb7e0c6e29d4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:38.392838 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-48a67bb7-13fb-47b6-b8cf-fb7e0c6e29d4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:38.398884 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-48a67bb7-13fb-47b6-b8cf-fb7e0c6e29d4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:38.399354 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-48a67bb7-13fb-47b6-b8cf-fb7e0c6e29d4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:38.400121 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-48a67bb7-13fb-47b6-b8cf-fb7e0c6e29d4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:38.400542 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-48a67bb7-13fb-47b6-b8cf-fb7e0c6e29d4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:38.529957 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-48a67bb7-13fb-47b6-b8cf-fb7e0c6e29d4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:38.537691 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-48a67bb7-13fb-47b6-b8cf-fb7e0c6e29d4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.149072 Aug 25 05:40:38.538266 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 492/1009] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:38 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:40:38.702085 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-3606992f-1328-4f89-a522-e6d24f864c7a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:38.702938 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-3606992f-1328-4f89-a522-e6d24f864c7a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:38.709349 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3606992f-1328-4f89-a522-e6d24f864c7a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:38.709827 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3606992f-1328-4f89-a522-e6d24f864c7a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:38.710611 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3606992f-1328-4f89-a522-e6d24f864c7a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:38.711045 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3606992f-1328-4f89-a522-e6d24f864c7a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:38.743449 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-3606992f-1328-4f89-a522-e6d24f864c7a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045977 Aug 25 05:40:38.744031 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 518/1010] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:38 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:39.555236 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-fd18e872-2e8d-4043-87b6-0f60b84bc0f6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:39.555849 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-fd18e872-2e8d-4043-87b6-0f60b84bc0f6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:39.562524 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fd18e872-2e8d-4043-87b6-0f60b84bc0f6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:39.562968 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fd18e872-2e8d-4043-87b6-0f60b84bc0f6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:39.563744 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fd18e872-2e8d-4043-87b6-0f60b84bc0f6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:39.564205 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fd18e872-2e8d-4043-87b6-0f60b84bc0f6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:39.688630 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-fd18e872-2e8d-4043-87b6-0f60b84bc0f6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:39.696074 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-fd18e872-2e8d-4043-87b6-0f60b84bc0f6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.144516 Aug 25 05:40:39.696627 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 493/1011] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:39 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:40:39.756170 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-62e41d6b-d09b-4e14-a4ee-434508474923 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:39.757081 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-62e41d6b-d09b-4e14-a4ee-434508474923 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:39.763385 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-62e41d6b-d09b-4e14-a4ee-434508474923 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:39.763825 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-62e41d6b-d09b-4e14-a4ee-434508474923 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:39.764598 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-62e41d6b-d09b-4e14-a4ee-434508474923 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:39.765028 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-62e41d6b-d09b-4e14-a4ee-434508474923 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:39.806176 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-62e41d6b-d09b-4e14-a4ee-434508474923 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054071 Aug 25 05:40:39.806753 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 519/1012] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:39 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:40.713821 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d80169c2-0bd6-4b56-86a5-e591c713dc51 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:40.714424 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-d80169c2-0bd6-4b56-86a5-e591c713dc51 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:40.721172 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d80169c2-0bd6-4b56-86a5-e591c713dc51 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:40.721648 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d80169c2-0bd6-4b56-86a5-e591c713dc51 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:40.722404 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d80169c2-0bd6-4b56-86a5-e591c713dc51 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:40.722831 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d80169c2-0bd6-4b56-86a5-e591c713dc51 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:40.818295 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6252cb60-18e8-4c10-a316-acc501064a57 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:40.819196 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6252cb60-18e8-4c10-a316-acc501064a57 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:40.825260 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6252cb60-18e8-4c10-a316-acc501064a57 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:40.826387 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6252cb60-18e8-4c10-a316-acc501064a57 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:40.827284 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6252cb60-18e8-4c10-a316-acc501064a57 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:40.827723 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6252cb60-18e8-4c10-a316-acc501064a57 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:40.853871 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-d80169c2-0bd6-4b56-86a5-e591c713dc51 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:40.858022 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6252cb60-18e8-4c10-a316-acc501064a57 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042590 Aug 25 05:40:40.858233 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 520/1013] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:40 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:40:40.862238 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d80169c2-0bd6-4b56-86a5-e591c713dc51 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.152208 Aug 25 05:40:40.862806 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 494/1014] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:40 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:40:41.869013 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7f93f179-9abc-4f1b-b38d-527276289fcb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:41.869975 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-7f93f179-9abc-4f1b-b38d-527276289fcb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:41.876137 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7f93f179-9abc-4f1b-b38d-527276289fcb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:41.876583 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7f93f179-9abc-4f1b-b38d-527276289fcb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:41.877345 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7f93f179-9abc-4f1b-b38d-527276289fcb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:41.877811 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7f93f179-9abc-4f1b-b38d-527276289fcb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:41.879003 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-4a050882-21d1-4f43-80bb-4ed312bf78c5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:41.879612 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-4a050882-21d1-4f43-80bb-4ed312bf78c5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:41.885291 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4a050882-21d1-4f43-80bb-4ed312bf78c5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:41.885773 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4a050882-21d1-4f43-80bb-4ed312bf78c5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:41.886540 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4a050882-21d1-4f43-80bb-4ed312bf78c5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:41.886967 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4a050882-21d1-4f43-80bb-4ed312bf78c5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:41.908053 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-7f93f179-9abc-4f1b-b38d-527276289fcb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042749 Aug 25 05:40:41.908615 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 521/1015] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:41 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:42.059744 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-4a050882-21d1-4f43-80bb-4ed312bf78c5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:42.067610 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-4a050882-21d1-4f43-80bb-4ed312bf78c5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.192255 Aug 25 05:40:42.068174 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 495/1016] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:41 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:40:42.919788 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-86a63db2-3062-4bf1-bb6c-d4bd2aa89d0b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:42.921184 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-86a63db2-3062-4bf1-bb6c-d4bd2aa89d0b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:42.927295 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-86a63db2-3062-4bf1-bb6c-d4bd2aa89d0b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:42.927742 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-86a63db2-3062-4bf1-bb6c-d4bd2aa89d0b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:42.928507 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-86a63db2-3062-4bf1-bb6c-d4bd2aa89d0b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:42.928940 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-86a63db2-3062-4bf1-bb6c-d4bd2aa89d0b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:42.958423 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-86a63db2-3062-4bf1-bb6c-d4bd2aa89d0b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042546 Aug 25 05:40:42.959031 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 522/1017] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:42 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:43.085066 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-77160ee1-876d-4fa2-938f-1ab0de27bf04 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:43.085737 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-77160ee1-876d-4fa2-938f-1ab0de27bf04 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:43.091589 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-77160ee1-876d-4fa2-938f-1ab0de27bf04 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:43.092547 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-77160ee1-876d-4fa2-938f-1ab0de27bf04 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:43.093479 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-77160ee1-876d-4fa2-938f-1ab0de27bf04 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:43.093931 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-77160ee1-876d-4fa2-938f-1ab0de27bf04 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:43.223551 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-77160ee1-876d-4fa2-938f-1ab0de27bf04 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:43.231023 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-77160ee1-876d-4fa2-938f-1ab0de27bf04 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.149784 Aug 25 05:40:43.231581 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 496/1018] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:43 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:40:43.970070 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7a67bb58-f84b-4010-9ba4-33e07fe27753 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:43.970905 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-7a67bb58-f84b-4010-9ba4-33e07fe27753 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:43.976693 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7a67bb58-f84b-4010-9ba4-33e07fe27753 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:43.977122 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7a67bb58-f84b-4010-9ba4-33e07fe27753 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:43.977901 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7a67bb58-f84b-4010-9ba4-33e07fe27753 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:43.978328 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7a67bb58-f84b-4010-9ba4-33e07fe27753 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:44.007685 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-7a67bb58-f84b-4010-9ba4-33e07fe27753 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041468 Aug 25 05:40:44.008231 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 523/1019] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:43 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:44.249289 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-279e9191-1c0e-4cd1-bcb9-9cb745920080 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:44.249845 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-279e9191-1c0e-4cd1-bcb9-9cb745920080 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:44.255944 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-279e9191-1c0e-4cd1-bcb9-9cb745920080 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:44.256389 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-279e9191-1c0e-4cd1-bcb9-9cb745920080 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:44.257182 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-279e9191-1c0e-4cd1-bcb9-9cb745920080 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:44.257653 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-279e9191-1c0e-4cd1-bcb9-9cb745920080 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:44.382205 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-279e9191-1c0e-4cd1-bcb9-9cb745920080 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:44.389400 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-279e9191-1c0e-4cd1-bcb9-9cb745920080 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.144473 Aug 25 05:40:44.389979 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 497/1020] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:44 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:40:45.020174 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-bd2bbd68-271d-4d90-91f9-b933a6c67ce3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:45.021137 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-bd2bbd68-271d-4d90-91f9-b933a6c67ce3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:45.027085 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bd2bbd68-271d-4d90-91f9-b933a6c67ce3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:45.027781 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bd2bbd68-271d-4d90-91f9-b933a6c67ce3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:45.028602 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bd2bbd68-271d-4d90-91f9-b933a6c67ce3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:45.029034 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bd2bbd68-271d-4d90-91f9-b933a6c67ce3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:45.058705 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-bd2bbd68-271d-4d90-91f9-b933a6c67ce3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042315 Aug 25 05:40:45.059252 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 524/1021] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:45 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:40:45.406436 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b4d561bd-aabe-47df-aad4-d4c2632d80d5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:45.407045 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b4d561bd-aabe-47df-aad4-d4c2632d80d5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:45.412891 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b4d561bd-aabe-47df-aad4-d4c2632d80d5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:45.413329 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b4d561bd-aabe-47df-aad4-d4c2632d80d5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:45.414112 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b4d561bd-aabe-47df-aad4-d4c2632d80d5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:45.414537 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b4d561bd-aabe-47df-aad4-d4c2632d80d5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:45.539577 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-b4d561bd-aabe-47df-aad4-d4c2632d80d5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:45.546921 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b4d561bd-aabe-47df-aad4-d4c2632d80d5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.144371 Aug 25 05:40:45.547449 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 498/1022] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:45 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:40:46.070350 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f5febb0c-7b8c-48e7-b776-2f29a54d18d4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:46.071253 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f5febb0c-7b8c-48e7-b776-2f29a54d18d4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:46.077334 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f5febb0c-7b8c-48e7-b776-2f29a54d18d4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:46.077816 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f5febb0c-7b8c-48e7-b776-2f29a54d18d4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:46.078595 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f5febb0c-7b8c-48e7-b776-2f29a54d18d4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:46.079062 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f5febb0c-7b8c-48e7-b776-2f29a54d18d4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:46.115897 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f5febb0c-7b8c-48e7-b776-2f29a54d18d4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045797 Aug 25 05:40:46.116509 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 525/1023] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:46 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:46.564235 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-15945d3a-107f-4923-ad8b-5e2de4a9bafc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:46.564843 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-15945d3a-107f-4923-ad8b-5e2de4a9bafc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:46.571011 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-15945d3a-107f-4923-ad8b-5e2de4a9bafc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:46.571456 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-15945d3a-107f-4923-ad8b-5e2de4a9bafc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:46.572239 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-15945d3a-107f-4923-ad8b-5e2de4a9bafc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:46.572662 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-15945d3a-107f-4923-ad8b-5e2de4a9bafc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:46.695042 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-15945d3a-107f-4923-ad8b-5e2de4a9bafc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:46.702811 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-15945d3a-107f-4923-ad8b-5e2de4a9bafc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.141931 Aug 25 05:40:46.703450 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 499/1024] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:46 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:40:47.127581 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f4cc9d8c-585d-4009-98c4-ff6f25b30cd4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:47.128504 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f4cc9d8c-585d-4009-98c4-ff6f25b30cd4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:47.134541 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f4cc9d8c-585d-4009-98c4-ff6f25b30cd4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:47.134985 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f4cc9d8c-585d-4009-98c4-ff6f25b30cd4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:47.135736 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f4cc9d8c-585d-4009-98c4-ff6f25b30cd4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:47.136195 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f4cc9d8c-585d-4009-98c4-ff6f25b30cd4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:47.166695 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f4cc9d8c-585d-4009-98c4-ff6f25b30cd4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042936 Aug 25 05:40:47.167240 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 526/1025] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:47 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:47.824448 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-52009ee4-7f47-49e3-8b34-d3c9bc5ac5e5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:47.830438 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-52009ee4-7f47-49e3-8b34-d3c9bc5ac5e5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:47.832401 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-52009ee4-7f47-49e3-8b34-d3c9bc5ac5e5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:47.832857 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-52009ee4-7f47-49e3-8b34-d3c9bc5ac5e5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:47.833682 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-52009ee4-7f47-49e3-8b34-d3c9bc5ac5e5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:47.834120 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-52009ee4-7f47-49e3-8b34-d3c9bc5ac5e5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:47.961265 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-52009ee4-7f47-49e3-8b34-d3c9bc5ac5e5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:47.968513 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-52009ee4-7f47-49e3-8b34-d3c9bc5ac5e5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.253274 Aug 25 05:40:47.969077 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 500/1026] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:47 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:40:48.178303 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b261fb21-2e92-44f1-af54-7203a914eaf0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:48.179200 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b261fb21-2e92-44f1-af54-7203a914eaf0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:48.185041 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b261fb21-2e92-44f1-af54-7203a914eaf0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:48.185480 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b261fb21-2e92-44f1-af54-7203a914eaf0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:48.186266 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b261fb21-2e92-44f1-af54-7203a914eaf0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:48.187334 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b261fb21-2e92-44f1-af54-7203a914eaf0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:48.217544 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b261fb21-2e92-44f1-af54-7203a914eaf0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042975 Aug 25 05:40:48.218724 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 527/1027] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:48 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:48.985899 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8d790b65-e9b3-4608-a4f1-a5c24ec40ca2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:48.986433 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8d790b65-e9b3-4608-a4f1-a5c24ec40ca2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:48.992280 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8d790b65-e9b3-4608-a4f1-a5c24ec40ca2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:48.992719 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8d790b65-e9b3-4608-a4f1-a5c24ec40ca2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:48.993472 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8d790b65-e9b3-4608-a4f1-a5c24ec40ca2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:48.993921 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8d790b65-e9b3-4608-a4f1-a5c24ec40ca2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:49.136922 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-8d790b65-e9b3-4608-a4f1-a5c24ec40ca2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:49.144306 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8d790b65-e9b3-4608-a4f1-a5c24ec40ca2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.162747 Aug 25 05:40:49.144882 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 501/1028] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:48 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:40:49.229811 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-4a7b1928-a803-43c6-8c97-0ebff23e3172 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:49.230709 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-4a7b1928-a803-43c6-8c97-0ebff23e3172 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:49.237919 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4a7b1928-a803-43c6-8c97-0ebff23e3172 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:49.238248 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4a7b1928-a803-43c6-8c97-0ebff23e3172 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:49.239011 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4a7b1928-a803-43c6-8c97-0ebff23e3172 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:49.239439 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4a7b1928-a803-43c6-8c97-0ebff23e3172 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:49.268752 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-4a7b1928-a803-43c6-8c97-0ebff23e3172 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042741 Aug 25 05:40:49.272262 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 528/1029] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:49 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:50.161218 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-0ced3fa9-b062-4322-9712-7963318754c6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:50.161855 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-0ced3fa9-b062-4322-9712-7963318754c6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:50.167935 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0ced3fa9-b062-4322-9712-7963318754c6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:50.168381 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0ced3fa9-b062-4322-9712-7963318754c6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:50.169214 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0ced3fa9-b062-4322-9712-7963318754c6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:50.169683 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0ced3fa9-b062-4322-9712-7963318754c6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:50.281663 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2afa00ea-a1d3-43f2-bd21-10450c4c7ac4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:50.282595 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2afa00ea-a1d3-43f2-bd21-10450c4c7ac4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:50.288612 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2afa00ea-a1d3-43f2-bd21-10450c4c7ac4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:50.289056 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2afa00ea-a1d3-43f2-bd21-10450c4c7ac4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:50.289910 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2afa00ea-a1d3-43f2-bd21-10450c4c7ac4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:50.290394 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2afa00ea-a1d3-43f2-bd21-10450c4c7ac4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:50.291285 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-0ced3fa9-b062-4322-9712-7963318754c6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:50.298787 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-0ced3fa9-b062-4322-9712-7963318754c6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.141220 Aug 25 05:40:50.299362 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 502/1030] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:50 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:40:50.320817 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2afa00ea-a1d3-43f2-bd21-10450c4c7ac4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043038 Aug 25 05:40:50.321363 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 529/1031] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:50 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:40:51.316917 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-714e1219-eef3-4845-965e-1fc016fb3f05 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:51.317569 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-714e1219-eef3-4845-965e-1fc016fb3f05 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:51.323645 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-714e1219-eef3-4845-965e-1fc016fb3f05 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:51.324085 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-714e1219-eef3-4845-965e-1fc016fb3f05 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:51.324841 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-714e1219-eef3-4845-965e-1fc016fb3f05 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:51.325263 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-714e1219-eef3-4845-965e-1fc016fb3f05 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:51.332694 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f21a8dca-31c2-4164-90b5-3b39cc5d8263 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:51.333737 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f21a8dca-31c2-4164-90b5-3b39cc5d8263 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:51.339908 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f21a8dca-31c2-4164-90b5-3b39cc5d8263 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:51.340356 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f21a8dca-31c2-4164-90b5-3b39cc5d8263 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:51.341131 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f21a8dca-31c2-4164-90b5-3b39cc5d8263 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:51.341593 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f21a8dca-31c2-4164-90b5-3b39cc5d8263 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:51.373273 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f21a8dca-31c2-4164-90b5-3b39cc5d8263 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044373 Aug 25 05:40:51.373885 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 530/1032] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:51 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:51.454558 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-714e1219-eef3-4845-965e-1fc016fb3f05 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:51.463380 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-714e1219-eef3-4845-965e-1fc016fb3f05 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.150518 Aug 25 05:40:51.463956 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 503/1033] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:51 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:40:52.385130 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2dec034b-ec31-4887-978b-b9eb10b6bc5a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:52.386051 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2dec034b-ec31-4887-978b-b9eb10b6bc5a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:52.392391 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2dec034b-ec31-4887-978b-b9eb10b6bc5a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:52.397174 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2dec034b-ec31-4887-978b-b9eb10b6bc5a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:52.397174 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2dec034b-ec31-4887-978b-b9eb10b6bc5a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:52.397174 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2dec034b-ec31-4887-978b-b9eb10b6bc5a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:52.424304 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2dec034b-ec31-4887-978b-b9eb10b6bc5a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042980 Aug 25 05:40:52.425353 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 531/1034] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:52 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:52.480811 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a42e21e8-0e5c-4c72-bf97-155d8b92170a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:52.481420 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a42e21e8-0e5c-4c72-bf97-155d8b92170a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:52.488195 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a42e21e8-0e5c-4c72-bf97-155d8b92170a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:52.489136 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a42e21e8-0e5c-4c72-bf97-155d8b92170a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:52.489451 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a42e21e8-0e5c-4c72-bf97-155d8b92170a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:52.489913 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a42e21e8-0e5c-4c72-bf97-155d8b92170a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:52.615882 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-a42e21e8-0e5c-4c72-bf97-155d8b92170a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:52.623222 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a42e21e8-0e5c-4c72-bf97-155d8b92170a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.146106 Aug 25 05:40:52.623778 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 504/1035] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:52 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:40:53.436463 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-37eac0ce-4930-4ec4-bc73-35aa91d7d131 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:53.437370 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-37eac0ce-4930-4ec4-bc73-35aa91d7d131 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:53.443731 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-37eac0ce-4930-4ec4-bc73-35aa91d7d131 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:53.444175 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-37eac0ce-4930-4ec4-bc73-35aa91d7d131 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:53.445055 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-37eac0ce-4930-4ec4-bc73-35aa91d7d131 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:53.445486 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-37eac0ce-4930-4ec4-bc73-35aa91d7d131 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:53.475063 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-37eac0ce-4930-4ec4-bc73-35aa91d7d131 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042363 Aug 25 05:40:53.475663 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 532/1036] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:53 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:53.641519 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-fd90d8cf-7808-4296-a16e-97f35ef50e2a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:53.642240 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-fd90d8cf-7808-4296-a16e-97f35ef50e2a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:53.649631 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fd90d8cf-7808-4296-a16e-97f35ef50e2a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:53.650124 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fd90d8cf-7808-4296-a16e-97f35ef50e2a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:53.650904 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fd90d8cf-7808-4296-a16e-97f35ef50e2a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:53.651333 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fd90d8cf-7808-4296-a16e-97f35ef50e2a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:53.775563 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-fd90d8cf-7808-4296-a16e-97f35ef50e2a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:53.783112 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-fd90d8cf-7808-4296-a16e-97f35ef50e2a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.145571 Aug 25 05:40:53.783668 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 505/1037] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:53 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:40:54.487500 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b81a6155-3a9a-4b98-807d-cd2721cf7eb9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:54.488462 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b81a6155-3a9a-4b98-807d-cd2721cf7eb9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:54.494578 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b81a6155-3a9a-4b98-807d-cd2721cf7eb9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:54.495015 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b81a6155-3a9a-4b98-807d-cd2721cf7eb9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:54.495762 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b81a6155-3a9a-4b98-807d-cd2721cf7eb9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:54.496187 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b81a6155-3a9a-4b98-807d-cd2721cf7eb9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:54.526656 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b81a6155-3a9a-4b98-807d-cd2721cf7eb9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043614 Aug 25 05:40:54.527490 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 533/1038] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:54 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:54.800870 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-06f204ec-e14e-435a-a4a5-3d355f92baf8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:54.801568 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-06f204ec-e14e-435a-a4a5-3d355f92baf8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:54.809429 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-06f204ec-e14e-435a-a4a5-3d355f92baf8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:54.810103 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-06f204ec-e14e-435a-a4a5-3d355f92baf8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:54.810874 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-06f204ec-e14e-435a-a4a5-3d355f92baf8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:54.811294 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-06f204ec-e14e-435a-a4a5-3d355f92baf8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:54.951948 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-06f204ec-e14e-435a-a4a5-3d355f92baf8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:54.960246 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-06f204ec-e14e-435a-a4a5-3d355f92baf8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.163228 Aug 25 05:40:54.960814 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 506/1039] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:54 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:40:55.538967 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b8d4241a-89e7-4b83-ab59-49fd1c63f2c9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:55.539872 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b8d4241a-89e7-4b83-ab59-49fd1c63f2c9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:55.546103 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b8d4241a-89e7-4b83-ab59-49fd1c63f2c9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:55.546548 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b8d4241a-89e7-4b83-ab59-49fd1c63f2c9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:55.547311 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b8d4241a-89e7-4b83-ab59-49fd1c63f2c9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:55.547740 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b8d4241a-89e7-4b83-ab59-49fd1c63f2c9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:55.578495 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b8d4241a-89e7-4b83-ab59-49fd1c63f2c9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043274 Aug 25 05:40:55.579046 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 534/1040] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:55 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:55.801272 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 05:40:55.801899 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: Wed Aug 25 05:40:55 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 05:40:55.977098 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-99a2df10-9289-40b9-85d8-bdb24c8b11b3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:55.977765 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-99a2df10-9289-40b9-85d8-bdb24c8b11b3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:55.983488 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-99a2df10-9289-40b9-85d8-bdb24c8b11b3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:55.983937 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-99a2df10-9289-40b9-85d8-bdb24c8b11b3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:55.984709 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-99a2df10-9289-40b9-85d8-bdb24c8b11b3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:55.985413 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-99a2df10-9289-40b9-85d8-bdb24c8b11b3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:56.116112 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-99a2df10-9289-40b9-85d8-bdb24c8b11b3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:56.124086 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-99a2df10-9289-40b9-85d8-bdb24c8b11b3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.150692 Aug 25 05:40:56.124666 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 507/1041] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:55 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:40:56.590564 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5b4918d1-ea50-4ccc-b119-4694a1ce4221 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:56.591464 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5b4918d1-ea50-4ccc-b119-4694a1ce4221 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:56.597336 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5b4918d1-ea50-4ccc-b119-4694a1ce4221 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:56.597861 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5b4918d1-ea50-4ccc-b119-4694a1ce4221 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:56.598665 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5b4918d1-ea50-4ccc-b119-4694a1ce4221 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:56.599099 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5b4918d1-ea50-4ccc-b119-4694a1ce4221 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:56.627339 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5b4918d1-ea50-4ccc-b119-4694a1ce4221 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040526 Aug 25 05:40:56.627812 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 535/1042] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:56 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:57.141257 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-81d5e249-2f81-4035-835e-d41348f3340a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:57.141872 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-81d5e249-2f81-4035-835e-d41348f3340a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:57.147958 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-81d5e249-2f81-4035-835e-d41348f3340a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:57.148391 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-81d5e249-2f81-4035-835e-d41348f3340a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:57.149140 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-81d5e249-2f81-4035-835e-d41348f3340a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:57.149601 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-81d5e249-2f81-4035-835e-d41348f3340a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:57.270515 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-81d5e249-2f81-4035-835e-d41348f3340a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:57.278335 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-81d5e249-2f81-4035-835e-d41348f3340a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.140731 Aug 25 05:40:57.278871 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 508/1043] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:57 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:40:57.639981 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a17a97e6-a314-4ba3-a07f-6803738776eb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:57.640879 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a17a97e6-a314-4ba3-a07f-6803738776eb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:57.647426 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a17a97e6-a314-4ba3-a07f-6803738776eb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:57.648479 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a17a97e6-a314-4ba3-a07f-6803738776eb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:57.649329 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a17a97e6-a314-4ba3-a07f-6803738776eb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:57.649743 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a17a97e6-a314-4ba3-a07f-6803738776eb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:57.680709 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a17a97e6-a314-4ba3-a07f-6803738776eb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044625 Aug 25 05:40:57.681264 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 536/1044] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:57 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:58.295215 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-eb55d018-458c-4698-8677-3637fe3c7f9f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:58.295821 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-eb55d018-458c-4698-8677-3637fe3c7f9f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:58.302080 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-eb55d018-458c-4698-8677-3637fe3c7f9f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:58.302519 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-eb55d018-458c-4698-8677-3637fe3c7f9f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:58.303776 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-eb55d018-458c-4698-8677-3637fe3c7f9f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:58.304206 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-eb55d018-458c-4698-8677-3637fe3c7f9f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:58.431395 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-eb55d018-458c-4698-8677-3637fe3c7f9f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:58.438983 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-eb55d018-458c-4698-8677-3637fe3c7f9f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.147368 Aug 25 05:40:58.439553 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 509/1045] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:58 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:40:58.692405 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-be091f54-1f3b-43da-8864-71be00eedcbb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:58.693226 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-be091f54-1f3b-43da-8864-71be00eedcbb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:58.699154 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-be091f54-1f3b-43da-8864-71be00eedcbb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:58.699609 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-be091f54-1f3b-43da-8864-71be00eedcbb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:58.700415 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-be091f54-1f3b-43da-8864-71be00eedcbb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:58.700853 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-be091f54-1f3b-43da-8864-71be00eedcbb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:58.730190 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-be091f54-1f3b-43da-8864-71be00eedcbb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041619 Aug 25 05:40:58.730758 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 537/1046] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:58 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:40:59.456277 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-2e9cac95-dbe2-43fd-b53e-527c498989d8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:59.456880 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-2e9cac95-dbe2-43fd-b53e-527c498989d8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:59.463458 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2e9cac95-dbe2-43fd-b53e-527c498989d8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:59.463891 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2e9cac95-dbe2-43fd-b53e-527c498989d8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:59.464645 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2e9cac95-dbe2-43fd-b53e-527c498989d8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:59.465074 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2e9cac95-dbe2-43fd-b53e-527c498989d8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:59.596133 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-2e9cac95-dbe2-43fd-b53e-527c498989d8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:40:59.603864 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-2e9cac95-dbe2-43fd-b53e-527c498989d8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.151234 Aug 25 05:40:59.604510 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 510/1047] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:40:59 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:40:59.742519 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d685a674-3f31-4d7d-bca7-d96421c606ce tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:40:59.743329 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d685a674-3f31-4d7d-bca7-d96421c606ce tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:40:59.749329 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d685a674-3f31-4d7d-bca7-d96421c606ce tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:59.749802 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d685a674-3f31-4d7d-bca7-d96421c606ce tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:59.750566 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d685a674-3f31-4d7d-bca7-d96421c606ce tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:40:59.751000 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d685a674-3f31-4d7d-bca7-d96421c606ce tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:40:59.783867 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d685a674-3f31-4d7d-bca7-d96421c606ce tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045806 Aug 25 05:40:59.784421 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 538/1048] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:40:59 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:00.620583 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-9584c874-0c05-4144-83c4-f017d853a0e8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:00.621180 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-9584c874-0c05-4144-83c4-f017d853a0e8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:00.627040 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9584c874-0c05-4144-83c4-f017d853a0e8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:00.627481 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9584c874-0c05-4144-83c4-f017d853a0e8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:00.628239 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9584c874-0c05-4144-83c4-f017d853a0e8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:00.628669 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9584c874-0c05-4144-83c4-f017d853a0e8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:00.751954 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-9584c874-0c05-4144-83c4-f017d853a0e8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:00.760436 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-9584c874-0c05-4144-83c4-f017d853a0e8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.143446 Aug 25 05:41:00.761231 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 511/1049] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:00 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:00.796462 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-694157c6-ae44-471b-a47f-8f4a94c03cf1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:00.797332 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-694157c6-ae44-471b-a47f-8f4a94c03cf1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:00.804017 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-694157c6-ae44-471b-a47f-8f4a94c03cf1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:00.804570 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-694157c6-ae44-471b-a47f-8f4a94c03cf1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:00.805766 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-694157c6-ae44-471b-a47f-8f4a94c03cf1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:00.806518 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-694157c6-ae44-471b-a47f-8f4a94c03cf1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:00.848976 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-694157c6-ae44-471b-a47f-8f4a94c03cf1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056187 Aug 25 05:41:00.849933 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 539/1050] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:00 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:41:01.779002 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e64b49fa-e31b-41f6-a1bc-fcea48e69822 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:01.779557 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e64b49fa-e31b-41f6-a1bc-fcea48e69822 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:01.785623 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e64b49fa-e31b-41f6-a1bc-fcea48e69822 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:01.786074 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e64b49fa-e31b-41f6-a1bc-fcea48e69822 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:01.786847 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e64b49fa-e31b-41f6-a1bc-fcea48e69822 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:01.787274 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e64b49fa-e31b-41f6-a1bc-fcea48e69822 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:01.864016 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-afbbe497-f889-4e09-93dc-358929ac25ae tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:01.864953 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-afbbe497-f889-4e09-93dc-358929ac25ae tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:01.871144 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-afbbe497-f889-4e09-93dc-358929ac25ae tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:01.871590 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-afbbe497-f889-4e09-93dc-358929ac25ae tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:01.872528 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-afbbe497-f889-4e09-93dc-358929ac25ae tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:01.872963 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-afbbe497-f889-4e09-93dc-358929ac25ae tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:01.904881 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-afbbe497-f889-4e09-93dc-358929ac25ae tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045967 Aug 25 05:41:01.905453 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 540/1051] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:01 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:41:01.931642 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e64b49fa-e31b-41f6-a1bc-fcea48e69822 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:01.938715 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e64b49fa-e31b-41f6-a1bc-fcea48e69822 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.163574 Aug 25 05:41:01.939292 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 512/1052] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:01 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:02.957261 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-985a936e-897d-43bb-8010-666c0e2aa16e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:02.958333 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-985a936e-897d-43bb-8010-666c0e2aa16e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:02.965376 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-985a936e-897d-43bb-8010-666c0e2aa16e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:02.965859 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-985a936e-897d-43bb-8010-666c0e2aa16e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:02.966802 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-985a936e-897d-43bb-8010-666c0e2aa16e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:02.967323 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-985a936e-897d-43bb-8010-666c0e2aa16e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:03.064737 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-25d1f041-8752-4378-b3ce-86d6047c50b2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:03.065913 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-25d1f041-8752-4378-b3ce-86d6047c50b2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:03.072671 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-25d1f041-8752-4378-b3ce-86d6047c50b2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:03.073113 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-25d1f041-8752-4378-b3ce-86d6047c50b2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:03.073941 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-25d1f041-8752-4378-b3ce-86d6047c50b2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:03.074372 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-25d1f041-8752-4378-b3ce-86d6047c50b2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:03.098047 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-985a936e-897d-43bb-8010-666c0e2aa16e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:03.105059 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-25d1f041-8752-4378-b3ce-86d6047c50b2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.192554 Aug 25 05:41:03.105687 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 541/1053] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:02 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:03.106051 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-985a936e-897d-43bb-8010-666c0e2aa16e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.152593 Aug 25 05:41:03.106612 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 513/1054] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:02 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:03.163397 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 05:41:03.163580 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: Wed Aug 25 05:41:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 05:41:04.116432 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6c3a8c89-eadd-4f81-9b2d-9544b6b3366d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:04.117363 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6c3a8c89-eadd-4f81-9b2d-9544b6b3366d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:04.122608 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-dc732d8d-9972-49ac-8da9-e4f70907bcf5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:04.123216 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-dc732d8d-9972-49ac-8da9-e4f70907bcf5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:04.125797 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6c3a8c89-eadd-4f81-9b2d-9544b6b3366d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:04.126467 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6c3a8c89-eadd-4f81-9b2d-9544b6b3366d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:04.131400 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6c3a8c89-eadd-4f81-9b2d-9544b6b3366d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:04.131400 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6c3a8c89-eadd-4f81-9b2d-9544b6b3366d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:04.131699 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dc732d8d-9972-49ac-8da9-e4f70907bcf5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:04.131699 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dc732d8d-9972-49ac-8da9-e4f70907bcf5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:04.131699 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dc732d8d-9972-49ac-8da9-e4f70907bcf5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:04.131699 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dc732d8d-9972-49ac-8da9-e4f70907bcf5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:04.160687 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6c3a8c89-eadd-4f81-9b2d-9544b6b3366d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048087 Aug 25 05:41:04.161589 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 542/1055] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:04 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:04.278750 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-dc732d8d-9972-49ac-8da9-e4f70907bcf5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:04.286158 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-dc732d8d-9972-49ac-8da9-e4f70907bcf5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.167331 Aug 25 05:41:04.286725 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 514/1056] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:04 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:05.172713 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-4598aa42-345a-46d3-bc85-7521a6ecf9ab tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:05.173666 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-4598aa42-345a-46d3-bc85-7521a6ecf9ab tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:05.180144 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4598aa42-345a-46d3-bc85-7521a6ecf9ab tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:05.180713 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4598aa42-345a-46d3-bc85-7521a6ecf9ab tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:05.181536 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4598aa42-345a-46d3-bc85-7521a6ecf9ab tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:05.182038 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4598aa42-345a-46d3-bc85-7521a6ecf9ab tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:05.212820 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-4598aa42-345a-46d3-bc85-7521a6ecf9ab tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043871 Aug 25 05:41:05.213416 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 543/1057] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:05 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:41:05.306208 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ff9b870f-3fda-466f-9479-c05c96df6e67 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:05.306926 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ff9b870f-3fda-466f-9479-c05c96df6e67 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:05.312912 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ff9b870f-3fda-466f-9479-c05c96df6e67 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:05.313355 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ff9b870f-3fda-466f-9479-c05c96df6e67 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:05.314151 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ff9b870f-3fda-466f-9479-c05c96df6e67 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:05.314574 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ff9b870f-3fda-466f-9479-c05c96df6e67 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:05.441512 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ff9b870f-3fda-466f-9479-c05c96df6e67 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:05.451831 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ff9b870f-3fda-466f-9479-c05c96df6e67 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.149694 Aug 25 05:41:05.452402 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 515/1058] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:05 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:06.225726 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-598954f7-f839-4cff-9471-cec460f1a7f3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:06.227657 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-598954f7-f839-4cff-9471-cec460f1a7f3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:06.233480 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-598954f7-f839-4cff-9471-cec460f1a7f3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:06.233955 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-598954f7-f839-4cff-9471-cec460f1a7f3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:06.234721 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-598954f7-f839-4cff-9471-cec460f1a7f3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:06.235261 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-598954f7-f839-4cff-9471-cec460f1a7f3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:06.264539 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-598954f7-f839-4cff-9471-cec460f1a7f3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042491 Aug 25 05:41:06.265082 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 544/1059] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:06 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:06.469862 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1cbd8c7e-6b99-45ad-8832-dbf4334de52d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:06.470475 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1cbd8c7e-6b99-45ad-8832-dbf4334de52d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:06.477194 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1cbd8c7e-6b99-45ad-8832-dbf4334de52d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:06.477756 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1cbd8c7e-6b99-45ad-8832-dbf4334de52d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:06.478535 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1cbd8c7e-6b99-45ad-8832-dbf4334de52d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:06.478973 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1cbd8c7e-6b99-45ad-8832-dbf4334de52d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:06.608907 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-1cbd8c7e-6b99-45ad-8832-dbf4334de52d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:06.616273 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1cbd8c7e-6b99-45ad-8832-dbf4334de52d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.149928 Aug 25 05:41:06.616975 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 516/1060] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:06 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:07.278275 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-be8d47ff-5d88-4254-806f-34c0d0034ca7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:07.279249 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-be8d47ff-5d88-4254-806f-34c0d0034ca7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:07.285202 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-be8d47ff-5d88-4254-806f-34c0d0034ca7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:07.285680 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-be8d47ff-5d88-4254-806f-34c0d0034ca7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:07.286585 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-be8d47ff-5d88-4254-806f-34c0d0034ca7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:07.287016 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-be8d47ff-5d88-4254-806f-34c0d0034ca7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:07.316676 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-be8d47ff-5d88-4254-806f-34c0d0034ca7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042504 Aug 25 05:41:07.317236 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 545/1061] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:07 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:07.635216 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-0b8be6db-43ab-4192-b7c1-1f1fc811124f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:07.635848 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-0b8be6db-43ab-4192-b7c1-1f1fc811124f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:07.641737 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0b8be6db-43ab-4192-b7c1-1f1fc811124f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:07.642180 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0b8be6db-43ab-4192-b7c1-1f1fc811124f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:07.642928 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0b8be6db-43ab-4192-b7c1-1f1fc811124f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:07.643542 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0b8be6db-43ab-4192-b7c1-1f1fc811124f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:07.779196 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-0b8be6db-43ab-4192-b7c1-1f1fc811124f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:07.788352 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-0b8be6db-43ab-4192-b7c1-1f1fc811124f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.156586 Aug 25 05:41:07.789898 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 517/1062] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:07 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:08.329050 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-06bd354c-b2b3-46a3-ae23-7eeda587811d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:08.329964 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-06bd354c-b2b3-46a3-ae23-7eeda587811d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:08.336470 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-06bd354c-b2b3-46a3-ae23-7eeda587811d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:08.337021 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-06bd354c-b2b3-46a3-ae23-7eeda587811d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:08.338012 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-06bd354c-b2b3-46a3-ae23-7eeda587811d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:08.338524 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-06bd354c-b2b3-46a3-ae23-7eeda587811d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:08.369351 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-06bd354c-b2b3-46a3-ae23-7eeda587811d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044039 Aug 25 05:41:08.369933 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 546/1063] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:08 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:08.807363 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-9d22b202-da10-4281-8364-de47eb57dab5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:08.807987 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-9d22b202-da10-4281-8364-de47eb57dab5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:08.813997 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9d22b202-da10-4281-8364-de47eb57dab5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:08.814450 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9d22b202-da10-4281-8364-de47eb57dab5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:08.815224 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9d22b202-da10-4281-8364-de47eb57dab5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:08.815654 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9d22b202-da10-4281-8364-de47eb57dab5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:08.948274 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-9d22b202-da10-4281-8364-de47eb57dab5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:08.955717 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-9d22b202-da10-4281-8364-de47eb57dab5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.152714 Aug 25 05:41:08.956277 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 518/1064] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:08 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:09.381451 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e1efa812-5796-4033-bf6a-b549ee2b9388 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:09.383103 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e1efa812-5796-4033-bf6a-b549ee2b9388 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:09.389067 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e1efa812-5796-4033-bf6a-b549ee2b9388 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:09.389505 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e1efa812-5796-4033-bf6a-b549ee2b9388 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:09.390293 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e1efa812-5796-4033-bf6a-b549ee2b9388 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:09.390725 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e1efa812-5796-4033-bf6a-b549ee2b9388 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:09.422044 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e1efa812-5796-4033-bf6a-b549ee2b9388 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044620 Aug 25 05:41:09.422606 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 547/1065] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:09 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:09.973068 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a77f0acf-d9d9-4b42-9bd2-cee04d8a6f78 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:09.973712 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a77f0acf-d9d9-4b42-9bd2-cee04d8a6f78 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:09.979636 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a77f0acf-d9d9-4b42-9bd2-cee04d8a6f78 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:09.980072 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a77f0acf-d9d9-4b42-9bd2-cee04d8a6f78 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:09.980872 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a77f0acf-d9d9-4b42-9bd2-cee04d8a6f78 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:09.981283 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a77f0acf-d9d9-4b42-9bd2-cee04d8a6f78 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:10.107656 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-a77f0acf-d9d9-4b42-9bd2-cee04d8a6f78 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:10.114987 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a77f0acf-d9d9-4b42-9bd2-cee04d8a6f78 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.145692 Aug 25 05:41:10.115544 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 519/1066] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:09 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:10.434408 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-65856b59-a2f1-4b17-8385-1588025844e0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:10.435310 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-65856b59-a2f1-4b17-8385-1588025844e0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:10.441293 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-65856b59-a2f1-4b17-8385-1588025844e0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:10.441763 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-65856b59-a2f1-4b17-8385-1588025844e0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:10.442527 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-65856b59-a2f1-4b17-8385-1588025844e0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:10.442955 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-65856b59-a2f1-4b17-8385-1588025844e0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:10.473142 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-65856b59-a2f1-4b17-8385-1588025844e0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043125 Aug 25 05:41:10.473711 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 548/1067] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:10 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:11.132446 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5cea2d42-d156-4761-a39d-1ac6f5705184 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:11.133216 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5cea2d42-d156-4761-a39d-1ac6f5705184 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:11.139639 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5cea2d42-d156-4761-a39d-1ac6f5705184 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:11.140080 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5cea2d42-d156-4761-a39d-1ac6f5705184 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:11.140877 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5cea2d42-d156-4761-a39d-1ac6f5705184 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:11.141296 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5cea2d42-d156-4761-a39d-1ac6f5705184 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:11.272377 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-5cea2d42-d156-4761-a39d-1ac6f5705184 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:11.281507 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5cea2d42-d156-4761-a39d-1ac6f5705184 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.152697 Aug 25 05:41:11.282110 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 520/1068] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:11 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:11.484835 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-926651b4-75f9-4679-a434-9d73b2b4de6e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:11.485753 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-926651b4-75f9-4679-a434-9d73b2b4de6e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:11.491572 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-926651b4-75f9-4679-a434-9d73b2b4de6e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:11.492036 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-926651b4-75f9-4679-a434-9d73b2b4de6e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:11.492847 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-926651b4-75f9-4679-a434-9d73b2b4de6e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:11.493290 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-926651b4-75f9-4679-a434-9d73b2b4de6e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:11.522348 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-926651b4-75f9-4679-a434-9d73b2b4de6e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041498 Aug 25 05:41:11.522895 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 549/1069] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:11 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:12.299950 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-952b402a-289b-4abb-8dd2-c0fe9d32ef7c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:12.300544 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-952b402a-289b-4abb-8dd2-c0fe9d32ef7c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:12.307122 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-952b402a-289b-4abb-8dd2-c0fe9d32ef7c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:12.307558 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-952b402a-289b-4abb-8dd2-c0fe9d32ef7c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:12.308320 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-952b402a-289b-4abb-8dd2-c0fe9d32ef7c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:12.308757 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-952b402a-289b-4abb-8dd2-c0fe9d32ef7c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:12.433166 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-952b402a-289b-4abb-8dd2-c0fe9d32ef7c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:12.440434 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-952b402a-289b-4abb-8dd2-c0fe9d32ef7c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.144231 Aug 25 05:41:12.440986 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 521/1070] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:12 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:12.538079 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-3787bf32-77bc-407f-a9c7-27071b8a7fb3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:12.539624 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-3787bf32-77bc-407f-a9c7-27071b8a7fb3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:12.546312 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3787bf32-77bc-407f-a9c7-27071b8a7fb3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:12.552203 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3787bf32-77bc-407f-a9c7-27071b8a7fb3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:12.552203 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3787bf32-77bc-407f-a9c7-27071b8a7fb3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:12.552203 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3787bf32-77bc-407f-a9c7-27071b8a7fb3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:12.577782 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-3787bf32-77bc-407f-a9c7-27071b8a7fb3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046207 Aug 25 05:41:12.578332 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 550/1071] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:12 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:13.455948 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3ac0d0e8-875b-40a8-9e1d-02189c76080d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:13.456553 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3ac0d0e8-875b-40a8-9e1d-02189c76080d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:13.462553 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3ac0d0e8-875b-40a8-9e1d-02189c76080d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:13.462985 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3ac0d0e8-875b-40a8-9e1d-02189c76080d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:13.463740 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3ac0d0e8-875b-40a8-9e1d-02189c76080d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:13.464165 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3ac0d0e8-875b-40a8-9e1d-02189c76080d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:13.590192 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-59f2bed4-9fa4-484c-83a3-6b395a9a53fe tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:13.591105 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-59f2bed4-9fa4-484c-83a3-6b395a9a53fe tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:13.598563 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-3ac0d0e8-875b-40a8-9e1d-02189c76080d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:13.600151 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-59f2bed4-9fa4-484c-83a3-6b395a9a53fe tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:13.600599 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-59f2bed4-9fa4-484c-83a3-6b395a9a53fe tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:13.601386 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-59f2bed4-9fa4-484c-83a3-6b395a9a53fe tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:13.601852 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-59f2bed4-9fa4-484c-83a3-6b395a9a53fe tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:13.608600 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3ac0d0e8-875b-40a8-9e1d-02189c76080d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.156224 Aug 25 05:41:13.609172 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 522/1072] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:13 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:13.632295 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-59f2bed4-9fa4-484c-83a3-6b395a9a53fe tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046125 Aug 25 05:41:13.632929 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 551/1073] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:13 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:41:14.625802 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a29c08df-d952-4ccd-9a49-870e02f88da9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:14.626421 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a29c08df-d952-4ccd-9a49-870e02f88da9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:14.632421 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a29c08df-d952-4ccd-9a49-870e02f88da9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:14.632865 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a29c08df-d952-4ccd-9a49-870e02f88da9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:14.633907 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a29c08df-d952-4ccd-9a49-870e02f88da9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:14.634341 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a29c08df-d952-4ccd-9a49-870e02f88da9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:14.644674 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-4cd53464-bc28-4728-95e9-b41914a5b6ea tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:14.645611 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-4cd53464-bc28-4728-95e9-b41914a5b6ea tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:14.653033 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4cd53464-bc28-4728-95e9-b41914a5b6ea tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:14.653033 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4cd53464-bc28-4728-95e9-b41914a5b6ea tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:14.653674 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4cd53464-bc28-4728-95e9-b41914a5b6ea tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:14.654100 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4cd53464-bc28-4728-95e9-b41914a5b6ea tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:14.685210 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-4cd53464-bc28-4728-95e9-b41914a5b6ea tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044279 Aug 25 05:41:14.686051 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 552/1074] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:14 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:41:14.766042 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-a29c08df-d952-4ccd-9a49-870e02f88da9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:14.776299 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a29c08df-d952-4ccd-9a49-870e02f88da9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.154279 Aug 25 05:41:14.777126 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 523/1075] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:14 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:15.697085 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6ce43511-6b98-4b87-8461-13b33050a180 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:15.697959 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6ce43511-6b98-4b87-8461-13b33050a180 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:15.703981 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6ce43511-6b98-4b87-8461-13b33050a180 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:15.704412 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6ce43511-6b98-4b87-8461-13b33050a180 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:15.705186 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6ce43511-6b98-4b87-8461-13b33050a180 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:15.705636 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6ce43511-6b98-4b87-8461-13b33050a180 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:15.734431 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6ce43511-6b98-4b87-8461-13b33050a180 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041859 Aug 25 05:41:15.734991 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 553/1076] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:15 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:15.795332 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6492a99e-57ff-436f-a3bb-9ea46256e38f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:15.795976 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6492a99e-57ff-436f-a3bb-9ea46256e38f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:15.801954 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6492a99e-57ff-436f-a3bb-9ea46256e38f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:15.802400 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6492a99e-57ff-436f-a3bb-9ea46256e38f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:15.803169 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6492a99e-57ff-436f-a3bb-9ea46256e38f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:15.803599 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6492a99e-57ff-436f-a3bb-9ea46256e38f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:15.926755 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6492a99e-57ff-436f-a3bb-9ea46256e38f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:15.935115 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6492a99e-57ff-436f-a3bb-9ea46256e38f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.144296 Aug 25 05:41:15.935679 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 524/1077] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:15 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:16.745346 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-8ad7ccba-02cb-4b52-88d2-be1e3ce980a4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:16.746261 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-8ad7ccba-02cb-4b52-88d2-be1e3ce980a4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:16.751982 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8ad7ccba-02cb-4b52-88d2-be1e3ce980a4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:16.752411 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8ad7ccba-02cb-4b52-88d2-be1e3ce980a4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:16.753153 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8ad7ccba-02cb-4b52-88d2-be1e3ce980a4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:16.753601 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8ad7ccba-02cb-4b52-88d2-be1e3ce980a4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:16.782710 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-8ad7ccba-02cb-4b52-88d2-be1e3ce980a4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041270 Aug 25 05:41:16.783257 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 554/1078] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:16 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:16.952162 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-20b7315f-b836-4bc9-ae0a-b7f5a8444ed0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:16.952719 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-20b7315f-b836-4bc9-ae0a-b7f5a8444ed0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:16.958652 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-20b7315f-b836-4bc9-ae0a-b7f5a8444ed0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:16.959097 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-20b7315f-b836-4bc9-ae0a-b7f5a8444ed0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:16.959859 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-20b7315f-b836-4bc9-ae0a-b7f5a8444ed0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:16.960293 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-20b7315f-b836-4bc9-ae0a-b7f5a8444ed0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:17.090607 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-20b7315f-b836-4bc9-ae0a-b7f5a8444ed0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:17.098078 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-20b7315f-b836-4bc9-ae0a-b7f5a8444ed0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.149624 Aug 25 05:41:17.098644 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 525/1079] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:16 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:17.794309 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-abcade63-e6b2-4d8f-864d-2bc52f676979 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:17.795246 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-abcade63-e6b2-4d8f-864d-2bc52f676979 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:17.801023 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-abcade63-e6b2-4d8f-864d-2bc52f676979 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:17.801463 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-abcade63-e6b2-4d8f-864d-2bc52f676979 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:17.802243 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-abcade63-e6b2-4d8f-864d-2bc52f676979 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:17.802668 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-abcade63-e6b2-4d8f-864d-2bc52f676979 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:17.832805 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-abcade63-e6b2-4d8f-864d-2bc52f676979 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042295 Aug 25 05:41:17.836623 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 555/1080] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:17 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:18.115280 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b5b051e8-6d67-4929-aab3-b7532477e897 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:18.115814 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b5b051e8-6d67-4929-aab3-b7532477e897 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:18.122630 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b5b051e8-6d67-4929-aab3-b7532477e897 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:18.123073 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b5b051e8-6d67-4929-aab3-b7532477e897 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:18.123829 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b5b051e8-6d67-4929-aab3-b7532477e897 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:18.124262 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b5b051e8-6d67-4929-aab3-b7532477e897 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:18.247458 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-b5b051e8-6d67-4929-aab3-b7532477e897 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:18.255007 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b5b051e8-6d67-4929-aab3-b7532477e897 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.143436 Aug 25 05:41:18.255571 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 526/1081] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:18 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:18.844947 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a4bf5d94-e43c-4284-91ee-fa1be924e12e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:18.845885 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a4bf5d94-e43c-4284-91ee-fa1be924e12e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:18.852012 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a4bf5d94-e43c-4284-91ee-fa1be924e12e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:18.852478 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a4bf5d94-e43c-4284-91ee-fa1be924e12e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:18.853358 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a4bf5d94-e43c-4284-91ee-fa1be924e12e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:18.853855 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a4bf5d94-e43c-4284-91ee-fa1be924e12e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:18.883533 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a4bf5d94-e43c-4284-91ee-fa1be924e12e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042363 Aug 25 05:41:18.884079 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 556/1082] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:18 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:19.272250 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-63dcca78-a3e2-4e35-9718-cf43c7edc02c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:19.273045 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-63dcca78-a3e2-4e35-9718-cf43c7edc02c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:19.283420 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-63dcca78-a3e2-4e35-9718-cf43c7edc02c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:19.284556 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-63dcca78-a3e2-4e35-9718-cf43c7edc02c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:19.285327 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-63dcca78-a3e2-4e35-9718-cf43c7edc02c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:19.285786 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-63dcca78-a3e2-4e35-9718-cf43c7edc02c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:19.414886 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-63dcca78-a3e2-4e35-9718-cf43c7edc02c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:19.422705 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-63dcca78-a3e2-4e35-9718-cf43c7edc02c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.154387 Aug 25 05:41:19.423294 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 527/1083] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:19 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:19.896112 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d1a9c0ff-4965-4cb0-bbbc-bad15ea88864 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:19.896958 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d1a9c0ff-4965-4cb0-bbbc-bad15ea88864 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:19.904185 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d1a9c0ff-4965-4cb0-bbbc-bad15ea88864 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:19.904667 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d1a9c0ff-4965-4cb0-bbbc-bad15ea88864 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:19.905684 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d1a9c0ff-4965-4cb0-bbbc-bad15ea88864 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:19.906618 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d1a9c0ff-4965-4cb0-bbbc-bad15ea88864 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:19.940088 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d1a9c0ff-4965-4cb0-bbbc-bad15ea88864 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048012 Aug 25 05:41:19.940634 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 557/1084] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:19 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:20.440141 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-f2de065d-e981-4b75-9eef-43c23032db63 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:20.440755 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-f2de065d-e981-4b75-9eef-43c23032db63 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:20.446505 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f2de065d-e981-4b75-9eef-43c23032db63 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:20.447546 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f2de065d-e981-4b75-9eef-43c23032db63 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:20.448298 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f2de065d-e981-4b75-9eef-43c23032db63 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:20.448718 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f2de065d-e981-4b75-9eef-43c23032db63 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:20.567936 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-f2de065d-e981-4b75-9eef-43c23032db63 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:20.576636 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-f2de065d-e981-4b75-9eef-43c23032db63 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.140198 Aug 25 05:41:20.577191 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 528/1085] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:20 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:20.953393 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e7f3b8e5-50dc-4186-9caa-69cecc632472 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:20.954323 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e7f3b8e5-50dc-4186-9caa-69cecc632472 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:20.960208 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e7f3b8e5-50dc-4186-9caa-69cecc632472 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:20.960647 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e7f3b8e5-50dc-4186-9caa-69cecc632472 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:20.961405 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e7f3b8e5-50dc-4186-9caa-69cecc632472 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:20.961874 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e7f3b8e5-50dc-4186-9caa-69cecc632472 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:20.990840 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e7f3b8e5-50dc-4186-9caa-69cecc632472 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042097 Aug 25 05:41:20.991384 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 558/1086] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:20 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:21.593793 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-61a61818-5c36-4439-a584-db191954a1b5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:21.594392 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-61a61818-5c36-4439-a584-db191954a1b5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:21.600119 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-61a61818-5c36-4439-a584-db191954a1b5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:21.600560 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-61a61818-5c36-4439-a584-db191954a1b5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:21.601305 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-61a61818-5c36-4439-a584-db191954a1b5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:21.601758 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-61a61818-5c36-4439-a584-db191954a1b5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:21.719943 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-61a61818-5c36-4439-a584-db191954a1b5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:21.727101 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-61a61818-5c36-4439-a584-db191954a1b5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.136923 Aug 25 05:41:21.727660 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 529/1087] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:21 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:22.003510 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-0b6996cd-c7ec-40d5-b055-e34de9775e84 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:22.004356 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-0b6996cd-c7ec-40d5-b055-e34de9775e84 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:22.010381 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0b6996cd-c7ec-40d5-b055-e34de9775e84 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:22.010859 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0b6996cd-c7ec-40d5-b055-e34de9775e84 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:22.011616 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0b6996cd-c7ec-40d5-b055-e34de9775e84 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:22.012042 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0b6996cd-c7ec-40d5-b055-e34de9775e84 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:22.040119 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-0b6996cd-c7ec-40d5-b055-e34de9775e84 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040475 Aug 25 05:41:22.041210 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 559/1088] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:21 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:22.744130 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6d07c8f9-75de-4e1e-a009-621ba28343a4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:22.744731 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6d07c8f9-75de-4e1e-a009-621ba28343a4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:22.750581 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6d07c8f9-75de-4e1e-a009-621ba28343a4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:22.751018 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6d07c8f9-75de-4e1e-a009-621ba28343a4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:22.751796 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6d07c8f9-75de-4e1e-a009-621ba28343a4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:22.752218 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6d07c8f9-75de-4e1e-a009-621ba28343a4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:22.877989 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6d07c8f9-75de-4e1e-a009-621ba28343a4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:22.885944 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6d07c8f9-75de-4e1e-a009-621ba28343a4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.145621 Aug 25 05:41:22.886545 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 530/1089] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:22 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:23.052388 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-774d4696-33eb-4d72-a6c9-2f2e73ab2e19 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:23.053352 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-774d4696-33eb-4d72-a6c9-2f2e73ab2e19 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:23.060113 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-774d4696-33eb-4d72-a6c9-2f2e73ab2e19 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:23.060561 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-774d4696-33eb-4d72-a6c9-2f2e73ab2e19 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:23.061324 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-774d4696-33eb-4d72-a6c9-2f2e73ab2e19 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:23.061791 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-774d4696-33eb-4d72-a6c9-2f2e73ab2e19 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:23.092154 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-774d4696-33eb-4d72-a6c9-2f2e73ab2e19 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043460 Aug 25 05:41:23.092631 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 560/1090] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:23 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:23.903500 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-68c945a0-7133-4d6e-874d-5948e434f6d7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:23.904102 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-68c945a0-7133-4d6e-874d-5948e434f6d7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:23.910081 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-68c945a0-7133-4d6e-874d-5948e434f6d7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:23.910523 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-68c945a0-7133-4d6e-874d-5948e434f6d7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:23.911303 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-68c945a0-7133-4d6e-874d-5948e434f6d7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:23.911725 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-68c945a0-7133-4d6e-874d-5948e434f6d7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:24.030296 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-68c945a0-7133-4d6e-874d-5948e434f6d7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:24.037415 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-68c945a0-7133-4d6e-874d-5948e434f6d7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.138479 Aug 25 05:41:24.037993 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 531/1091] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:23 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:24.103498 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a007deda-36f0-4641-a6c4-e7c66c0116d3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:24.104411 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a007deda-36f0-4641-a6c4-e7c66c0116d3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:24.110226 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a007deda-36f0-4641-a6c4-e7c66c0116d3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:24.110670 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a007deda-36f0-4641-a6c4-e7c66c0116d3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:24.111433 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a007deda-36f0-4641-a6c4-e7c66c0116d3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:24.111867 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a007deda-36f0-4641-a6c4-e7c66c0116d3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:24.140098 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a007deda-36f0-4641-a6c4-e7c66c0116d3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040424 Aug 25 05:41:24.140638 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 561/1092] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:24 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:25.054039 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-2a890d8a-2c82-4395-a09e-20b2445c3c68 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:25.054650 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-2a890d8a-2c82-4395-a09e-20b2445c3c68 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:25.061093 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2a890d8a-2c82-4395-a09e-20b2445c3c68 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:25.061626 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2a890d8a-2c82-4395-a09e-20b2445c3c68 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:25.062398 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2a890d8a-2c82-4395-a09e-20b2445c3c68 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:25.062834 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2a890d8a-2c82-4395-a09e-20b2445c3c68 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:25.151923 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-beb2361f-700b-4b44-928b-adb3406849ce tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:25.152814 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-beb2361f-700b-4b44-928b-adb3406849ce tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:25.158596 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-beb2361f-700b-4b44-928b-adb3406849ce tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:25.159032 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-beb2361f-700b-4b44-928b-adb3406849ce tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:25.159787 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-beb2361f-700b-4b44-928b-adb3406849ce tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:25.160210 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-beb2361f-700b-4b44-928b-adb3406849ce tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:25.184230 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-2a890d8a-2c82-4395-a09e-20b2445c3c68 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:25.190124 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-beb2361f-700b-4b44-928b-adb3406849ce tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042810 Aug 25 05:41:25.190926 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 562/1093] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:25 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:41:25.191741 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-2a890d8a-2c82-4395-a09e-20b2445c3c68 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.141335 Aug 25 05:41:25.192284 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 532/1094] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:25 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:26.202309 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-230075b9-2ba9-4a73-a26c-fc6f42a0dce8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:26.203204 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-230075b9-2ba9-4a73-a26c-fc6f42a0dce8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:26.208146 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-4693f25e-0d2c-4c73-936c-a6755fa38392 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:26.208756 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-4693f25e-0d2c-4c73-936c-a6755fa38392 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:26.208979 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-230075b9-2ba9-4a73-a26c-fc6f42a0dce8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:26.209418 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-230075b9-2ba9-4a73-a26c-fc6f42a0dce8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:26.210202 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-230075b9-2ba9-4a73-a26c-fc6f42a0dce8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:26.210631 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-230075b9-2ba9-4a73-a26c-fc6f42a0dce8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:26.214906 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4693f25e-0d2c-4c73-936c-a6755fa38392 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:26.215357 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4693f25e-0d2c-4c73-936c-a6755fa38392 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:26.216121 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4693f25e-0d2c-4c73-936c-a6755fa38392 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:26.216552 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4693f25e-0d2c-4c73-936c-a6755fa38392 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:26.241546 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-230075b9-2ba9-4a73-a26c-fc6f42a0dce8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042909 Aug 25 05:41:26.242098 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 563/1095] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:26 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:26.344209 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-4693f25e-0d2c-4c73-936c-a6755fa38392 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:26.351414 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-4693f25e-0d2c-4c73-936c-a6755fa38392 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.147110 Aug 25 05:41:26.351974 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 533/1096] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:26 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:41:27.253857 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a139893e-cb92-472a-af33-df78b3b3ddec tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:27.254787 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a139893e-cb92-472a-af33-df78b3b3ddec tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:27.261731 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a139893e-cb92-472a-af33-df78b3b3ddec tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:27.262167 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a139893e-cb92-472a-af33-df78b3b3ddec tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:27.262920 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a139893e-cb92-472a-af33-df78b3b3ddec tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:27.263341 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a139893e-cb92-472a-af33-df78b3b3ddec tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:27.292341 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a139893e-cb92-472a-af33-df78b3b3ddec tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042452 Aug 25 05:41:27.292872 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 564/1097] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:27 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:27.368539 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6412384f-44dd-4b10-aeec-81e3a6f53f2e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:27.369507 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6412384f-44dd-4b10-aeec-81e3a6f53f2e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:27.374909 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6412384f-44dd-4b10-aeec-81e3a6f53f2e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:27.375348 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6412384f-44dd-4b10-aeec-81e3a6f53f2e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:27.376094 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6412384f-44dd-4b10-aeec-81e3a6f53f2e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:27.376516 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6412384f-44dd-4b10-aeec-81e3a6f53f2e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:27.496623 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6412384f-44dd-4b10-aeec-81e3a6f53f2e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:27.503808 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6412384f-44dd-4b10-aeec-81e3a6f53f2e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.138909 Aug 25 05:41:27.504424 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 534/1098] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:27 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:28.303894 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5f28834a-5bb2-4827-8519-0f0078629add tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:28.304818 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5f28834a-5bb2-4827-8519-0f0078629add tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:28.312055 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5f28834a-5bb2-4827-8519-0f0078629add tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:28.312498 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5f28834a-5bb2-4827-8519-0f0078629add tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:28.313253 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5f28834a-5bb2-4827-8519-0f0078629add tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:28.313727 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5f28834a-5bb2-4827-8519-0f0078629add tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:28.341956 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5f28834a-5bb2-4827-8519-0f0078629add tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041839 Aug 25 05:41:28.342491 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 565/1099] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:28 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:28.521369 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-374cbe3d-f132-424c-8a4c-2bdaeaf9f39f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:28.522000 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-374cbe3d-f132-424c-8a4c-2bdaeaf9f39f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:28.528454 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-374cbe3d-f132-424c-8a4c-2bdaeaf9f39f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:28.528904 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-374cbe3d-f132-424c-8a4c-2bdaeaf9f39f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:28.529718 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-374cbe3d-f132-424c-8a4c-2bdaeaf9f39f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:28.530170 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-374cbe3d-f132-424c-8a4c-2bdaeaf9f39f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:28.658569 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-374cbe3d-f132-424c-8a4c-2bdaeaf9f39f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:28.667849 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-374cbe3d-f132-424c-8a4c-2bdaeaf9f39f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.149960 Aug 25 05:41:28.668661 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 535/1100] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:28 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:29.354445 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-53296769-9f66-4833-8df0-e00c6849614b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:29.355349 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-53296769-9f66-4833-8df0-e00c6849614b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:29.362495 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-53296769-9f66-4833-8df0-e00c6849614b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:29.362685 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-53296769-9f66-4833-8df0-e00c6849614b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:29.363400 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-53296769-9f66-4833-8df0-e00c6849614b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:29.364056 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-53296769-9f66-4833-8df0-e00c6849614b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:29.394597 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-53296769-9f66-4833-8df0-e00c6849614b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044627 Aug 25 05:41:29.395147 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 566/1101] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:29 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:29.685218 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5a00a269-8318-49bc-8607-92e6a55276ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:29.685801 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5a00a269-8318-49bc-8607-92e6a55276ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:29.691757 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5a00a269-8318-49bc-8607-92e6a55276ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:29.692200 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5a00a269-8318-49bc-8607-92e6a55276ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:29.692979 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5a00a269-8318-49bc-8607-92e6a55276ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:29.693400 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5a00a269-8318-49bc-8607-92e6a55276ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:29.817918 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-5a00a269-8318-49bc-8607-92e6a55276ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:29.825780 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5a00a269-8318-49bc-8607-92e6a55276ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.144775 Aug 25 05:41:29.826345 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 536/1102] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:29 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:30.407075 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d10fe54c-426e-444e-92e8-8188b990f64a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:30.407982 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d10fe54c-426e-444e-92e8-8188b990f64a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:30.413797 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d10fe54c-426e-444e-92e8-8188b990f64a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:30.414271 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d10fe54c-426e-444e-92e8-8188b990f64a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:30.415027 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d10fe54c-426e-444e-92e8-8188b990f64a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:30.416166 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d10fe54c-426e-444e-92e8-8188b990f64a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:30.444147 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d10fe54c-426e-444e-92e8-8188b990f64a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040933 Aug 25 05:41:30.444693 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 567/1103] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:30 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:30.842579 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-69ddf3cd-a5fc-4081-8c33-529f841f7b7d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:30.843092 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-69ddf3cd-a5fc-4081-8c33-529f841f7b7d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:30.848875 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-69ddf3cd-a5fc-4081-8c33-529f841f7b7d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:30.849396 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-69ddf3cd-a5fc-4081-8c33-529f841f7b7d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:30.850200 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-69ddf3cd-a5fc-4081-8c33-529f841f7b7d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:30.850631 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-69ddf3cd-a5fc-4081-8c33-529f841f7b7d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:30.976360 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-69ddf3cd-a5fc-4081-8c33-529f841f7b7d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:30.984315 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-69ddf3cd-a5fc-4081-8c33-529f841f7b7d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.145480 Aug 25 05:41:30.984865 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 537/1104] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:30 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:31.455979 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1de3c18e-f7d1-42d5-9085-79b213dbf3a0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:31.456868 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1de3c18e-f7d1-42d5-9085-79b213dbf3a0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:31.463062 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1de3c18e-f7d1-42d5-9085-79b213dbf3a0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:31.463493 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1de3c18e-f7d1-42d5-9085-79b213dbf3a0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:31.464236 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1de3c18e-f7d1-42d5-9085-79b213dbf3a0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:31.464658 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1de3c18e-f7d1-42d5-9085-79b213dbf3a0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:31.492815 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1de3c18e-f7d1-42d5-9085-79b213dbf3a0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040572 Aug 25 05:41:31.494190 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 568/1105] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:31 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:32.002821 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-167e5794-bb26-4849-b191-c46ce50a2371 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:32.003547 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-167e5794-bb26-4849-b191-c46ce50a2371 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:32.010700 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-167e5794-bb26-4849-b191-c46ce50a2371 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:32.011155 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-167e5794-bb26-4849-b191-c46ce50a2371 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:32.011934 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-167e5794-bb26-4849-b191-c46ce50a2371 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:32.012369 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-167e5794-bb26-4849-b191-c46ce50a2371 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:32.149210 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-167e5794-bb26-4849-b191-c46ce50a2371 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:32.156638 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-167e5794-bb26-4849-b191-c46ce50a2371 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.158501 Aug 25 05:41:32.157193 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 538/1106] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:31 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:32.504626 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1ee5f88f-44d2-4f52-a841-fce6c0581525 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:32.505544 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1ee5f88f-44d2-4f52-a841-fce6c0581525 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:32.512144 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1ee5f88f-44d2-4f52-a841-fce6c0581525 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:32.512586 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1ee5f88f-44d2-4f52-a841-fce6c0581525 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:32.513334 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1ee5f88f-44d2-4f52-a841-fce6c0581525 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:32.513786 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1ee5f88f-44d2-4f52-a841-fce6c0581525 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:32.544630 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1ee5f88f-44d2-4f52-a841-fce6c0581525 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043721 Aug 25 05:41:32.545219 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 569/1107] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:32 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:33.173792 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-64e665dc-9623-4a56-814f-eb717da57b35 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:33.174429 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-64e665dc-9623-4a56-814f-eb717da57b35 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:33.182127 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-64e665dc-9623-4a56-814f-eb717da57b35 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:33.182572 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-64e665dc-9623-4a56-814f-eb717da57b35 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:33.183338 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-64e665dc-9623-4a56-814f-eb717da57b35 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:33.183769 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-64e665dc-9623-4a56-814f-eb717da57b35 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:33.320743 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-64e665dc-9623-4a56-814f-eb717da57b35 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:33.331331 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-64e665dc-9623-4a56-814f-eb717da57b35 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.161114 Aug 25 05:41:33.332277 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 539/1108] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:33 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:41:33.556272 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-23b4b808-e475-44e6-9493-08915735714b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:33.557269 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-23b4b808-e475-44e6-9493-08915735714b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:33.563184 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-23b4b808-e475-44e6-9493-08915735714b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:33.563627 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-23b4b808-e475-44e6-9493-08915735714b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:33.564420 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-23b4b808-e475-44e6-9493-08915735714b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:33.564849 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-23b4b808-e475-44e6-9493-08915735714b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:33.595443 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-23b4b808-e475-44e6-9493-08915735714b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042968 Aug 25 05:41:33.596007 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 570/1109] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:33 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:34.350284 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a590036b-afb8-443e-b026-995e1d796414 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:34.350866 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a590036b-afb8-443e-b026-995e1d796414 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:34.356694 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a590036b-afb8-443e-b026-995e1d796414 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:34.357134 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a590036b-afb8-443e-b026-995e1d796414 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:34.357918 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a590036b-afb8-443e-b026-995e1d796414 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:34.358343 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a590036b-afb8-443e-b026-995e1d796414 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:34.453014 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4945947b-868a-4594-a167-64b475d876a3] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 25 05:41:34.478474 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-a590036b-afb8-443e-b026-995e1d796414 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:34.486057 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a590036b-afb8-443e-b026-995e1d796414 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.139501 Aug 25 05:41:34.486606 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 540/1110] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:34 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:34.607889 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-765eba78-cf38-48d0-9939-10080aad52a2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:34.608708 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-765eba78-cf38-48d0-9939-10080aad52a2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:34.614484 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-765eba78-cf38-48d0-9939-10080aad52a2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:34.614916 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-765eba78-cf38-48d0-9939-10080aad52a2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:34.615661 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-765eba78-cf38-48d0-9939-10080aad52a2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:34.616085 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-765eba78-cf38-48d0-9939-10080aad52a2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:34.644698 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-765eba78-cf38-48d0-9939-10080aad52a2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040843 Aug 25 05:41:34.645237 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 571/1111] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:34 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:35.503488 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-acce4bba-728b-4d9f-804e-b196b7c79320 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:35.504086 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-acce4bba-728b-4d9f-804e-b196b7c79320 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:35.525148 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-acce4bba-728b-4d9f-804e-b196b7c79320 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:35.525811 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-acce4bba-728b-4d9f-804e-b196b7c79320 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:35.526835 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-acce4bba-728b-4d9f-804e-b196b7c79320 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:35.527261 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-acce4bba-728b-4d9f-804e-b196b7c79320 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:35.530901 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [-] [4945947b-868a-4594-a167-64b475d876a3] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 35340. Aug 25 05:41:35.652537 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-acce4bba-728b-4d9f-804e-b196b7c79320 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:35.656934 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b6ba82c1-fce0-4905-b087-2fd5208e2e84 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:35.657869 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b6ba82c1-fce0-4905-b087-2fd5208e2e84 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:35.666802 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b6ba82c1-fce0-4905-b087-2fd5208e2e84 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:35.667186 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-acce4bba-728b-4d9f-804e-b196b7c79320 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.167280 Aug 25 05:41:35.667585 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b6ba82c1-fce0-4905-b087-2fd5208e2e84 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:35.667770 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 541/1112] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:35 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:35.668794 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b6ba82c1-fce0-4905-b087-2fd5208e2e84 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:35.669234 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b6ba82c1-fce0-4905-b087-2fd5208e2e84 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:35.700127 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b6ba82c1-fce0-4905-b087-2fd5208e2e84 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046826 Aug 25 05:41:35.700601 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 572/1113] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:35 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:41:36.685339 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-de07d5af-052a-4919-8ee6-e6f527362b7a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:36.685964 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-de07d5af-052a-4919-8ee6-e6f527362b7a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:36.691830 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-de07d5af-052a-4919-8ee6-e6f527362b7a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:36.692261 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-de07d5af-052a-4919-8ee6-e6f527362b7a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:36.693015 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-de07d5af-052a-4919-8ee6-e6f527362b7a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:36.693436 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-de07d5af-052a-4919-8ee6-e6f527362b7a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:36.712106 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-02cf0b17-2790-4bee-97af-ae1db0a65cb7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:36.713004 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-02cf0b17-2790-4bee-97af-ae1db0a65cb7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:36.719692 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-02cf0b17-2790-4bee-97af-ae1db0a65cb7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:36.720135 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-02cf0b17-2790-4bee-97af-ae1db0a65cb7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:36.720902 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-02cf0b17-2790-4bee-97af-ae1db0a65cb7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:36.721335 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-02cf0b17-2790-4bee-97af-ae1db0a65cb7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:36.752263 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-02cf0b17-2790-4bee-97af-ae1db0a65cb7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043915 Aug 25 05:41:36.753032 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 573/1114] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:36 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:41:36.819230 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-de07d5af-052a-4919-8ee6-e6f527362b7a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:36.827992 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-de07d5af-052a-4919-8ee6-e6f527362b7a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.146476 Aug 25 05:41:36.828560 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 542/1115] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:36 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:37.764205 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-efa95780-33bc-4a51-9669-46df1225d552 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:37.765109 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-efa95780-33bc-4a51-9669-46df1225d552 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:37.770960 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-efa95780-33bc-4a51-9669-46df1225d552 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:37.771404 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-efa95780-33bc-4a51-9669-46df1225d552 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:37.772249 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-efa95780-33bc-4a51-9669-46df1225d552 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:37.772684 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-efa95780-33bc-4a51-9669-46df1225d552 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:37.802697 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-efa95780-33bc-4a51-9669-46df1225d552 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042415 Aug 25 05:41:37.803174 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 574/1116] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:37 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:37.845083 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b3c4ceae-6886-46bb-9af4-bb7f24ace5e6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:37.845720 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b3c4ceae-6886-46bb-9af4-bb7f24ace5e6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:37.851414 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b3c4ceae-6886-46bb-9af4-bb7f24ace5e6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:37.851880 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b3c4ceae-6886-46bb-9af4-bb7f24ace5e6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:37.852643 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b3c4ceae-6886-46bb-9af4-bb7f24ace5e6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:37.853053 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b3c4ceae-6886-46bb-9af4-bb7f24ace5e6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:37.972451 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-b3c4ceae-6886-46bb-9af4-bb7f24ace5e6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:37.980373 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b3c4ceae-6886-46bb-9af4-bb7f24ace5e6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.138698 Aug 25 05:41:37.980934 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 543/1117] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:37 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:38.814438 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1cfd23f2-487d-4bdc-9329-a76a15a8ff45 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:38.815337 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1cfd23f2-487d-4bdc-9329-a76a15a8ff45 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:38.821176 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1cfd23f2-487d-4bdc-9329-a76a15a8ff45 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:38.821645 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1cfd23f2-487d-4bdc-9329-a76a15a8ff45 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:38.822401 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1cfd23f2-487d-4bdc-9329-a76a15a8ff45 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:38.823688 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1cfd23f2-487d-4bdc-9329-a76a15a8ff45 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:38.853411 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1cfd23f2-487d-4bdc-9329-a76a15a8ff45 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042668 Aug 25 05:41:38.854434 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 575/1118] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:38 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:38.998554 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d820d9c5-dc1a-4aa0-93aa-2486d00c3b44 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:38.999142 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-d820d9c5-dc1a-4aa0-93aa-2486d00c3b44 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:39.005327 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d820d9c5-dc1a-4aa0-93aa-2486d00c3b44 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:39.005805 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d820d9c5-dc1a-4aa0-93aa-2486d00c3b44 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:39.006573 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d820d9c5-dc1a-4aa0-93aa-2486d00c3b44 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:39.007005 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d820d9c5-dc1a-4aa0-93aa-2486d00c3b44 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:39.131184 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-d820d9c5-dc1a-4aa0-93aa-2486d00c3b44 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:39.138687 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d820d9c5-dc1a-4aa0-93aa-2486d00c3b44 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.144530 Aug 25 05:41:39.139252 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 544/1119] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:38 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:39.865153 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ab2c044d-cf66-4107-836d-1472653f8d98 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:39.866068 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ab2c044d-cf66-4107-836d-1472653f8d98 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:39.871917 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ab2c044d-cf66-4107-836d-1472653f8d98 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:39.872351 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ab2c044d-cf66-4107-836d-1472653f8d98 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:39.873097 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ab2c044d-cf66-4107-836d-1472653f8d98 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:39.873537 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ab2c044d-cf66-4107-836d-1472653f8d98 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:39.903503 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ab2c044d-cf66-4107-836d-1472653f8d98 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042118 Aug 25 05:41:39.904037 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 576/1120] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:39 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:40.155707 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7705c38b-a33d-42a3-9ec2-00b1bbbdc7b5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:40.156238 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7705c38b-a33d-42a3-9ec2-00b1bbbdc7b5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:40.161998 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7705c38b-a33d-42a3-9ec2-00b1bbbdc7b5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:40.162437 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7705c38b-a33d-42a3-9ec2-00b1bbbdc7b5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:40.163183 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7705c38b-a33d-42a3-9ec2-00b1bbbdc7b5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:40.163604 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7705c38b-a33d-42a3-9ec2-00b1bbbdc7b5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:40.285922 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-7705c38b-a33d-42a3-9ec2-00b1bbbdc7b5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:40.293118 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7705c38b-a33d-42a3-9ec2-00b1bbbdc7b5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.141097 Aug 25 05:41:40.293694 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 545/1121] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:40 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:40.915026 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-8d30d004-cc77-4ccd-a2c7-e2e40e1ff97b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:40.915918 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-8d30d004-cc77-4ccd-a2c7-e2e40e1ff97b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:40.923298 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8d30d004-cc77-4ccd-a2c7-e2e40e1ff97b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:40.923747 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8d30d004-cc77-4ccd-a2c7-e2e40e1ff97b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:40.924525 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8d30d004-cc77-4ccd-a2c7-e2e40e1ff97b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:40.924961 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8d30d004-cc77-4ccd-a2c7-e2e40e1ff97b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:40.955003 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-8d30d004-cc77-4ccd-a2c7-e2e40e1ff97b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043681 Aug 25 05:41:40.955587 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 577/1122] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:40 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:41.311587 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-0d912320-8840-451b-8b09-d32bdb69dad0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:41.312544 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-0d912320-8840-451b-8b09-d32bdb69dad0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:41.320896 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0d912320-8840-451b-8b09-d32bdb69dad0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:41.321345 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0d912320-8840-451b-8b09-d32bdb69dad0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:41.322573 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0d912320-8840-451b-8b09-d32bdb69dad0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:41.323259 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0d912320-8840-451b-8b09-d32bdb69dad0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:41.460087 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-0d912320-8840-451b-8b09-d32bdb69dad0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:41.469614 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-0d912320-8840-451b-8b09-d32bdb69dad0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.163270 Aug 25 05:41:41.470130 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 546/1123] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:41 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:41.967098 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-236438e7-c45c-40f3-8d7a-8967ffe6d96f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:41.968562 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-236438e7-c45c-40f3-8d7a-8967ffe6d96f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:41.974724 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-236438e7-c45c-40f3-8d7a-8967ffe6d96f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:41.975170 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-236438e7-c45c-40f3-8d7a-8967ffe6d96f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:41.975941 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-236438e7-c45c-40f3-8d7a-8967ffe6d96f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:41.976367 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-236438e7-c45c-40f3-8d7a-8967ffe6d96f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:42.005917 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-236438e7-c45c-40f3-8d7a-8967ffe6d96f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042950 Aug 25 05:41:42.006480 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 578/1124] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:41 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:42.486387 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-240d362f-9489-4b76-9198-ebec3864036e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:42.487054 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-240d362f-9489-4b76-9198-ebec3864036e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:42.492675 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-240d362f-9489-4b76-9198-ebec3864036e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:42.493115 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-240d362f-9489-4b76-9198-ebec3864036e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:42.493884 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-240d362f-9489-4b76-9198-ebec3864036e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:42.494309 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-240d362f-9489-4b76-9198-ebec3864036e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:42.616869 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-240d362f-9489-4b76-9198-ebec3864036e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:42.624966 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-240d362f-9489-4b76-9198-ebec3864036e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.142245 Aug 25 05:41:42.625543 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 547/1125] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:42 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:43.019502 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-0547048d-d113-41af-aafb-6b145abfc65a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:43.020395 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-0547048d-d113-41af-aafb-6b145abfc65a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:43.026581 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0547048d-d113-41af-aafb-6b145abfc65a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:43.027841 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0547048d-d113-41af-aafb-6b145abfc65a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:43.028764 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0547048d-d113-41af-aafb-6b145abfc65a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:43.029038 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0547048d-d113-41af-aafb-6b145abfc65a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:43.057148 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-0547048d-d113-41af-aafb-6b145abfc65a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041453 Aug 25 05:41:43.057974 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 579/1126] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:43 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:43.641158 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-662e664e-2f19-41a4-a96f-e8df721a680f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:43.641789 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-662e664e-2f19-41a4-a96f-e8df721a680f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:43.647695 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-662e664e-2f19-41a4-a96f-e8df721a680f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:43.648144 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-662e664e-2f19-41a4-a96f-e8df721a680f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:43.648905 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-662e664e-2f19-41a4-a96f-e8df721a680f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:43.649663 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-662e664e-2f19-41a4-a96f-e8df721a680f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:43.783937 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-662e664e-2f19-41a4-a96f-e8df721a680f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:43.791426 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-662e664e-2f19-41a4-a96f-e8df721a680f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.153875 Aug 25 05:41:43.792913 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 548/1127] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:43 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:44.068045 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b348d671-bc8c-4adc-a4c2-4698e79ea917 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:44.068943 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b348d671-bc8c-4adc-a4c2-4698e79ea917 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:44.075369 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b348d671-bc8c-4adc-a4c2-4698e79ea917 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:44.075814 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b348d671-bc8c-4adc-a4c2-4698e79ea917 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:44.076558 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b348d671-bc8c-4adc-a4c2-4698e79ea917 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:44.076985 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b348d671-bc8c-4adc-a4c2-4698e79ea917 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:44.106651 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b348d671-bc8c-4adc-a4c2-4698e79ea917 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042373 Aug 25 05:41:44.107214 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 580/1128] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:44 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:44.808677 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-15f87403-7706-4ae0-9db9-93d0beb54b58 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:44.809295 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-15f87403-7706-4ae0-9db9-93d0beb54b58 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:44.815346 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-15f87403-7706-4ae0-9db9-93d0beb54b58 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:44.815902 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-15f87403-7706-4ae0-9db9-93d0beb54b58 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:44.816677 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-15f87403-7706-4ae0-9db9-93d0beb54b58 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:44.817112 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-15f87403-7706-4ae0-9db9-93d0beb54b58 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:44.941729 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-15f87403-7706-4ae0-9db9-93d0beb54b58 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:44.950660 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-15f87403-7706-4ae0-9db9-93d0beb54b58 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.145921 Aug 25 05:41:44.951598 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 549/1129] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:44 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:45.118457 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-78497cae-3daa-4a66-b896-0d6081b44b77 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:45.119269 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-78497cae-3daa-4a66-b896-0d6081b44b77 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:45.126670 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-78497cae-3daa-4a66-b896-0d6081b44b77 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:45.127111 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-78497cae-3daa-4a66-b896-0d6081b44b77 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:45.127869 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-78497cae-3daa-4a66-b896-0d6081b44b77 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:45.128291 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-78497cae-3daa-4a66-b896-0d6081b44b77 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:45.161240 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-78497cae-3daa-4a66-b896-0d6081b44b77 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046245 Aug 25 05:41:45.162376 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 581/1130] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:45 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:45.969142 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-f8a6f78e-4154-434e-82e8-e6e523e82cea tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:45.969768 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-f8a6f78e-4154-434e-82e8-e6e523e82cea tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:45.975703 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f8a6f78e-4154-434e-82e8-e6e523e82cea tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:45.976090 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f8a6f78e-4154-434e-82e8-e6e523e82cea tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:45.976837 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f8a6f78e-4154-434e-82e8-e6e523e82cea tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:45.977262 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f8a6f78e-4154-434e-82e8-e6e523e82cea tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:46.098067 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-f8a6f78e-4154-434e-82e8-e6e523e82cea tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:46.105182 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-f8a6f78e-4154-434e-82e8-e6e523e82cea tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.139765 Aug 25 05:41:46.105768 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 550/1131] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:45 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:46.173259 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-0d1d28e2-b162-4365-afd0-79f6b70036df tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:46.174182 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-0d1d28e2-b162-4365-afd0-79f6b70036df tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:46.179871 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0d1d28e2-b162-4365-afd0-79f6b70036df tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:46.180341 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0d1d28e2-b162-4365-afd0-79f6b70036df tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:46.181090 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0d1d28e2-b162-4365-afd0-79f6b70036df tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:46.181517 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0d1d28e2-b162-4365-afd0-79f6b70036df tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:46.210447 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-0d1d28e2-b162-4365-afd0-79f6b70036df tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040922 Aug 25 05:41:46.210988 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 582/1132] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:46 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:47.122148 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6786d17e-8de3-4469-9402-c21b0d4dc19c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:47.122792 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6786d17e-8de3-4469-9402-c21b0d4dc19c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:47.128556 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6786d17e-8de3-4469-9402-c21b0d4dc19c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:47.128999 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6786d17e-8de3-4469-9402-c21b0d4dc19c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:47.129787 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6786d17e-8de3-4469-9402-c21b0d4dc19c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:47.130217 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6786d17e-8de3-4469-9402-c21b0d4dc19c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:47.221425 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5a13ee0c-1517-4488-95ff-668c56b34aed tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:47.222358 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5a13ee0c-1517-4488-95ff-668c56b34aed tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:47.228145 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5a13ee0c-1517-4488-95ff-668c56b34aed tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:47.228583 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5a13ee0c-1517-4488-95ff-668c56b34aed tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:47.229346 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5a13ee0c-1517-4488-95ff-668c56b34aed tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:47.230332 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5a13ee0c-1517-4488-95ff-668c56b34aed tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:47.254895 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6786d17e-8de3-4469-9402-c21b0d4dc19c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:47.259939 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5a13ee0c-1517-4488-95ff-668c56b34aed tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042258 Aug 25 05:41:47.260500 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 583/1133] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:47 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:47.262857 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6786d17e-8de3-4469-9402-c21b0d4dc19c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.144967 Aug 25 05:41:47.263410 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 551/1134] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:47 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:48.271915 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-3ee39a26-2a8a-4562-bfd8-925072879b39 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:48.272725 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-3ee39a26-2a8a-4562-bfd8-925072879b39 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:48.279103 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3ee39a26-2a8a-4562-bfd8-925072879b39 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:48.279450 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1e7b3b5d-756b-47b5-9bab-229c157994fb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:48.279937 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3ee39a26-2a8a-4562-bfd8-925072879b39 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:48.280070 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1e7b3b5d-756b-47b5-9bab-229c157994fb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:48.280358 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3ee39a26-2a8a-4562-bfd8-925072879b39 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:48.280718 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3ee39a26-2a8a-4562-bfd8-925072879b39 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:48.285872 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1e7b3b5d-756b-47b5-9bab-229c157994fb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:48.286321 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1e7b3b5d-756b-47b5-9bab-229c157994fb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:48.287086 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1e7b3b5d-756b-47b5-9bab-229c157994fb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:48.287519 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1e7b3b5d-756b-47b5-9bab-229c157994fb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:48.310474 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-3ee39a26-2a8a-4562-bfd8-925072879b39 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042489 Aug 25 05:41:48.311039 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 584/1135] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:48 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:48.407239 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-1e7b3b5d-756b-47b5-9bab-229c157994fb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:48.414762 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1e7b3b5d-756b-47b5-9bab-229c157994fb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.139235 Aug 25 05:41:48.415335 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 552/1136] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:48 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:41:49.321250 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9d197aeb-cb10-4117-9694-41c0a44f300c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:49.322172 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9d197aeb-cb10-4117-9694-41c0a44f300c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:49.328977 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9d197aeb-cb10-4117-9694-41c0a44f300c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:49.329415 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9d197aeb-cb10-4117-9694-41c0a44f300c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:49.330203 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9d197aeb-cb10-4117-9694-41c0a44f300c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:49.330635 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9d197aeb-cb10-4117-9694-41c0a44f300c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:49.359662 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9d197aeb-cb10-4117-9694-41c0a44f300c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042060 Aug 25 05:41:49.360212 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 585/1137] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:49 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:49.432165 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7eb6452f-2018-4107-bd6d-d6c895d3bd5b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:49.433769 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7eb6452f-2018-4107-bd6d-d6c895d3bd5b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:49.439776 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7eb6452f-2018-4107-bd6d-d6c895d3bd5b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:49.440220 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7eb6452f-2018-4107-bd6d-d6c895d3bd5b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:49.440977 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7eb6452f-2018-4107-bd6d-d6c895d3bd5b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:49.441406 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7eb6452f-2018-4107-bd6d-d6c895d3bd5b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:49.564445 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-7eb6452f-2018-4107-bd6d-d6c895d3bd5b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:49.571752 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7eb6452f-2018-4107-bd6d-d6c895d3bd5b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.143225 Aug 25 05:41:49.572239 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 553/1138] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:49 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:41:50.371186 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d2044b86-053d-4ada-8f5e-df6088987d12 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:50.372260 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d2044b86-053d-4ada-8f5e-df6088987d12 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:50.379538 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d2044b86-053d-4ada-8f5e-df6088987d12 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:50.380336 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d2044b86-053d-4ada-8f5e-df6088987d12 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:50.381383 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d2044b86-053d-4ada-8f5e-df6088987d12 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:50.381882 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d2044b86-053d-4ada-8f5e-df6088987d12 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:50.416955 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d2044b86-053d-4ada-8f5e-df6088987d12 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049552 Aug 25 05:41:50.417654 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 586/1139] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:50 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:50.589468 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d108cb39-3760-467e-8b3f-613d5392b3c2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:50.590418 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-d108cb39-3760-467e-8b3f-613d5392b3c2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:50.596265 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d108cb39-3760-467e-8b3f-613d5392b3c2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:50.596709 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d108cb39-3760-467e-8b3f-613d5392b3c2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:50.597485 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d108cb39-3760-467e-8b3f-613d5392b3c2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:50.597939 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d108cb39-3760-467e-8b3f-613d5392b3c2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:50.732698 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-d108cb39-3760-467e-8b3f-613d5392b3c2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:50.740213 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d108cb39-3760-467e-8b3f-613d5392b3c2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.155084 Aug 25 05:41:50.740794 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 554/1140] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:50 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:41:51.429133 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9f7f5cca-addf-43ad-9a23-be1257e10134 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:51.429666 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9f7f5cca-addf-43ad-9a23-be1257e10134 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:51.436267 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9f7f5cca-addf-43ad-9a23-be1257e10134 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:51.436709 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9f7f5cca-addf-43ad-9a23-be1257e10134 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:51.437478 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9f7f5cca-addf-43ad-9a23-be1257e10134 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:51.437946 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9f7f5cca-addf-43ad-9a23-be1257e10134 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:51.466930 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9f7f5cca-addf-43ad-9a23-be1257e10134 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041982 Aug 25 05:41:51.467475 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 587/1141] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:51 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:51.757501 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6a9e43e9-d18b-4a48-b65c-24dd894d908a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:51.758081 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6a9e43e9-d18b-4a48-b65c-24dd894d908a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:51.764382 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6a9e43e9-d18b-4a48-b65c-24dd894d908a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:51.764832 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6a9e43e9-d18b-4a48-b65c-24dd894d908a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:51.765632 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6a9e43e9-d18b-4a48-b65c-24dd894d908a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:51.766174 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6a9e43e9-d18b-4a48-b65c-24dd894d908a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:51.885440 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6a9e43e9-d18b-4a48-b65c-24dd894d908a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:51.893260 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6a9e43e9-d18b-4a48-b65c-24dd894d908a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.139568 Aug 25 05:41:51.894026 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 555/1142] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:51 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:52.478579 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d884b5b3-a640-47e3-b360-d3f2a7b1e7e9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:52.479403 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d884b5b3-a640-47e3-b360-d3f2a7b1e7e9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:52.486060 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d884b5b3-a640-47e3-b360-d3f2a7b1e7e9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:52.486498 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d884b5b3-a640-47e3-b360-d3f2a7b1e7e9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:52.487274 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d884b5b3-a640-47e3-b360-d3f2a7b1e7e9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:52.487697 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d884b5b3-a640-47e3-b360-d3f2a7b1e7e9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:52.516936 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d884b5b3-a640-47e3-b360-d3f2a7b1e7e9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042226 Aug 25 05:41:52.517654 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 588/1143] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:52 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:52.911148 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c0a501ef-b576-4512-ac02-c183ff4369ae tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:52.911767 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c0a501ef-b576-4512-ac02-c183ff4369ae tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:52.917834 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c0a501ef-b576-4512-ac02-c183ff4369ae tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:52.918278 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c0a501ef-b576-4512-ac02-c183ff4369ae tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:52.919038 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c0a501ef-b576-4512-ac02-c183ff4369ae tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:52.919463 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c0a501ef-b576-4512-ac02-c183ff4369ae tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:53.042232 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-c0a501ef-b576-4512-ac02-c183ff4369ae tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:53.049333 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c0a501ef-b576-4512-ac02-c183ff4369ae tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.141923 Aug 25 05:41:53.049916 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 556/1144] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:52 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:53.529227 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a523d997-dac8-4345-8b19-8843fdb49363 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:53.530176 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a523d997-dac8-4345-8b19-8843fdb49363 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:53.536164 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a523d997-dac8-4345-8b19-8843fdb49363 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:53.536605 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a523d997-dac8-4345-8b19-8843fdb49363 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:53.537363 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a523d997-dac8-4345-8b19-8843fdb49363 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:53.537837 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a523d997-dac8-4345-8b19-8843fdb49363 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:53.568916 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a523d997-dac8-4345-8b19-8843fdb49363 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043966 Aug 25 05:41:53.569478 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 589/1145] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:53 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:54.066256 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-43a8137c-4aef-431d-b62d-65d2eee3c72a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:54.066869 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-43a8137c-4aef-431d-b62d-65d2eee3c72a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:54.072693 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-43a8137c-4aef-431d-b62d-65d2eee3c72a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:54.073690 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-43a8137c-4aef-431d-b62d-65d2eee3c72a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:54.074701 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-43a8137c-4aef-431d-b62d-65d2eee3c72a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:54.075135 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-43a8137c-4aef-431d-b62d-65d2eee3c72a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:54.201353 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-43a8137c-4aef-431d-b62d-65d2eee3c72a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:54.208530 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-43a8137c-4aef-431d-b62d-65d2eee3c72a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.146028 Aug 25 05:41:54.209094 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 557/1146] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:54 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:54.580595 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d5848893-5e81-4b4e-ae18-faf71ccbd612 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:54.581589 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d5848893-5e81-4b4e-ae18-faf71ccbd612 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:54.587334 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d5848893-5e81-4b4e-ae18-faf71ccbd612 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:54.587772 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d5848893-5e81-4b4e-ae18-faf71ccbd612 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:54.588523 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d5848893-5e81-4b4e-ae18-faf71ccbd612 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:54.588951 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d5848893-5e81-4b4e-ae18-faf71ccbd612 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:54.617092 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d5848893-5e81-4b4e-ae18-faf71ccbd612 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040372 Aug 25 05:41:54.617665 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 590/1147] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:54 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:55.225861 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a1797b52-2d3a-4944-a3b9-ff2fd8022866 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:55.226501 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a1797b52-2d3a-4944-a3b9-ff2fd8022866 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:55.232699 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a1797b52-2d3a-4944-a3b9-ff2fd8022866 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:55.233146 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a1797b52-2d3a-4944-a3b9-ff2fd8022866 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:55.233924 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a1797b52-2d3a-4944-a3b9-ff2fd8022866 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:55.234355 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a1797b52-2d3a-4944-a3b9-ff2fd8022866 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:55.357345 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-a1797b52-2d3a-4944-a3b9-ff2fd8022866 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:55.364541 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a1797b52-2d3a-4944-a3b9-ff2fd8022866 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.142347 Aug 25 05:41:55.365099 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 558/1148] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:55 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:55.629647 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2a214e4c-4f49-4a10-8ce2-3f17c1892a8b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:55.630542 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2a214e4c-4f49-4a10-8ce2-3f17c1892a8b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:55.636443 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2a214e4c-4f49-4a10-8ce2-3f17c1892a8b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:55.636883 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2a214e4c-4f49-4a10-8ce2-3f17c1892a8b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:55.637674 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2a214e4c-4f49-4a10-8ce2-3f17c1892a8b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:55.638106 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2a214e4c-4f49-4a10-8ce2-3f17c1892a8b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:55.667355 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2a214e4c-4f49-4a10-8ce2-3f17c1892a8b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040980 Aug 25 05:41:55.667984 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 591/1149] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:55 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:56.390595 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-bdea4b5f-c0c6-442f-9e48-9e79dddde676 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:56.391203 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-bdea4b5f-c0c6-442f-9e48-9e79dddde676 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:56.398653 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bdea4b5f-c0c6-442f-9e48-9e79dddde676 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:56.399096 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bdea4b5f-c0c6-442f-9e48-9e79dddde676 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:56.399869 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bdea4b5f-c0c6-442f-9e48-9e79dddde676 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:56.400293 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bdea4b5f-c0c6-442f-9e48-9e79dddde676 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:56.537304 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-bdea4b5f-c0c6-442f-9e48-9e79dddde676 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:56.545817 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-bdea4b5f-c0c6-442f-9e48-9e79dddde676 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.166137 Aug 25 05:41:56.546379 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 559/1150] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:56 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:56.679332 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7a26d351-a528-4978-9bd1-eec09872d7b5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:56.680142 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-7a26d351-a528-4978-9bd1-eec09872d7b5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:56.688578 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7a26d351-a528-4978-9bd1-eec09872d7b5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:56.689298 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7a26d351-a528-4978-9bd1-eec09872d7b5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:56.690328 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7a26d351-a528-4978-9bd1-eec09872d7b5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:56.690818 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7a26d351-a528-4978-9bd1-eec09872d7b5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:56.720226 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-7a26d351-a528-4978-9bd1-eec09872d7b5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044722 Aug 25 05:41:56.720775 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 592/1151] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:56 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:57.563107 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-987a5b33-a98d-411b-aa96-b24d1f9bb6f2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:57.563706 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-987a5b33-a98d-411b-aa96-b24d1f9bb6f2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:57.569638 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-987a5b33-a98d-411b-aa96-b24d1f9bb6f2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:57.570079 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-987a5b33-a98d-411b-aa96-b24d1f9bb6f2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:57.570827 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-987a5b33-a98d-411b-aa96-b24d1f9bb6f2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:57.571263 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-987a5b33-a98d-411b-aa96-b24d1f9bb6f2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:57.703107 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-987a5b33-a98d-411b-aa96-b24d1f9bb6f2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:57.710567 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-987a5b33-a98d-411b-aa96-b24d1f9bb6f2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.151102 Aug 25 05:41:57.711146 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 560/1152] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:57 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:57.732083 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b070f3a4-3f5e-4240-af2e-58b5f1e73c02 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:57.733000 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b070f3a4-3f5e-4240-af2e-58b5f1e73c02 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:57.739155 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b070f3a4-3f5e-4240-af2e-58b5f1e73c02 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:57.739594 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b070f3a4-3f5e-4240-af2e-58b5f1e73c02 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:57.740369 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b070f3a4-3f5e-4240-af2e-58b5f1e73c02 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:57.740803 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b070f3a4-3f5e-4240-af2e-58b5f1e73c02 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:57.771509 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b070f3a4-3f5e-4240-af2e-58b5f1e73c02 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043433 Aug 25 05:41:57.772079 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 593/1153] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:57 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:58.728370 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-cff0ce38-6321-41ad-9219-d654a71ec5ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:58.728945 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-cff0ce38-6321-41ad-9219-d654a71ec5ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:58.736036 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cff0ce38-6321-41ad-9219-d654a71ec5ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:58.736479 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cff0ce38-6321-41ad-9219-d654a71ec5ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:58.737282 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cff0ce38-6321-41ad-9219-d654a71ec5ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:58.737739 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cff0ce38-6321-41ad-9219-d654a71ec5ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:58.782690 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-861731be-ec83-42b7-94b0-f268fe8bb179 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:58.783589 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-861731be-ec83-42b7-94b0-f268fe8bb179 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:58.789303 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-861731be-ec83-42b7-94b0-f268fe8bb179 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:58.789784 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-861731be-ec83-42b7-94b0-f268fe8bb179 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:58.790549 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-861731be-ec83-42b7-94b0-f268fe8bb179 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:58.790978 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-861731be-ec83-42b7-94b0-f268fe8bb179 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:58.821403 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-861731be-ec83-42b7-94b0-f268fe8bb179 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042407 Aug 25 05:41:58.822074 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 594/1154] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:58 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:41:58.862827 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-cff0ce38-6321-41ad-9219-d654a71ec5ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:41:58.871640 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-cff0ce38-6321-41ad-9219-d654a71ec5ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.146767 Aug 25 05:41:58.877489 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 561/1155] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:58 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:41:59.833887 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d63be9d8-644d-434e-af68-75ab78356bdc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:59.834785 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d63be9d8-644d-434e-af68-75ab78356bdc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:59.842266 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d63be9d8-644d-434e-af68-75ab78356bdc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:59.842813 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d63be9d8-644d-434e-af68-75ab78356bdc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:59.843671 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d63be9d8-644d-434e-af68-75ab78356bdc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:59.844157 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d63be9d8-644d-434e-af68-75ab78356bdc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:59.876062 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d63be9d8-644d-434e-af68-75ab78356bdc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045993 Aug 25 05:41:59.876646 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 595/1156] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:41:59 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:41:59.897194 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e5132238-405b-4835-bfb3-a9381b86da2a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:41:59.898309 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e5132238-405b-4835-bfb3-a9381b86da2a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:41:59.907073 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e5132238-405b-4835-bfb3-a9381b86da2a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:59.907835 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e5132238-405b-4835-bfb3-a9381b86da2a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:41:59.908953 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e5132238-405b-4835-bfb3-a9381b86da2a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:41:59.909903 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e5132238-405b-4835-bfb3-a9381b86da2a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:00.040140 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e5132238-405b-4835-bfb3-a9381b86da2a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:00.047795 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e5132238-405b-4835-bfb3-a9381b86da2a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.157727 Aug 25 05:42:00.048357 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 562/1157] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:41:59 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:00.890361 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2a06d2be-c6d4-482f-950d-4e727d7277e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:00.891173 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2a06d2be-c6d4-482f-950d-4e727d7277e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:00.897069 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2a06d2be-c6d4-482f-950d-4e727d7277e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:00.897505 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2a06d2be-c6d4-482f-950d-4e727d7277e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:00.898293 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2a06d2be-c6d4-482f-950d-4e727d7277e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:00.898720 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2a06d2be-c6d4-482f-950d-4e727d7277e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:00.927895 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2a06d2be-c6d4-482f-950d-4e727d7277e2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042117 Aug 25 05:42:00.928446 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 596/1158] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:00 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:01.066553 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7e097e64-c9d9-47e4-ab29-180e9d0eb414 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:01.067186 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7e097e64-c9d9-47e4-ab29-180e9d0eb414 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:01.073812 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7e097e64-c9d9-47e4-ab29-180e9d0eb414 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:01.074274 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7e097e64-c9d9-47e4-ab29-180e9d0eb414 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:01.075059 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7e097e64-c9d9-47e4-ab29-180e9d0eb414 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:01.075523 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7e097e64-c9d9-47e4-ab29-180e9d0eb414 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:01.208911 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-7e097e64-c9d9-47e4-ab29-180e9d0eb414 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:01.216551 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7e097e64-c9d9-47e4-ab29-180e9d0eb414 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.153609 Aug 25 05:42:01.217325 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 563/1159] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:01 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:01.940062 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-3c37c0bd-e132-4f15-8013-d4e885062a64 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:01.940887 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-3c37c0bd-e132-4f15-8013-d4e885062a64 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:01.947200 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3c37c0bd-e132-4f15-8013-d4e885062a64 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:01.947744 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3c37c0bd-e132-4f15-8013-d4e885062a64 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:01.949111 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3c37c0bd-e132-4f15-8013-d4e885062a64 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:01.949564 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3c37c0bd-e132-4f15-8013-d4e885062a64 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:01.983534 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-3c37c0bd-e132-4f15-8013-d4e885062a64 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046328 Aug 25 05:42:01.984820 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 597/1160] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:01 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:42:02.233474 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3bbe556f-2699-48d2-a2c6-ac8c93ce2a41 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:02.234033 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3bbe556f-2699-48d2-a2c6-ac8c93ce2a41 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:02.239865 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3bbe556f-2699-48d2-a2c6-ac8c93ce2a41 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:02.240319 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3bbe556f-2699-48d2-a2c6-ac8c93ce2a41 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:02.241050 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3bbe556f-2699-48d2-a2c6-ac8c93ce2a41 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:02.241474 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3bbe556f-2699-48d2-a2c6-ac8c93ce2a41 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:02.365280 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-3bbe556f-2699-48d2-a2c6-ac8c93ce2a41 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:02.373793 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3bbe556f-2699-48d2-a2c6-ac8c93ce2a41 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.143914 Aug 25 05:42:02.374603 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 564/1161] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:02 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:02.997006 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-99b2a7e6-5d0c-4273-aba3-b6b81a5a7d25 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:02.998517 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-99b2a7e6-5d0c-4273-aba3-b6b81a5a7d25 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:03.005421 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-99b2a7e6-5d0c-4273-aba3-b6b81a5a7d25 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:03.005907 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-99b2a7e6-5d0c-4273-aba3-b6b81a5a7d25 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:03.006671 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-99b2a7e6-5d0c-4273-aba3-b6b81a5a7d25 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:03.007095 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-99b2a7e6-5d0c-4273-aba3-b6b81a5a7d25 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:03.036946 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-99b2a7e6-5d0c-4273-aba3-b6b81a5a7d25 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044907 Aug 25 05:42:03.037560 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 598/1162] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:02 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:03.391895 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d9d83a7c-ad33-4b08-9ac9-691cc1544c52 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:03.392529 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-d9d83a7c-ad33-4b08-9ac9-691cc1544c52 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:03.398366 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d9d83a7c-ad33-4b08-9ac9-691cc1544c52 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:03.398803 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d9d83a7c-ad33-4b08-9ac9-691cc1544c52 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:03.399559 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d9d83a7c-ad33-4b08-9ac9-691cc1544c52 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:03.399984 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d9d83a7c-ad33-4b08-9ac9-691cc1544c52 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:03.522760 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-d9d83a7c-ad33-4b08-9ac9-691cc1544c52 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:03.532073 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d9d83a7c-ad33-4b08-9ac9-691cc1544c52 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.144128 Aug 25 05:42:03.532639 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 565/1163] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:03 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:04.048448 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e4b83d9b-8b83-439d-8b94-db72f20cb117 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:04.049338 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e4b83d9b-8b83-439d-8b94-db72f20cb117 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:04.055117 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e4b83d9b-8b83-439d-8b94-db72f20cb117 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:04.055558 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e4b83d9b-8b83-439d-8b94-db72f20cb117 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:04.056318 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e4b83d9b-8b83-439d-8b94-db72f20cb117 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:04.056747 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e4b83d9b-8b83-439d-8b94-db72f20cb117 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:04.087244 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e4b83d9b-8b83-439d-8b94-db72f20cb117 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042521 Aug 25 05:42:04.087794 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 599/1164] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:04 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:04.548924 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6a7e736e-048f-43c9-a55b-8a94fb03d733 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:04.549606 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6a7e736e-048f-43c9-a55b-8a94fb03d733 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:04.555343 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6a7e736e-048f-43c9-a55b-8a94fb03d733 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:04.555780 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6a7e736e-048f-43c9-a55b-8a94fb03d733 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:04.556535 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6a7e736e-048f-43c9-a55b-8a94fb03d733 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:04.556964 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6a7e736e-048f-43c9-a55b-8a94fb03d733 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:04.681673 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6a7e736e-048f-43c9-a55b-8a94fb03d733 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:04.689394 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6a7e736e-048f-43c9-a55b-8a94fb03d733 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.144078 Aug 25 05:42:04.694326 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 566/1165] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:04 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:05.098298 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-0b995daf-e9b6-40c1-911a-ab88b7c22a6e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:05.099123 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-0b995daf-e9b6-40c1-911a-ab88b7c22a6e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:05.105775 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0b995daf-e9b6-40c1-911a-ab88b7c22a6e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:05.106225 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0b995daf-e9b6-40c1-911a-ab88b7c22a6e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:05.106994 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0b995daf-e9b6-40c1-911a-ab88b7c22a6e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:05.107430 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0b995daf-e9b6-40c1-911a-ab88b7c22a6e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:05.135976 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-0b995daf-e9b6-40c1-911a-ab88b7c22a6e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041502 Aug 25 05:42:05.136517 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 600/1166] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:05 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:05.709753 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-316088f0-39ff-4b9c-bdeb-2e1a3a509938 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:05.710296 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-316088f0-39ff-4b9c-bdeb-2e1a3a509938 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:05.716868 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-316088f0-39ff-4b9c-bdeb-2e1a3a509938 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:05.717310 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-316088f0-39ff-4b9c-bdeb-2e1a3a509938 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:05.718082 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-316088f0-39ff-4b9c-bdeb-2e1a3a509938 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:05.718508 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-316088f0-39ff-4b9c-bdeb-2e1a3a509938 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:05.841516 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-316088f0-39ff-4b9c-bdeb-2e1a3a509938 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:05.849059 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-316088f0-39ff-4b9c-bdeb-2e1a3a509938 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.143012 Aug 25 05:42:05.849654 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 567/1167] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:05 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:06.147693 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-86b10ed2-31d5-4a26-b790-b8a18c09e230 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:06.148593 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-86b10ed2-31d5-4a26-b790-b8a18c09e230 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:06.154800 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-86b10ed2-31d5-4a26-b790-b8a18c09e230 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:06.155246 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-86b10ed2-31d5-4a26-b790-b8a18c09e230 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:06.156134 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-86b10ed2-31d5-4a26-b790-b8a18c09e230 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:06.156572 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-86b10ed2-31d5-4a26-b790-b8a18c09e230 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:06.185746 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-86b10ed2-31d5-4a26-b790-b8a18c09e230 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041829 Aug 25 05:42:06.186298 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 601/1168] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:06 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:42:06.868307 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-cba195ee-91d2-4dfd-a141-6071398f13c6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:06.868855 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-cba195ee-91d2-4dfd-a141-6071398f13c6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:06.874652 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cba195ee-91d2-4dfd-a141-6071398f13c6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:06.875086 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cba195ee-91d2-4dfd-a141-6071398f13c6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:06.875833 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cba195ee-91d2-4dfd-a141-6071398f13c6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:06.876255 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cba195ee-91d2-4dfd-a141-6071398f13c6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:06.997512 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-cba195ee-91d2-4dfd-a141-6071398f13c6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:07.004707 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-cba195ee-91d2-4dfd-a141-6071398f13c6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.140084 Aug 25 05:42:07.005266 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 568/1169] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:06 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:07.196986 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-08e8e212-13a6-424e-9571-af0c693a801d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:07.198321 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-08e8e212-13a6-424e-9571-af0c693a801d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:07.204434 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-08e8e212-13a6-424e-9571-af0c693a801d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:07.204877 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-08e8e212-13a6-424e-9571-af0c693a801d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:07.205742 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-08e8e212-13a6-424e-9571-af0c693a801d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:07.206176 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-08e8e212-13a6-424e-9571-af0c693a801d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:07.234622 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-08e8e212-13a6-424e-9571-af0c693a801d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041432 Aug 25 05:42:07.235161 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 602/1170] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:07 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:08.021576 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b26f1986-9699-4297-ad19-83d5f58abf41 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:08.022758 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b26f1986-9699-4297-ad19-83d5f58abf41 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:08.029730 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b26f1986-9699-4297-ad19-83d5f58abf41 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:08.030169 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b26f1986-9699-4297-ad19-83d5f58abf41 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:08.030925 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b26f1986-9699-4297-ad19-83d5f58abf41 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:08.031370 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b26f1986-9699-4297-ad19-83d5f58abf41 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:08.154256 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-b26f1986-9699-4297-ad19-83d5f58abf41 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:08.161505 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b26f1986-9699-4297-ad19-83d5f58abf41 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.143560 Aug 25 05:42:08.162095 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 569/1171] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:08 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:08.245899 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e6e5fa5d-2071-4039-977d-01fff6f91c10 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:08.246753 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e6e5fa5d-2071-4039-977d-01fff6f91c10 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:08.253319 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e6e5fa5d-2071-4039-977d-01fff6f91c10 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:08.253789 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e6e5fa5d-2071-4039-977d-01fff6f91c10 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:08.254546 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e6e5fa5d-2071-4039-977d-01fff6f91c10 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:08.254976 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e6e5fa5d-2071-4039-977d-01fff6f91c10 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:08.283787 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e6e5fa5d-2071-4039-977d-01fff6f91c10 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041729 Aug 25 05:42:08.284334 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 603/1172] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:08 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:09.178354 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-cbbdc32e-f342-4dd5-9747-2244a4ad4201 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:09.178963 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-cbbdc32e-f342-4dd5-9747-2244a4ad4201 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:09.185742 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cbbdc32e-f342-4dd5-9747-2244a4ad4201 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:09.186188 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cbbdc32e-f342-4dd5-9747-2244a4ad4201 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:09.186943 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cbbdc32e-f342-4dd5-9747-2244a4ad4201 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:09.187376 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cbbdc32e-f342-4dd5-9747-2244a4ad4201 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:09.295591 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2671a082-b005-41ce-a31d-2f416306f909 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:09.307302 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2671a082-b005-41ce-a31d-2f416306f909 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:09.307302 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2671a082-b005-41ce-a31d-2f416306f909 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:09.307302 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2671a082-b005-41ce-a31d-2f416306f909 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:09.307302 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2671a082-b005-41ce-a31d-2f416306f909 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:09.308338 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2671a082-b005-41ce-a31d-2f416306f909 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:09.308435 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-cbbdc32e-f342-4dd5-9747-2244a4ad4201 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:09.315091 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-cbbdc32e-f342-4dd5-9747-2244a4ad4201 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.140338 Aug 25 05:42:09.315687 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 570/1173] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:09 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:09.334847 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2671a082-b005-41ce-a31d-2f416306f909 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043345 Aug 25 05:42:09.335975 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 604/1174] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:09 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:10.332959 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-14d5c42e-bd2d-4e49-ab9c-862af00f0b78 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:10.333543 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-14d5c42e-bd2d-4e49-ab9c-862af00f0b78 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:10.340247 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-14d5c42e-bd2d-4e49-ab9c-862af00f0b78 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:10.340743 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-14d5c42e-bd2d-4e49-ab9c-862af00f0b78 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:10.341679 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-14d5c42e-bd2d-4e49-ab9c-862af00f0b78 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:10.342109 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-14d5c42e-bd2d-4e49-ab9c-862af00f0b78 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:10.346435 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-095c5c58-c56b-4373-979e-198bbd8f1f3c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:10.347343 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-095c5c58-c56b-4373-979e-198bbd8f1f3c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:10.353934 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-095c5c58-c56b-4373-979e-198bbd8f1f3c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:10.354135 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-095c5c58-c56b-4373-979e-198bbd8f1f3c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:10.354968 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-095c5c58-c56b-4373-979e-198bbd8f1f3c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:10.355391 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-095c5c58-c56b-4373-979e-198bbd8f1f3c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:10.385143 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-095c5c58-c56b-4373-979e-198bbd8f1f3c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042512 Aug 25 05:42:10.386436 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 605/1175] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:10 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:42:10.473544 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-14d5c42e-bd2d-4e49-ab9c-862af00f0b78 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:10.480935 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-14d5c42e-bd2d-4e49-ab9c-862af00f0b78 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.151668 Aug 25 05:42:10.481952 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 571/1176] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:10 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:11.397323 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d786eca6-02c1-48c7-b6b2-073b82a5a44e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:11.398241 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d786eca6-02c1-48c7-b6b2-073b82a5a44e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:11.404495 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d786eca6-02c1-48c7-b6b2-073b82a5a44e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:11.404941 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d786eca6-02c1-48c7-b6b2-073b82a5a44e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:11.405728 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d786eca6-02c1-48c7-b6b2-073b82a5a44e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:11.406161 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d786eca6-02c1-48c7-b6b2-073b82a5a44e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:11.435683 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d786eca6-02c1-48c7-b6b2-073b82a5a44e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042181 Aug 25 05:42:11.436371 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 606/1177] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:11 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:11.498263 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ef27d567-9a3a-40c9-b0ac-360b3294e012 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:11.498868 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ef27d567-9a3a-40c9-b0ac-360b3294e012 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:11.504548 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ef27d567-9a3a-40c9-b0ac-360b3294e012 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:11.504986 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ef27d567-9a3a-40c9-b0ac-360b3294e012 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:11.505756 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ef27d567-9a3a-40c9-b0ac-360b3294e012 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:11.506178 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ef27d567-9a3a-40c9-b0ac-360b3294e012 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:11.628356 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ef27d567-9a3a-40c9-b0ac-360b3294e012 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:11.635635 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ef27d567-9a3a-40c9-b0ac-360b3294e012 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.141793 Aug 25 05:42:11.636193 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 572/1178] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:11 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:12.447379 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-44e6e0b0-babb-4204-b517-a87881547fbd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:12.448192 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-44e6e0b0-babb-4204-b517-a87881547fbd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:12.454539 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-44e6e0b0-babb-4204-b517-a87881547fbd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:12.454975 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-44e6e0b0-babb-4204-b517-a87881547fbd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:12.455725 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-44e6e0b0-babb-4204-b517-a87881547fbd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:12.456149 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-44e6e0b0-babb-4204-b517-a87881547fbd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:12.489768 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-44e6e0b0-babb-4204-b517-a87881547fbd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046117 Aug 25 05:42:12.490323 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 607/1179] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:12 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:12.652746 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7ee21424-f660-4d00-87bd-81e48c193ff3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:12.658682 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7ee21424-f660-4d00-87bd-81e48c193ff3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:12.659970 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7ee21424-f660-4d00-87bd-81e48c193ff3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:12.660529 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7ee21424-f660-4d00-87bd-81e48c193ff3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:12.661322 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7ee21424-f660-4d00-87bd-81e48c193ff3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:12.661832 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7ee21424-f660-4d00-87bd-81e48c193ff3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:12.785112 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-7ee21424-f660-4d00-87bd-81e48c193ff3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:12.792535 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7ee21424-f660-4d00-87bd-81e48c193ff3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.144192 Aug 25 05:42:12.793613 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 573/1180] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:12 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:13.501362 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5b2fe186-e2fa-4201-bc2b-2aa3d9938330 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:13.502234 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5b2fe186-e2fa-4201-bc2b-2aa3d9938330 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:13.507833 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5b2fe186-e2fa-4201-bc2b-2aa3d9938330 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:13.508269 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5b2fe186-e2fa-4201-bc2b-2aa3d9938330 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:13.509022 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5b2fe186-e2fa-4201-bc2b-2aa3d9938330 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:13.509447 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5b2fe186-e2fa-4201-bc2b-2aa3d9938330 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:13.539941 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5b2fe186-e2fa-4201-bc2b-2aa3d9938330 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042367 Aug 25 05:42:13.540489 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 608/1181] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:13 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:13.810177 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-693800b1-89fd-4e44-80b0-9e2e0c82d157 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:13.810798 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-693800b1-89fd-4e44-80b0-9e2e0c82d157 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:13.816585 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-693800b1-89fd-4e44-80b0-9e2e0c82d157 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:13.817026 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-693800b1-89fd-4e44-80b0-9e2e0c82d157 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:13.817809 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-693800b1-89fd-4e44-80b0-9e2e0c82d157 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:13.818237 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-693800b1-89fd-4e44-80b0-9e2e0c82d157 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:13.939961 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-693800b1-89fd-4e44-80b0-9e2e0c82d157 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:13.947417 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-693800b1-89fd-4e44-80b0-9e2e0c82d157 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.141276 Aug 25 05:42:13.947982 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 574/1182] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:13 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:14.551727 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-223f722d-b183-49c4-925d-af53c0436f03 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:14.552565 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-223f722d-b183-49c4-925d-af53c0436f03 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:14.558420 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-223f722d-b183-49c4-925d-af53c0436f03 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:14.559469 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-223f722d-b183-49c4-925d-af53c0436f03 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:14.560227 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-223f722d-b183-49c4-925d-af53c0436f03 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:14.560652 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-223f722d-b183-49c4-925d-af53c0436f03 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:14.588440 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-223f722d-b183-49c4-925d-af53c0436f03 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040642 Aug 25 05:42:14.588986 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 609/1183] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:14 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:14.964676 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-f9dad373-8542-4b24-986a-1ff362882cc8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:14.966118 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-f9dad373-8542-4b24-986a-1ff362882cc8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:14.971937 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f9dad373-8542-4b24-986a-1ff362882cc8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:14.972380 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f9dad373-8542-4b24-986a-1ff362882cc8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:14.973132 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f9dad373-8542-4b24-986a-1ff362882cc8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:14.973586 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f9dad373-8542-4b24-986a-1ff362882cc8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:15.101704 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-f9dad373-8542-4b24-986a-1ff362882cc8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:15.108902 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-f9dad373-8542-4b24-986a-1ff362882cc8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.147990 Aug 25 05:42:15.109464 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 575/1184] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:14 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:15.599239 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7ca1abfc-fcd4-4b06-b90b-af6d677ff7e7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:15.600061 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-7ca1abfc-fcd4-4b06-b90b-af6d677ff7e7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:15.605768 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7ca1abfc-fcd4-4b06-b90b-af6d677ff7e7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:15.606216 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7ca1abfc-fcd4-4b06-b90b-af6d677ff7e7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:15.607141 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7ca1abfc-fcd4-4b06-b90b-af6d677ff7e7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:15.607563 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7ca1abfc-fcd4-4b06-b90b-af6d677ff7e7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:15.635165 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-7ca1abfc-fcd4-4b06-b90b-af6d677ff7e7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039735 Aug 25 05:42:15.635702 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 610/1185] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:15 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:16.126494 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-68cfec7a-b993-4d64-9a17-0efbbd14e427 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:16.127127 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-68cfec7a-b993-4d64-9a17-0efbbd14e427 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:16.132902 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-68cfec7a-b993-4d64-9a17-0efbbd14e427 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:16.133358 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-68cfec7a-b993-4d64-9a17-0efbbd14e427 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:16.134154 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-68cfec7a-b993-4d64-9a17-0efbbd14e427 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:16.134584 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-68cfec7a-b993-4d64-9a17-0efbbd14e427 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:16.253519 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-68cfec7a-b993-4d64-9a17-0efbbd14e427 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:16.260814 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-68cfec7a-b993-4d64-9a17-0efbbd14e427 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.137961 Aug 25 05:42:16.261385 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 576/1186] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:16 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:16.647231 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b7d698bc-486b-4fb3-b8a9-d4593b87ada8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:16.648176 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b7d698bc-486b-4fb3-b8a9-d4593b87ada8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:16.655356 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b7d698bc-486b-4fb3-b8a9-d4593b87ada8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:16.655791 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b7d698bc-486b-4fb3-b8a9-d4593b87ada8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:16.656563 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b7d698bc-486b-4fb3-b8a9-d4593b87ada8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:16.656972 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b7d698bc-486b-4fb3-b8a9-d4593b87ada8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:16.685294 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b7d698bc-486b-4fb3-b8a9-d4593b87ada8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041894 Aug 25 05:42:16.685859 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 611/1187] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:16 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:17.278330 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7adc4339-7d1e-43bc-8c2f-71d4726f08ba tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:17.278942 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7adc4339-7d1e-43bc-8c2f-71d4726f08ba tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:17.285036 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7adc4339-7d1e-43bc-8c2f-71d4726f08ba tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:17.285504 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7adc4339-7d1e-43bc-8c2f-71d4726f08ba tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:17.286285 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7adc4339-7d1e-43bc-8c2f-71d4726f08ba tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:17.286714 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7adc4339-7d1e-43bc-8c2f-71d4726f08ba tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:17.407796 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-7adc4339-7d1e-43bc-8c2f-71d4726f08ba tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:17.415087 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7adc4339-7d1e-43bc-8c2f-71d4726f08ba tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1568 microversion: 2.1 time: 0.141023 Aug 25 05:42:17.415631 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 577/1188] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:17 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:17.696220 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-608aeb12-409f-4a35-85dc-37f92bcaaf31 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:17.697163 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-608aeb12-409f-4a35-85dc-37f92bcaaf31 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:17.703607 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-608aeb12-409f-4a35-85dc-37f92bcaaf31 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:17.704452 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-608aeb12-409f-4a35-85dc-37f92bcaaf31 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:17.705139 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-608aeb12-409f-4a35-85dc-37f92bcaaf31 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:17.705499 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-608aeb12-409f-4a35-85dc-37f92bcaaf31 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:17.735981 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-608aeb12-409f-4a35-85dc-37f92bcaaf31 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043539 Aug 25 05:42:17.736526 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 612/1189] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:17 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:18.432033 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ae7cf149-e17c-4868-8e43-7ca8dac93006 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:18.432645 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ae7cf149-e17c-4868-8e43-7ca8dac93006 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:18.439137 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ae7cf149-e17c-4868-8e43-7ca8dac93006 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:18.439578 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ae7cf149-e17c-4868-8e43-7ca8dac93006 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:18.440330 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ae7cf149-e17c-4868-8e43-7ca8dac93006 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:18.440756 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ae7cf149-e17c-4868-8e43-7ca8dac93006 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:18.579424 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ae7cf149-e17c-4868-8e43-7ca8dac93006 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:18.586748 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ae7cf149-e17c-4868-8e43-7ca8dac93006 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.158385 Aug 25 05:42:18.587314 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 578/1190] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:18 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:18.748533 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2fc02ba7-7176-4173-9b59-d64a398b9e5c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:18.749350 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2fc02ba7-7176-4173-9b59-d64a398b9e5c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:18.755185 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2fc02ba7-7176-4173-9b59-d64a398b9e5c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:18.755626 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2fc02ba7-7176-4173-9b59-d64a398b9e5c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:18.756379 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2fc02ba7-7176-4173-9b59-d64a398b9e5c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:18.756807 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2fc02ba7-7176-4173-9b59-d64a398b9e5c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:18.784915 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2fc02ba7-7176-4173-9b59-d64a398b9e5c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040941 Aug 25 05:42:18.785504 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 613/1191] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:18 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:19.603382 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-42d4d217-4aad-4879-a8cb-6a89fd69a277 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:19.603982 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-42d4d217-4aad-4879-a8cb-6a89fd69a277 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:19.610823 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-42d4d217-4aad-4879-a8cb-6a89fd69a277 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:19.611582 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-42d4d217-4aad-4879-a8cb-6a89fd69a277 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:19.612398 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-42d4d217-4aad-4879-a8cb-6a89fd69a277 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:19.612820 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-42d4d217-4aad-4879-a8cb-6a89fd69a277 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:19.737761 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-42d4d217-4aad-4879-a8cb-6a89fd69a277 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:19.747999 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-42d4d217-4aad-4879-a8cb-6a89fd69a277 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.148198 Aug 25 05:42:19.748579 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 579/1192] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:19 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:19.797144 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-863b36c4-bbb4-432a-b574-d3aca0a8c737 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:19.798056 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-863b36c4-bbb4-432a-b574-d3aca0a8c737 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:19.804172 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-863b36c4-bbb4-432a-b574-d3aca0a8c737 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:19.804636 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-863b36c4-bbb4-432a-b574-d3aca0a8c737 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:19.805446 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-863b36c4-bbb4-432a-b574-d3aca0a8c737 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:19.805905 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-863b36c4-bbb4-432a-b574-d3aca0a8c737 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:19.834029 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-863b36c4-bbb4-432a-b574-d3aca0a8c737 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040845 Aug 25 05:42:19.834570 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 614/1193] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:19 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:20.765513 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d4145187-e546-493b-8c7e-0be8affc757e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:20.766149 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-d4145187-e546-493b-8c7e-0be8affc757e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:20.772039 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d4145187-e546-493b-8c7e-0be8affc757e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:20.772486 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d4145187-e546-493b-8c7e-0be8affc757e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:20.773250 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d4145187-e546-493b-8c7e-0be8affc757e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:20.773793 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d4145187-e546-493b-8c7e-0be8affc757e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:20.846467 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-884efac1-a52e-410b-9e8d-0fcbd20205dc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:20.847278 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-884efac1-a52e-410b-9e8d-0fcbd20205dc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:20.853381 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-884efac1-a52e-410b-9e8d-0fcbd20205dc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:20.853381 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-884efac1-a52e-410b-9e8d-0fcbd20205dc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:20.854095 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-884efac1-a52e-410b-9e8d-0fcbd20205dc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:20.854589 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-884efac1-a52e-410b-9e8d-0fcbd20205dc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:20.884814 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-884efac1-a52e-410b-9e8d-0fcbd20205dc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042116 Aug 25 05:42:20.885703 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 615/1194] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:20 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:42:20.895643 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-d4145187-e546-493b-8c7e-0be8affc757e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:20.903815 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d4145187-e546-493b-8c7e-0be8affc757e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.142027 Aug 25 05:42:20.904377 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 580/1195] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:20 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:21.896566 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-eb8d9720-d3ed-492a-a14d-9dfb433f9a09 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:21.897543 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-eb8d9720-d3ed-492a-a14d-9dfb433f9a09 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:21.903549 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-eb8d9720-d3ed-492a-a14d-9dfb433f9a09 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:21.903988 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-eb8d9720-d3ed-492a-a14d-9dfb433f9a09 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:21.904767 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-eb8d9720-d3ed-492a-a14d-9dfb433f9a09 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:21.905197 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-eb8d9720-d3ed-492a-a14d-9dfb433f9a09 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:21.920640 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ee1cf186-9546-4b84-83c8-d0b832251884 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:21.921228 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ee1cf186-9546-4b84-83c8-d0b832251884 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:21.927219 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ee1cf186-9546-4b84-83c8-d0b832251884 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:21.927660 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ee1cf186-9546-4b84-83c8-d0b832251884 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:21.928428 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ee1cf186-9546-4b84-83c8-d0b832251884 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:21.928848 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ee1cf186-9546-4b84-83c8-d0b832251884 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:21.937842 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-eb8d9720-d3ed-492a-a14d-9dfb433f9a09 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045110 Aug 25 05:42:21.938519 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 616/1196] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:21 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:22.055763 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ee1cf186-9546-4b84-83c8-d0b832251884 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:22.063605 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ee1cf186-9546-4b84-83c8-d0b832251884 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.147143 Aug 25 05:42:22.064160 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 581/1197] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:21 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:42:22.949445 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1281cc77-182b-45a0-bd7f-374ab56a75ae tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:22.951088 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1281cc77-182b-45a0-bd7f-374ab56a75ae tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:22.957035 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1281cc77-182b-45a0-bd7f-374ab56a75ae tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:22.957474 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1281cc77-182b-45a0-bd7f-374ab56a75ae tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:22.958248 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1281cc77-182b-45a0-bd7f-374ab56a75ae tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:22.958673 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1281cc77-182b-45a0-bd7f-374ab56a75ae tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:22.988011 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1281cc77-182b-45a0-bd7f-374ab56a75ae tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042320 Aug 25 05:42:22.988568 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 617/1198] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:22 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:23.080249 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a3f1da81-3c50-449e-9937-2dc6dd0d271c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:23.081402 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a3f1da81-3c50-449e-9937-2dc6dd0d271c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:23.087350 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a3f1da81-3c50-449e-9937-2dc6dd0d271c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:23.087788 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a3f1da81-3c50-449e-9937-2dc6dd0d271c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:23.088548 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a3f1da81-3c50-449e-9937-2dc6dd0d271c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:23.088973 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a3f1da81-3c50-449e-9937-2dc6dd0d271c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:23.213304 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-a3f1da81-3c50-449e-9937-2dc6dd0d271c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:23.220724 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a3f1da81-3c50-449e-9937-2dc6dd0d271c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.144180 Aug 25 05:42:23.221278 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 582/1199] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:23 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:23.998633 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-022d8aeb-96ac-4697-b098-c07bb058a029 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:23.999557 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-022d8aeb-96ac-4697-b098-c07bb058a029 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:24.005327 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-022d8aeb-96ac-4697-b098-c07bb058a029 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:24.005795 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-022d8aeb-96ac-4697-b098-c07bb058a029 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:24.006547 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-022d8aeb-96ac-4697-b098-c07bb058a029 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:24.006972 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-022d8aeb-96ac-4697-b098-c07bb058a029 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:24.036206 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-022d8aeb-96ac-4697-b098-c07bb058a029 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041406 Aug 25 05:42:24.036743 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 618/1200] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:23 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:24.238223 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-43625938-552b-4a55-b77b-86aa7de3135d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:24.238775 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-43625938-552b-4a55-b77b-86aa7de3135d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:24.244543 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-43625938-552b-4a55-b77b-86aa7de3135d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:24.245003 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-43625938-552b-4a55-b77b-86aa7de3135d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:24.245777 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-43625938-552b-4a55-b77b-86aa7de3135d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:24.246214 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-43625938-552b-4a55-b77b-86aa7de3135d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:24.364670 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-43625938-552b-4a55-b77b-86aa7de3135d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:24.371957 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-43625938-552b-4a55-b77b-86aa7de3135d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.137547 Aug 25 05:42:24.373082 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 583/1201] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:24 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:42:24.921596 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 05:42:24.921812 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: Wed Aug 25 05:42:24 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 05:42:25.047763 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9a320583-c1cc-48ab-80b9-95360c2e99f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:25.048690 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9a320583-c1cc-48ab-80b9-95360c2e99f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:25.054642 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9a320583-c1cc-48ab-80b9-95360c2e99f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:25.055090 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9a320583-c1cc-48ab-80b9-95360c2e99f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:25.055850 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9a320583-c1cc-48ab-80b9-95360c2e99f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:25.056286 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9a320583-c1cc-48ab-80b9-95360c2e99f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:25.085209 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9a320583-c1cc-48ab-80b9-95360c2e99f5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041463 Aug 25 05:42:25.085799 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 619/1202] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:25 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:25.389949 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c6b94217-4c89-4e68-bb1c-e3e8bf7c1337 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:25.390572 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c6b94217-4c89-4e68-bb1c-e3e8bf7c1337 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:25.396490 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c6b94217-4c89-4e68-bb1c-e3e8bf7c1337 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:25.396939 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c6b94217-4c89-4e68-bb1c-e3e8bf7c1337 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:25.397742 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c6b94217-4c89-4e68-bb1c-e3e8bf7c1337 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:25.398176 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c6b94217-4c89-4e68-bb1c-e3e8bf7c1337 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:25.530101 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-c6b94217-4c89-4e68-bb1c-e3e8bf7c1337 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:25.537423 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c6b94217-4c89-4e68-bb1c-e3e8bf7c1337 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.151842 Aug 25 05:42:25.538036 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 584/1203] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:25 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:26.096902 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9bef4890-79a7-4677-8b54-295e414423bb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:26.097818 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9bef4890-79a7-4677-8b54-295e414423bb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:26.103535 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9bef4890-79a7-4677-8b54-295e414423bb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:26.103972 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9bef4890-79a7-4677-8b54-295e414423bb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:26.104725 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9bef4890-79a7-4677-8b54-295e414423bb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:26.105150 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9bef4890-79a7-4677-8b54-295e414423bb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:26.133412 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9bef4890-79a7-4677-8b54-295e414423bb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040208 Aug 25 05:42:26.133991 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 620/1204] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:26 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:26.554305 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-815981c5-4a52-4c32-82ef-a1beb9613690 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:26.554917 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-815981c5-4a52-4c32-82ef-a1beb9613690 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:26.561083 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-815981c5-4a52-4c32-82ef-a1beb9613690 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:26.561554 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-815981c5-4a52-4c32-82ef-a1beb9613690 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:26.562304 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-815981c5-4a52-4c32-82ef-a1beb9613690 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:26.562731 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-815981c5-4a52-4c32-82ef-a1beb9613690 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:26.681589 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-815981c5-4a52-4c32-82ef-a1beb9613690 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:26.689460 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-815981c5-4a52-4c32-82ef-a1beb9613690 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.138783 Aug 25 05:42:26.690033 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 585/1205] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:26 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:27.145198 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d93313cf-f1ef-408e-a7ee-7029545d5e3a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:27.146034 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d93313cf-f1ef-408e-a7ee-7029545d5e3a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:27.152024 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d93313cf-f1ef-408e-a7ee-7029545d5e3a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:27.152458 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d93313cf-f1ef-408e-a7ee-7029545d5e3a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:27.153209 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d93313cf-f1ef-408e-a7ee-7029545d5e3a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:27.153832 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d93313cf-f1ef-408e-a7ee-7029545d5e3a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:27.182761 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d93313cf-f1ef-408e-a7ee-7029545d5e3a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041391 Aug 25 05:42:27.183314 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 621/1206] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:27 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:27.707112 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b94748e7-d8bd-4f27-92c4-746c6ca2b02f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:27.707660 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b94748e7-d8bd-4f27-92c4-746c6ca2b02f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:27.713416 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b94748e7-d8bd-4f27-92c4-746c6ca2b02f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:27.713891 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b94748e7-d8bd-4f27-92c4-746c6ca2b02f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:27.714653 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b94748e7-d8bd-4f27-92c4-746c6ca2b02f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:27.715079 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b94748e7-d8bd-4f27-92c4-746c6ca2b02f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:27.847650 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-b94748e7-d8bd-4f27-92c4-746c6ca2b02f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:27.858265 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b94748e7-d8bd-4f27-92c4-746c6ca2b02f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.153025 Aug 25 05:42:27.858875 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 586/1207] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:27 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:28.195511 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-47d96e41-5057-462f-8a35-a38a5c8df8e8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:28.196403 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-47d96e41-5057-462f-8a35-a38a5c8df8e8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:28.202564 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-47d96e41-5057-462f-8a35-a38a5c8df8e8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:28.202998 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-47d96e41-5057-462f-8a35-a38a5c8df8e8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:28.203754 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-47d96e41-5057-462f-8a35-a38a5c8df8e8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:28.204181 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-47d96e41-5057-462f-8a35-a38a5c8df8e8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:28.234963 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-47d96e41-5057-462f-8a35-a38a5c8df8e8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043339 Aug 25 05:42:28.235534 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 622/1208] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:28 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:28.876205 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-057a1151-62e4-4693-8765-1452c6596d32 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:28.876858 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-057a1151-62e4-4693-8765-1452c6596d32 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:28.883198 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-057a1151-62e4-4693-8765-1452c6596d32 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:28.883198 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-057a1151-62e4-4693-8765-1452c6596d32 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:28.883872 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-057a1151-62e4-4693-8765-1452c6596d32 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:28.884304 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-057a1151-62e4-4693-8765-1452c6596d32 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:29.006134 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-057a1151-62e4-4693-8765-1452c6596d32 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:29.014206 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-057a1151-62e4-4693-8765-1452c6596d32 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.142039 Aug 25 05:42:29.014773 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 587/1209] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:28 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:29.248015 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e54f9142-b843-4e02-906a-df7da5ed2f58 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:29.248907 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e54f9142-b843-4e02-906a-df7da5ed2f58 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:29.254741 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e54f9142-b843-4e02-906a-df7da5ed2f58 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:29.255185 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e54f9142-b843-4e02-906a-df7da5ed2f58 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:29.255940 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e54f9142-b843-4e02-906a-df7da5ed2f58 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:29.256369 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e54f9142-b843-4e02-906a-df7da5ed2f58 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:29.285163 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e54f9142-b843-4e02-906a-df7da5ed2f58 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041575 Aug 25 05:42:29.285939 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 623/1210] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:29 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:30.030696 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6dbbf0dc-7751-4a1c-b2e1-3d2f0af38a5d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:30.031306 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6dbbf0dc-7751-4a1c-b2e1-3d2f0af38a5d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:30.037284 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6dbbf0dc-7751-4a1c-b2e1-3d2f0af38a5d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:30.037770 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6dbbf0dc-7751-4a1c-b2e1-3d2f0af38a5d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:30.038531 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6dbbf0dc-7751-4a1c-b2e1-3d2f0af38a5d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:30.038992 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6dbbf0dc-7751-4a1c-b2e1-3d2f0af38a5d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:30.160597 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6dbbf0dc-7751-4a1c-b2e1-3d2f0af38a5d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:30.170567 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6dbbf0dc-7751-4a1c-b2e1-3d2f0af38a5d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.143483 Aug 25 05:42:30.171454 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 588/1211] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:30 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:30.297211 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-006dab91-4ac7-4071-b49a-2e149c85976a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:30.298124 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-006dab91-4ac7-4071-b49a-2e149c85976a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:30.303794 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-006dab91-4ac7-4071-b49a-2e149c85976a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:30.304260 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-006dab91-4ac7-4071-b49a-2e149c85976a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:30.305004 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-006dab91-4ac7-4071-b49a-2e149c85976a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:30.305425 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-006dab91-4ac7-4071-b49a-2e149c85976a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:30.333600 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-006dab91-4ac7-4071-b49a-2e149c85976a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040896 Aug 25 05:42:30.334128 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 624/1212] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:30 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:31.188839 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3e0d715c-07c6-4cc3-9e20-d5cc38fe473a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:31.189398 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3e0d715c-07c6-4cc3-9e20-d5cc38fe473a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:31.201572 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3e0d715c-07c6-4cc3-9e20-d5cc38fe473a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:31.201981 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3e0d715c-07c6-4cc3-9e20-d5cc38fe473a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:31.202763 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3e0d715c-07c6-4cc3-9e20-d5cc38fe473a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:31.203193 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3e0d715c-07c6-4cc3-9e20-d5cc38fe473a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:31.335000 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-3e0d715c-07c6-4cc3-9e20-d5cc38fe473a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:31.342378 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3e0d715c-07c6-4cc3-9e20-d5cc38fe473a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.157970 Aug 25 05:42:31.343107 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 589/1213] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:31 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:31.344158 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-00be1801-0ee8-4562-950b-fee5a6650490 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:31.345053 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-00be1801-0ee8-4562-950b-fee5a6650490 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:31.350866 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-00be1801-0ee8-4562-950b-fee5a6650490 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:31.351299 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-00be1801-0ee8-4562-950b-fee5a6650490 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:31.352044 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-00be1801-0ee8-4562-950b-fee5a6650490 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:31.352463 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-00be1801-0ee8-4562-950b-fee5a6650490 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:31.380888 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-00be1801-0ee8-4562-950b-fee5a6650490 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040535 Aug 25 05:42:31.381434 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 625/1214] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:31 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:42:32.359195 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6a682281-d754-4e7a-99df-9b124e53bd52 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:32.359802 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6a682281-d754-4e7a-99df-9b124e53bd52 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:32.365677 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6a682281-d754-4e7a-99df-9b124e53bd52 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:32.366119 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6a682281-d754-4e7a-99df-9b124e53bd52 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:32.366870 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6a682281-d754-4e7a-99df-9b124e53bd52 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:32.367292 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6a682281-d754-4e7a-99df-9b124e53bd52 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:32.392779 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9012ffe7-e903-4b39-8a3b-e58e88985f0e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:32.393710 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9012ffe7-e903-4b39-8a3b-e58e88985f0e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:32.399513 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9012ffe7-e903-4b39-8a3b-e58e88985f0e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:32.399946 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9012ffe7-e903-4b39-8a3b-e58e88985f0e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:32.400944 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9012ffe7-e903-4b39-8a3b-e58e88985f0e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:32.401376 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9012ffe7-e903-4b39-8a3b-e58e88985f0e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:32.431025 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9012ffe7-e903-4b39-8a3b-e58e88985f0e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042054 Aug 25 05:42:32.431585 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 626/1215] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:32 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:42:32.490307 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6a682281-d754-4e7a-99df-9b124e53bd52 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:32.497455 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6a682281-d754-4e7a-99df-9b124e53bd52 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.142125 Aug 25 05:42:32.498047 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 590/1216] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:32 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:33.444269 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b5fc772d-bc62-42b1-9a0c-28aab2d5b33e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:33.445440 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b5fc772d-bc62-42b1-9a0c-28aab2d5b33e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:33.451757 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b5fc772d-bc62-42b1-9a0c-28aab2d5b33e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:33.459342 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b5fc772d-bc62-42b1-9a0c-28aab2d5b33e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:33.459342 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b5fc772d-bc62-42b1-9a0c-28aab2d5b33e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:33.459342 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b5fc772d-bc62-42b1-9a0c-28aab2d5b33e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:33.490925 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b5fc772d-bc62-42b1-9a0c-28aab2d5b33e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051503 Aug 25 05:42:33.491868 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 627/1217] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:33 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:33.514246 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e317bf68-ece8-4803-80fe-885a75c4764a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:33.514850 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e317bf68-ece8-4803-80fe-885a75c4764a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:33.522333 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e317bf68-ece8-4803-80fe-885a75c4764a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:33.522788 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e317bf68-ece8-4803-80fe-885a75c4764a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:33.523603 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e317bf68-ece8-4803-80fe-885a75c4764a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:33.524358 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e317bf68-ece8-4803-80fe-885a75c4764a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:33.676752 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e317bf68-ece8-4803-80fe-885a75c4764a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:33.683948 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e317bf68-ece8-4803-80fe-885a75c4764a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.173375 Aug 25 05:42:33.684501 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 591/1218] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:33 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:34.502970 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e3d6417b-0101-4633-a76c-5eb8b13000d6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:34.503872 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e3d6417b-0101-4633-a76c-5eb8b13000d6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:34.509721 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e3d6417b-0101-4633-a76c-5eb8b13000d6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:34.510167 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e3d6417b-0101-4633-a76c-5eb8b13000d6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:34.510923 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e3d6417b-0101-4633-a76c-5eb8b13000d6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:34.511354 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e3d6417b-0101-4633-a76c-5eb8b13000d6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:34.541564 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e3d6417b-0101-4633-a76c-5eb8b13000d6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042364 Aug 25 05:42:34.542128 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 628/1219] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:34 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:34.701316 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-af9f2f5a-7420-46de-8cf0-705874295e19 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:34.702154 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-af9f2f5a-7420-46de-8cf0-705874295e19 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:34.707742 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-af9f2f5a-7420-46de-8cf0-705874295e19 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:34.708181 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-af9f2f5a-7420-46de-8cf0-705874295e19 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:34.708929 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-af9f2f5a-7420-46de-8cf0-705874295e19 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:34.709351 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-af9f2f5a-7420-46de-8cf0-705874295e19 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:34.830532 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-af9f2f5a-7420-46de-8cf0-705874295e19 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:34.837837 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-af9f2f5a-7420-46de-8cf0-705874295e19 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.140871 Aug 25 05:42:34.838400 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 592/1220] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:34 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:35.554396 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1b9934fb-8ec2-49e4-b375-df66b9df8ddb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:35.555305 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1b9934fb-8ec2-49e4-b375-df66b9df8ddb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:35.561818 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1b9934fb-8ec2-49e4-b375-df66b9df8ddb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:35.562262 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1b9934fb-8ec2-49e4-b375-df66b9df8ddb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:35.563029 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1b9934fb-8ec2-49e4-b375-df66b9df8ddb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:35.563464 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1b9934fb-8ec2-49e4-b375-df66b9df8ddb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:35.593147 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1b9934fb-8ec2-49e4-b375-df66b9df8ddb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044072 Aug 25 05:42:35.593737 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 629/1221] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:35 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:35.854785 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-25046dab-0936-4e5d-873c-e175140d3fdb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:35.855393 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-25046dab-0936-4e5d-873c-e175140d3fdb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:35.861949 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-25046dab-0936-4e5d-873c-e175140d3fdb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:35.862386 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-25046dab-0936-4e5d-873c-e175140d3fdb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:35.863143 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-25046dab-0936-4e5d-873c-e175140d3fdb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:35.863573 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-25046dab-0936-4e5d-873c-e175140d3fdb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:35.987029 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-25046dab-0936-4e5d-873c-e175140d3fdb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:35.994438 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-25046dab-0936-4e5d-873c-e175140d3fdb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.143274 Aug 25 05:42:35.995032 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 593/1222] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:35 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:36.605154 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-30a0f136-2a80-4738-973e-9491e83269ba tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:36.606078 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-30a0f136-2a80-4738-973e-9491e83269ba tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:36.612471 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-30a0f136-2a80-4738-973e-9491e83269ba tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:36.612920 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-30a0f136-2a80-4738-973e-9491e83269ba tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:36.613723 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-30a0f136-2a80-4738-973e-9491e83269ba tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:36.614164 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-30a0f136-2a80-4738-973e-9491e83269ba tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:36.642344 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-30a0f136-2a80-4738-973e-9491e83269ba tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041600 Aug 25 05:42:36.642892 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 630/1223] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:36 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:37.011358 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-42c570bb-d279-4d22-8fcb-e9c93bdc7b32 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:37.011971 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-42c570bb-d279-4d22-8fcb-e9c93bdc7b32 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:37.018561 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-42c570bb-d279-4d22-8fcb-e9c93bdc7b32 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:37.019016 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-42c570bb-d279-4d22-8fcb-e9c93bdc7b32 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:37.020008 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-42c570bb-d279-4d22-8fcb-e9c93bdc7b32 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:37.020368 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-42c570bb-d279-4d22-8fcb-e9c93bdc7b32 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:37.024806 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5b6c16df-d0c7-48ec-8a3e-2680d0deb97d tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:37.025570 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5b6c16df-d0c7-48ec-8a3e-2680d0deb97d tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:37.031295 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5b6c16df-d0c7-48ec-8a3e-2680d0deb97d tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:37.031733 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5b6c16df-d0c7-48ec-8a3e-2680d0deb97d tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:37.032500 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5b6c16df-d0c7-48ec-8a3e-2680d0deb97d tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:37.032927 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5b6c16df-d0c7-48ec-8a3e-2680d0deb97d tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:37.152775 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-42c570bb-d279-4d22-8fcb-e9c93bdc7b32 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:37.160197 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-42c570bb-d279-4d22-8fcb-e9c93bdc7b32 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.152457 Aug 25 05:42:37.160763 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 594/1224] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:37 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:37.173146 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.objects.instance [None req-5b6c16df-d0c7-48ec-8a3e-2680d0deb97d tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lazy-loading 'services' on Instance uuid 8e74fcd5-99b3-4716-b064-182c7db61275 {{(pid=108885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 05:42:37.424734 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5b6c16df-d0c7-48ec-8a3e-2680d0deb97d tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [da404304-81c2-48ef-8271-5a002b2af397] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 05:42:37.654202 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-4c2cbb67-9e3a-4066-8040-3793b4c22e08 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:37.655119 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-4c2cbb67-9e3a-4066-8040-3793b4c22e08 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:37.661390 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4c2cbb67-9e3a-4066-8040-3793b4c22e08 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:37.661878 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4c2cbb67-9e3a-4066-8040-3793b4c22e08 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:37.662708 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4c2cbb67-9e3a-4066-8040-3793b4c22e08 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:37.663151 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4c2cbb67-9e3a-4066-8040-3793b4c22e08 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:37.695151 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-4c2cbb67-9e3a-4066-8040-3793b4c22e08 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045165 Aug 25 05:42:37.695841 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 595/1225] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:37 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:37.700423 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-9e90ab68-7ac4-472a-b4f5-a2a4f639f4aa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:37.701346 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-9e90ab68-7ac4-472a-b4f5-a2a4f639f4aa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:37.707056 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9e90ab68-7ac4-472a-b4f5-a2a4f639f4aa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:37.707499 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9e90ab68-7ac4-472a-b4f5-a2a4f639f4aa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:37.708263 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9e90ab68-7ac4-472a-b4f5-a2a4f639f4aa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:37.708691 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9e90ab68-7ac4-472a-b4f5-a2a4f639f4aa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:37.738149 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-9e90ab68-7ac4-472a-b4f5-a2a4f639f4aa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041211 Aug 25 05:42:37.738704 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 596/1226] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:42:37 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:42:38.181262 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-243c90e0-fe6f-4a6c-a414-075347ee05ba tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:38.182472 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-243c90e0-fe6f-4a6c-a414-075347ee05ba tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:38.192777 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-243c90e0-fe6f-4a6c-a414-075347ee05ba tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:38.193458 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-243c90e0-fe6f-4a6c-a414-075347ee05ba tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:38.194853 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-243c90e0-fe6f-4a6c-a414-075347ee05ba tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:38.195635 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-243c90e0-fe6f-4a6c-a414-075347ee05ba tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:38.384455 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-243c90e0-fe6f-4a6c-a414-075347ee05ba tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:38.392462 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-243c90e0-fe6f-4a6c-a414-075347ee05ba tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.217996 Aug 25 05:42:38.393031 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 597/1227] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:38 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:38.443248 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO oslo.messaging._drivers.impl_rabbit [None req-5b6c16df-d0c7-48ec-8a3e-2680d0deb97d tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [da404304-81c2-48ef-8271-5a002b2af397] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 35978. Aug 25 05:42:38.446467 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5b6c16df-d0c7-48ec-8a3e-2680d0deb97d tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275/os-volume_attachments/7512b19a-ad25-4d1b-be97-721fbaf90bba" status: 202 len: 0 microversion: 2.1 time: 1.425394 Aug 25 05:42:38.447060 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 631/1228] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 25 05:42:37 2021] DELETE /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275/os-volume_attachments/7512b19a-ad25-4d1b-be97-721fbaf90bba => generated 0 bytes in 1427 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 05:42:38.706826 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3d0f3aeb-022c-4362-b886-396f8b6e3f25 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:38.707649 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3d0f3aeb-022c-4362-b886-396f8b6e3f25 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:38.713369 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3d0f3aeb-022c-4362-b886-396f8b6e3f25 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:38.713871 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3d0f3aeb-022c-4362-b886-396f8b6e3f25 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:38.714630 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3d0f3aeb-022c-4362-b886-396f8b6e3f25 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:38.715057 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3d0f3aeb-022c-4362-b886-396f8b6e3f25 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:38.744863 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3d0f3aeb-022c-4362-b886-396f8b6e3f25 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041822 Aug 25 05:42:38.745423 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 598/1229] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:38 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:38.754472 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2d64bb6a-eca0-453c-b856-568879c877b1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:38.756966 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2d64bb6a-eca0-453c-b856-568879c877b1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:38.763492 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2d64bb6a-eca0-453c-b856-568879c877b1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:38.763945 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2d64bb6a-eca0-453c-b856-568879c877b1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:38.764716 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2d64bb6a-eca0-453c-b856-568879c877b1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:38.765334 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2d64bb6a-eca0-453c-b856-568879c877b1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:38.798582 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2d64bb6a-eca0-453c-b856-568879c877b1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052558 Aug 25 05:42:38.802383 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 632/1230] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:42:38 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:42:39.409650 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7cf46698-5d2b-45df-a9b6-d5a52e314859 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:39.410648 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7cf46698-5d2b-45df-a9b6-d5a52e314859 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:39.416135 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7cf46698-5d2b-45df-a9b6-d5a52e314859 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:39.416584 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7cf46698-5d2b-45df-a9b6-d5a52e314859 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:39.417350 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7cf46698-5d2b-45df-a9b6-d5a52e314859 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:39.417807 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7cf46698-5d2b-45df-a9b6-d5a52e314859 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:39.541241 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-7cf46698-5d2b-45df-a9b6-d5a52e314859 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:39.549015 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7cf46698-5d2b-45df-a9b6-d5a52e314859 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.143044 Aug 25 05:42:39.549813 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 599/1231] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:39 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:42:39.758333 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-4e91ac98-a4b6-439c-8e6b-8685039ec48a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:39.759233 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-4e91ac98-a4b6-439c-8e6b-8685039ec48a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:39.765970 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4e91ac98-a4b6-439c-8e6b-8685039ec48a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:39.766334 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4e91ac98-a4b6-439c-8e6b-8685039ec48a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:39.767102 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4e91ac98-a4b6-439c-8e6b-8685039ec48a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:39.767530 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4e91ac98-a4b6-439c-8e6b-8685039ec48a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:39.797196 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-4e91ac98-a4b6-439c-8e6b-8685039ec48a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042590 Aug 25 05:42:39.797772 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 633/1232] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:39 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:39.810802 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c553ede4-7115-4d0e-9d2f-0f9febc17687 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:39.811747 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c553ede4-7115-4d0e-9d2f-0f9febc17687 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:39.817747 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c553ede4-7115-4d0e-9d2f-0f9febc17687 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:39.818195 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c553ede4-7115-4d0e-9d2f-0f9febc17687 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:39.818958 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c553ede4-7115-4d0e-9d2f-0f9febc17687 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:39.819389 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c553ede4-7115-4d0e-9d2f-0f9febc17687 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:39.848007 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c553ede4-7115-4d0e-9d2f-0f9febc17687 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041826 Aug 25 05:42:39.848565 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 600/1233] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:42:39 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:42:40.565964 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-bce2afc9-5bdc-4cd6-a28e-6eb00cc811b3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:40.566575 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-bce2afc9-5bdc-4cd6-a28e-6eb00cc811b3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:40.572579 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bce2afc9-5bdc-4cd6-a28e-6eb00cc811b3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:40.573305 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bce2afc9-5bdc-4cd6-a28e-6eb00cc811b3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:40.573795 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bce2afc9-5bdc-4cd6-a28e-6eb00cc811b3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:40.574224 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bce2afc9-5bdc-4cd6-a28e-6eb00cc811b3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:40.703879 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-bce2afc9-5bdc-4cd6-a28e-6eb00cc811b3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:40.711306 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-bce2afc9-5bdc-4cd6-a28e-6eb00cc811b3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.149021 Aug 25 05:42:40.711863 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 634/1234] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:40 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:40.808811 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8b886092-c4f0-4fac-bbb0-cd3fedb66ef1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:40.810211 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8b886092-c4f0-4fac-bbb0-cd3fedb66ef1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:40.816068 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8b886092-c4f0-4fac-bbb0-cd3fedb66ef1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:40.816511 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8b886092-c4f0-4fac-bbb0-cd3fedb66ef1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:40.817267 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8b886092-c4f0-4fac-bbb0-cd3fedb66ef1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:40.817736 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8b886092-c4f0-4fac-bbb0-cd3fedb66ef1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:40.847434 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8b886092-c4f0-4fac-bbb0-cd3fedb66ef1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042464 Aug 25 05:42:40.848000 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 601/1235] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:40 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:40.859224 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-780c1f9d-db5e-495d-a658-4bf3679bf8df tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:40.860118 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-780c1f9d-db5e-495d-a658-4bf3679bf8df tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:40.865896 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-780c1f9d-db5e-495d-a658-4bf3679bf8df tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:40.866334 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-780c1f9d-db5e-495d-a658-4bf3679bf8df tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:40.867084 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-780c1f9d-db5e-495d-a658-4bf3679bf8df tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:40.867508 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-780c1f9d-db5e-495d-a658-4bf3679bf8df tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:40.897097 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-780c1f9d-db5e-495d-a658-4bf3679bf8df tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041664 Aug 25 05:42:40.897656 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 635/1236] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:42:40 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:42:41.729653 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-71e772ed-3ed6-4e3b-9105-6d82cf55e8f0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:41.730192 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-71e772ed-3ed6-4e3b-9105-6d82cf55e8f0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:41.737071 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-71e772ed-3ed6-4e3b-9105-6d82cf55e8f0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:41.737518 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-71e772ed-3ed6-4e3b-9105-6d82cf55e8f0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:41.738315 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-71e772ed-3ed6-4e3b-9105-6d82cf55e8f0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:41.738747 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-71e772ed-3ed6-4e3b-9105-6d82cf55e8f0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:41.859940 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-69023d4c-ecf6-4dd9-a81c-39edaa03e0b9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:41.860883 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-69023d4c-ecf6-4dd9-a81c-39edaa03e0b9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:41.863307 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-71e772ed-3ed6-4e3b-9105-6d82cf55e8f0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:41.866971 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-69023d4c-ecf6-4dd9-a81c-39edaa03e0b9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:41.867421 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-69023d4c-ecf6-4dd9-a81c-39edaa03e0b9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:41.868196 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-69023d4c-ecf6-4dd9-a81c-39edaa03e0b9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:41.868630 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-69023d4c-ecf6-4dd9-a81c-39edaa03e0b9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:41.870697 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-71e772ed-3ed6-4e3b-9105-6d82cf55e8f0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.144754 Aug 25 05:42:41.871263 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 602/1237] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:41 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:41.900738 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-69023d4c-ecf6-4dd9-a81c-39edaa03e0b9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045262 Aug 25 05:42:41.901290 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 636/1238] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:41 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:42:41.909083 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5dbe6bf4-62bd-42e7-ad89-194e2921bb8e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:41.910032 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5dbe6bf4-62bd-42e7-ad89-194e2921bb8e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:41.916657 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5dbe6bf4-62bd-42e7-ad89-194e2921bb8e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:41.917096 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5dbe6bf4-62bd-42e7-ad89-194e2921bb8e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:41.917896 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5dbe6bf4-62bd-42e7-ad89-194e2921bb8e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:41.918327 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5dbe6bf4-62bd-42e7-ad89-194e2921bb8e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:41.954542 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5dbe6bf4-62bd-42e7-ad89-194e2921bb8e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049100 Aug 25 05:42:41.955104 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 603/1239] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:42:41 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:42:42.886900 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-277e2715-6d71-468b-a09a-580064c6bf06 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:42.887975 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-277e2715-6d71-468b-a09a-580064c6bf06 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:42.893765 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-277e2715-6d71-468b-a09a-580064c6bf06 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:42.894205 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-277e2715-6d71-468b-a09a-580064c6bf06 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:42.894955 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-277e2715-6d71-468b-a09a-580064c6bf06 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:42.895382 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-277e2715-6d71-468b-a09a-580064c6bf06 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:42.915675 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-0d903621-fac2-435b-a7f1-69bf32698907 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:42.917001 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-0d903621-fac2-435b-a7f1-69bf32698907 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:42.925296 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0d903621-fac2-435b-a7f1-69bf32698907 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:42.926103 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0d903621-fac2-435b-a7f1-69bf32698907 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:42.927254 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0d903621-fac2-435b-a7f1-69bf32698907 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:42.927897 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0d903621-fac2-435b-a7f1-69bf32698907 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:42.964991 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-0d903621-fac2-435b-a7f1-69bf32698907 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055324 Aug 25 05:42:42.966527 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 604/1240] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:42 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:42:42.972410 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1533dd7f-595e-406b-85a6-9673b8a1ded9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:42.973307 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1533dd7f-595e-406b-85a6-9673b8a1ded9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:42.979752 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1533dd7f-595e-406b-85a6-9673b8a1ded9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:42.980199 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1533dd7f-595e-406b-85a6-9673b8a1ded9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:42.980962 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1533dd7f-595e-406b-85a6-9673b8a1ded9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:42.982081 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1533dd7f-595e-406b-85a6-9673b8a1ded9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:43.010792 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1533dd7f-595e-406b-85a6-9673b8a1ded9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042891 Aug 25 05:42:43.011346 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 605/1241] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:42:42 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:42:43.030382 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-277e2715-6d71-468b-a09a-580064c6bf06 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:43.037630 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-277e2715-6d71-468b-a09a-580064c6bf06 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.154366 Aug 25 05:42:43.038200 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 637/1242] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:42 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:43.977430 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-75409540-3969-4494-a4a7-cb742b8b529b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:43.978348 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-75409540-3969-4494-a4a7-cb742b8b529b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:43.984691 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-75409540-3969-4494-a4a7-cb742b8b529b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:43.985124 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-75409540-3969-4494-a4a7-cb742b8b529b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:43.985925 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-75409540-3969-4494-a4a7-cb742b8b529b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:43.986351 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-75409540-3969-4494-a4a7-cb742b8b529b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:44.014092 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-75409540-3969-4494-a4a7-cb742b8b529b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040305 Aug 25 05:42:44.014565 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 606/1243] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:43 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:44.023325 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c2e8d8b9-0384-4596-80df-c12b3176188c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:44.024231 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c2e8d8b9-0384-4596-80df-c12b3176188c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:44.031548 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c2e8d8b9-0384-4596-80df-c12b3176188c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:44.031988 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c2e8d8b9-0384-4596-80df-c12b3176188c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:44.032765 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c2e8d8b9-0384-4596-80df-c12b3176188c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:44.033195 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c2e8d8b9-0384-4596-80df-c12b3176188c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:44.054113 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-4790df98-dac8-4b66-8206-85073a8fb043 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:44.054726 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-4790df98-dac8-4b66-8206-85073a8fb043 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:44.061044 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4790df98-dac8-4b66-8206-85073a8fb043 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:44.061492 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4790df98-dac8-4b66-8206-85073a8fb043 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:44.062283 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4790df98-dac8-4b66-8206-85073a8fb043 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:44.062714 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4790df98-dac8-4b66-8206-85073a8fb043 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:44.063920 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c2e8d8b9-0384-4596-80df-c12b3176188c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044312 Aug 25 05:42:44.064493 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 638/1244] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:42:44 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:42:44.182652 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-4790df98-dac8-4b66-8206-85073a8fb043 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:44.190149 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-4790df98-dac8-4b66-8206-85073a8fb043 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.139601 Aug 25 05:42:44.190720 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 607/1245] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:44 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:42:45.024448 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-281253ad-8918-41d0-9a75-b68778ce9c9d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:45.025615 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-281253ad-8918-41d0-9a75-b68778ce9c9d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:45.032290 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-281253ad-8918-41d0-9a75-b68778ce9c9d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:45.032728 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-281253ad-8918-41d0-9a75-b68778ce9c9d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:45.033482 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-281253ad-8918-41d0-9a75-b68778ce9c9d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:45.033952 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-281253ad-8918-41d0-9a75-b68778ce9c9d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:45.062824 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-281253ad-8918-41d0-9a75-b68778ce9c9d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042034 Aug 25 05:42:45.063295 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 639/1246] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:45 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:45.074242 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-077d8478-3c27-4ee8-8268-42d7351bc3e4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:45.075840 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-077d8478-3c27-4ee8-8268-42d7351bc3e4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:45.082058 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-077d8478-3c27-4ee8-8268-42d7351bc3e4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:45.082507 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-077d8478-3c27-4ee8-8268-42d7351bc3e4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:45.083276 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-077d8478-3c27-4ee8-8268-42d7351bc3e4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:45.083713 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-077d8478-3c27-4ee8-8268-42d7351bc3e4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:45.112681 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-077d8478-3c27-4ee8-8268-42d7351bc3e4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042131 Aug 25 05:42:45.113236 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 608/1247] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:42:45 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:42:45.207171 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e86c5874-b33c-45d6-859d-eeef75b2e764 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:45.207766 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e86c5874-b33c-45d6-859d-eeef75b2e764 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:45.213714 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e86c5874-b33c-45d6-859d-eeef75b2e764 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:45.214152 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e86c5874-b33c-45d6-859d-eeef75b2e764 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:45.214905 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e86c5874-b33c-45d6-859d-eeef75b2e764 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:45.215335 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e86c5874-b33c-45d6-859d-eeef75b2e764 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:45.340021 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-e86c5874-b33c-45d6-859d-eeef75b2e764 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:45.348017 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e86c5874-b33c-45d6-859d-eeef75b2e764 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.144486 Aug 25 05:42:45.348575 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 640/1248] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:45 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:46.074491 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-4da37134-dedc-467e-983d-94687c08ed25 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:46.075415 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-4da37134-dedc-467e-983d-94687c08ed25 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:46.081272 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4da37134-dedc-467e-983d-94687c08ed25 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:46.081752 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4da37134-dedc-467e-983d-94687c08ed25 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:46.082506 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4da37134-dedc-467e-983d-94687c08ed25 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:46.082933 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4da37134-dedc-467e-983d-94687c08ed25 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:46.112723 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-4da37134-dedc-467e-983d-94687c08ed25 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041849 Aug 25 05:42:46.113194 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 609/1249] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:46 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:46.123803 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ada665c3-90c6-4134-8114-e782df0671c4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:46.124740 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ada665c3-90c6-4134-8114-e782df0671c4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:46.130602 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ada665c3-90c6-4134-8114-e782df0671c4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:46.131041 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ada665c3-90c6-4134-8114-e782df0671c4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:46.131798 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ada665c3-90c6-4134-8114-e782df0671c4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:46.132220 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ada665c3-90c6-4134-8114-e782df0671c4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:46.161497 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ada665c3-90c6-4134-8114-e782df0671c4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041366 Aug 25 05:42:46.162095 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 641/1250] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:42:46 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:42:46.365037 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-014dfb7f-2a12-4310-b9cd-ce9fd8a85c29 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:46.365586 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-014dfb7f-2a12-4310-b9cd-ce9fd8a85c29 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:46.371790 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-014dfb7f-2a12-4310-b9cd-ce9fd8a85c29 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:46.372212 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-014dfb7f-2a12-4310-b9cd-ce9fd8a85c29 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:46.372964 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-014dfb7f-2a12-4310-b9cd-ce9fd8a85c29 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:46.373394 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-014dfb7f-2a12-4310-b9cd-ce9fd8a85c29 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:46.493571 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-014dfb7f-2a12-4310-b9cd-ce9fd8a85c29 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:46.500723 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-014dfb7f-2a12-4310-b9cd-ce9fd8a85c29 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.139638 Aug 25 05:42:46.501331 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 610/1251] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:46 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:47.124448 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d71805aa-ab25-401f-be9e-73d632affded tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:47.125345 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d71805aa-ab25-401f-be9e-73d632affded tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:47.131260 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d71805aa-ab25-401f-be9e-73d632affded tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:47.131694 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d71805aa-ab25-401f-be9e-73d632affded tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:47.132455 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d71805aa-ab25-401f-be9e-73d632affded tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:47.132882 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d71805aa-ab25-401f-be9e-73d632affded tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:47.163696 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d71805aa-ab25-401f-be9e-73d632affded tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043191 Aug 25 05:42:47.164189 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 642/1252] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:47 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:42:47.172706 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-848cdc89-2f13-44a9-b3d1-b884e9ac0e62 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:47.173702 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-848cdc89-2f13-44a9-b3d1-b884e9ac0e62 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:47.179611 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-848cdc89-2f13-44a9-b3d1-b884e9ac0e62 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:47.180084 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-848cdc89-2f13-44a9-b3d1-b884e9ac0e62 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:47.180871 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-848cdc89-2f13-44a9-b3d1-b884e9ac0e62 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:47.181292 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-848cdc89-2f13-44a9-b3d1-b884e9ac0e62 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:47.210952 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-848cdc89-2f13-44a9-b3d1-b884e9ac0e62 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042623 Aug 25 05:42:47.211512 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 611/1253] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:42:47 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:42:47.517841 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-bc851a54-23a9-424c-9e02-daac285c2233 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:47.518473 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-bc851a54-23a9-424c-9e02-daac285c2233 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:47.524301 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bc851a54-23a9-424c-9e02-daac285c2233 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:47.524736 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bc851a54-23a9-424c-9e02-daac285c2233 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:47.525768 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bc851a54-23a9-424c-9e02-daac285c2233 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:47.526193 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bc851a54-23a9-424c-9e02-daac285c2233 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:47.652844 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-bc851a54-23a9-424c-9e02-daac285c2233 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:47.660189 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-bc851a54-23a9-424c-9e02-daac285c2233 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.145901 Aug 25 05:42:47.660755 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 643/1254] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:47 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:42:48.175902 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-67975d03-2332-44c4-b667-b16c83062d61 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:48.176804 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-67975d03-2332-44c4-b667-b16c83062d61 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:48.182696 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-67975d03-2332-44c4-b667-b16c83062d61 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:48.183141 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-67975d03-2332-44c4-b667-b16c83062d61 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:48.183900 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-67975d03-2332-44c4-b667-b16c83062d61 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:48.184332 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-67975d03-2332-44c4-b667-b16c83062d61 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:48.214047 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-67975d03-2332-44c4-b667-b16c83062d61 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041996 Aug 25 05:42:48.214616 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 612/1255] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:48 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:48.222837 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-330cc2d8-ec7f-418b-82ff-24955cc94264 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:48.223673 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-330cc2d8-ec7f-418b-82ff-24955cc94264 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:48.229449 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-330cc2d8-ec7f-418b-82ff-24955cc94264 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:48.229945 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-330cc2d8-ec7f-418b-82ff-24955cc94264 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:48.230713 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-330cc2d8-ec7f-418b-82ff-24955cc94264 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:48.231788 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-330cc2d8-ec7f-418b-82ff-24955cc94264 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:48.261629 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-330cc2d8-ec7f-418b-82ff-24955cc94264 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042563 Aug 25 05:42:48.262690 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 644/1256] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:42:48 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:42:48.352998 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 05:42:48.353263 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: Wed Aug 25 05:42:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 05:42:48.677977 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-0f24ce35-4fa0-4e12-a122-c7a20ce257c9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:48.678586 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-0f24ce35-4fa0-4e12-a122-c7a20ce257c9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:48.685097 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0f24ce35-4fa0-4e12-a122-c7a20ce257c9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:48.685705 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0f24ce35-4fa0-4e12-a122-c7a20ce257c9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:48.686472 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0f24ce35-4fa0-4e12-a122-c7a20ce257c9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:48.686904 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0f24ce35-4fa0-4e12-a122-c7a20ce257c9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:48.814002 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-0f24ce35-4fa0-4e12-a122-c7a20ce257c9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:48.821300 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-0f24ce35-4fa0-4e12-a122-c7a20ce257c9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.147790 Aug 25 05:42:48.821893 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 613/1257] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:48 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:49.226695 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e39557f1-be61-41bb-81f1-d1496cff8bfe tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:49.227587 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e39557f1-be61-41bb-81f1-d1496cff8bfe tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:49.234599 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e39557f1-be61-41bb-81f1-d1496cff8bfe tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:49.235056 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e39557f1-be61-41bb-81f1-d1496cff8bfe tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:49.235825 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e39557f1-be61-41bb-81f1-d1496cff8bfe tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:49.236256 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e39557f1-be61-41bb-81f1-d1496cff8bfe tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:49.266728 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e39557f1-be61-41bb-81f1-d1496cff8bfe tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043744 Aug 25 05:42:49.267299 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 645/1258] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:49 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:49.273581 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-48e03fc3-1292-4983-a050-2300ff99e0a5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:49.274736 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-48e03fc3-1292-4983-a050-2300ff99e0a5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:49.282312 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-48e03fc3-1292-4983-a050-2300ff99e0a5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:49.282760 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-48e03fc3-1292-4983-a050-2300ff99e0a5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:49.283563 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-48e03fc3-1292-4983-a050-2300ff99e0a5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:49.283987 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-48e03fc3-1292-4983-a050-2300ff99e0a5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:49.325372 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-48e03fc3-1292-4983-a050-2300ff99e0a5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055228 Aug 25 05:42:49.326817 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 614/1259] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:42:49 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:42:49.838405 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-8ec65998-0b85-44a2-940b-32895d24ee39 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:49.838919 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-8ec65998-0b85-44a2-940b-32895d24ee39 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:49.846009 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8ec65998-0b85-44a2-940b-32895d24ee39 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:49.846450 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8ec65998-0b85-44a2-940b-32895d24ee39 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:49.847215 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8ec65998-0b85-44a2-940b-32895d24ee39 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:49.847642 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8ec65998-0b85-44a2-940b-32895d24ee39 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:49.970389 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-8ec65998-0b85-44a2-940b-32895d24ee39 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:49.977967 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-8ec65998-0b85-44a2-940b-32895d24ee39 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.143209 Aug 25 05:42:49.979520 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 646/1260] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:49 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:50.278683 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ab6a7c09-3c98-4a51-ac43-38be0c76c507 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:50.279588 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ab6a7c09-3c98-4a51-ac43-38be0c76c507 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:50.285778 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ab6a7c09-3c98-4a51-ac43-38be0c76c507 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:50.286221 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ab6a7c09-3c98-4a51-ac43-38be0c76c507 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:50.286980 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ab6a7c09-3c98-4a51-ac43-38be0c76c507 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:50.287413 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ab6a7c09-3c98-4a51-ac43-38be0c76c507 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:50.318041 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ab6a7c09-3c98-4a51-ac43-38be0c76c507 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043272 Aug 25 05:42:50.318614 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 615/1261] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:50 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:50.337749 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-510d8dc9-5dbd-4591-84a9-327d8c5bf033 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:50.338646 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-510d8dc9-5dbd-4591-84a9-327d8c5bf033 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:50.344704 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-510d8dc9-5dbd-4591-84a9-327d8c5bf033 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:50.345143 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-510d8dc9-5dbd-4591-84a9-327d8c5bf033 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:50.345937 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-510d8dc9-5dbd-4591-84a9-327d8c5bf033 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:50.346370 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-510d8dc9-5dbd-4591-84a9-327d8c5bf033 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:50.376660 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-510d8dc9-5dbd-4591-84a9-327d8c5bf033 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042603 Aug 25 05:42:50.377135 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 647/1262] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:42:50 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:42:50.995094 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-36f192ff-72f8-4675-8085-1c3d5bba6e42 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:50.995760 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-36f192ff-72f8-4675-8085-1c3d5bba6e42 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:51.001707 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-36f192ff-72f8-4675-8085-1c3d5bba6e42 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:51.002154 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-36f192ff-72f8-4675-8085-1c3d5bba6e42 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:51.002908 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-36f192ff-72f8-4675-8085-1c3d5bba6e42 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:51.003338 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-36f192ff-72f8-4675-8085-1c3d5bba6e42 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:51.122289 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-36f192ff-72f8-4675-8085-1c3d5bba6e42 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:51.129844 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-36f192ff-72f8-4675-8085-1c3d5bba6e42 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.138361 Aug 25 05:42:51.130413 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 616/1263] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:50 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:51.328200 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: ERROR oslo.messaging._drivers.impl_rabbit [-] [024c7946-b47b-4a06-aa5e-7d5b6a13301d] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 25 05:42:51.331664 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1b6975a7-f5fa-46f4-86df-98f1d8e71b30 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:51.332553 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1b6975a7-f5fa-46f4-86df-98f1d8e71b30 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:51.338591 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1b6975a7-f5fa-46f4-86df-98f1d8e71b30 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:51.339221 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1b6975a7-f5fa-46f4-86df-98f1d8e71b30 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:51.339834 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1b6975a7-f5fa-46f4-86df-98f1d8e71b30 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:51.340305 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1b6975a7-f5fa-46f4-86df-98f1d8e71b30 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:51.369608 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1b6975a7-f5fa-46f4-86df-98f1d8e71b30 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042784 Aug 25 05:42:51.370158 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 648/1264] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:51 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:51.388535 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-74c9a831-37b4-4e64-a53b-01c524095aed tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:51.389441 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-74c9a831-37b4-4e64-a53b-01c524095aed tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:51.395240 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-74c9a831-37b4-4e64-a53b-01c524095aed tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:51.395687 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-74c9a831-37b4-4e64-a53b-01c524095aed tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:51.396453 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-74c9a831-37b4-4e64-a53b-01c524095aed tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:51.396883 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-74c9a831-37b4-4e64-a53b-01c524095aed tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:51.425572 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-74c9a831-37b4-4e64-a53b-01c524095aed tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041464 Aug 25 05:42:51.426118 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 617/1265] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:42:51 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:42:52.148291 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2feaa16c-27c4-4268-986c-44ca19f1d980 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:52.148919 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2feaa16c-27c4-4268-986c-44ca19f1d980 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:52.155545 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2feaa16c-27c4-4268-986c-44ca19f1d980 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:52.155977 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2feaa16c-27c4-4268-986c-44ca19f1d980 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:52.156730 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2feaa16c-27c4-4268-986c-44ca19f1d980 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:52.157159 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2feaa16c-27c4-4268-986c-44ca19f1d980 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:52.347106 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO oslo.messaging._drivers.impl_rabbit [-] [024c7946-b47b-4a06-aa5e-7d5b6a13301d] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 36096. Aug 25 05:42:52.382327 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d1249742-da1f-4d8d-813c-b3bf95333d98 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:52.383255 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-d1249742-da1f-4d8d-813c-b3bf95333d98 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:52.389170 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d1249742-da1f-4d8d-813c-b3bf95333d98 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:52.389802 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d1249742-da1f-4d8d-813c-b3bf95333d98 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:52.390407 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d1249742-da1f-4d8d-813c-b3bf95333d98 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:52.390840 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d1249742-da1f-4d8d-813c-b3bf95333d98 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:52.423022 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d1249742-da1f-4d8d-813c-b3bf95333d98 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044667 Aug 25 05:42:52.423514 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 618/1266] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:52 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:42:52.436608 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-98870b6d-c0c8-40c1-8996-8484cb4feb9b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:52.437550 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-98870b6d-c0c8-40c1-8996-8484cb4feb9b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:52.443306 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-98870b6d-c0c8-40c1-8996-8484cb4feb9b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:52.443752 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-98870b6d-c0c8-40c1-8996-8484cb4feb9b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:52.444521 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-98870b6d-c0c8-40c1-8996-8484cb4feb9b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:52.444955 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-98870b6d-c0c8-40c1-8996-8484cb4feb9b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:52.475481 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-98870b6d-c0c8-40c1-8996-8484cb4feb9b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043027 Aug 25 05:42:52.476044 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 619/1267] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:42:52 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:42:52.502398 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-2feaa16c-27c4-4268-986c-44ca19f1d980 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:52.509394 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2feaa16c-27c4-4268-986c-44ca19f1d980 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.364817 Aug 25 05:42:52.509972 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 649/1268] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:52 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:53.434565 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-eedabe9f-e6ee-4c80-a72b-bc6a57a6bab1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:53.436093 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-eedabe9f-e6ee-4c80-a72b-bc6a57a6bab1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:53.441905 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-eedabe9f-e6ee-4c80-a72b-bc6a57a6bab1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:53.442345 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-eedabe9f-e6ee-4c80-a72b-bc6a57a6bab1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:53.443103 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-eedabe9f-e6ee-4c80-a72b-bc6a57a6bab1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:53.443525 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-eedabe9f-e6ee-4c80-a72b-bc6a57a6bab1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:53.471945 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-eedabe9f-e6ee-4c80-a72b-bc6a57a6bab1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041190 Aug 25 05:42:53.472501 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 620/1269] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:53 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:53.487240 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-170facfc-cc71-4c51-831d-2dfbbe9cf008 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:53.488138 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-170facfc-cc71-4c51-831d-2dfbbe9cf008 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:53.493848 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-170facfc-cc71-4c51-831d-2dfbbe9cf008 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:53.494284 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-170facfc-cc71-4c51-831d-2dfbbe9cf008 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:53.495038 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-170facfc-cc71-4c51-831d-2dfbbe9cf008 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:53.495463 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-170facfc-cc71-4c51-831d-2dfbbe9cf008 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:53.525398 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-170facfc-cc71-4c51-831d-2dfbbe9cf008 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041656 Aug 25 05:42:53.525998 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 650/1270] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:42:53 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:42:53.528216 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7ac50a69-9f56-48f0-8c15-7115be11cc31 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:53.529298 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7ac50a69-9f56-48f0-8c15-7115be11cc31 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:53.535498 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7ac50a69-9f56-48f0-8c15-7115be11cc31 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:53.536244 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7ac50a69-9f56-48f0-8c15-7115be11cc31 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:53.536737 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7ac50a69-9f56-48f0-8c15-7115be11cc31 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:53.537165 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7ac50a69-9f56-48f0-8c15-7115be11cc31 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:53.660466 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-7ac50a69-9f56-48f0-8c15-7115be11cc31 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:53.667972 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7ac50a69-9f56-48f0-8c15-7115be11cc31 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.143733 Aug 25 05:42:53.668508 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 621/1271] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:53 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:42:54.483634 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-77a5d642-64ab-4669-9022-54b2d4ce38a1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:54.484451 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-77a5d642-64ab-4669-9022-54b2d4ce38a1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:54.490185 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-77a5d642-64ab-4669-9022-54b2d4ce38a1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:54.490771 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-77a5d642-64ab-4669-9022-54b2d4ce38a1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:54.491338 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-77a5d642-64ab-4669-9022-54b2d4ce38a1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:54.491759 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-77a5d642-64ab-4669-9022-54b2d4ce38a1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:54.522138 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-77a5d642-64ab-4669-9022-54b2d4ce38a1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042377 Aug 25 05:42:54.522689 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 651/1272] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:54 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:54.536109 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7c6abb6a-1a87-4ed7-bf53-a65338c3d7c4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:54.537041 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7c6abb6a-1a87-4ed7-bf53-a65338c3d7c4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:54.542892 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7c6abb6a-1a87-4ed7-bf53-a65338c3d7c4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:54.543331 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7c6abb6a-1a87-4ed7-bf53-a65338c3d7c4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:54.544086 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7c6abb6a-1a87-4ed7-bf53-a65338c3d7c4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:54.544548 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7c6abb6a-1a87-4ed7-bf53-a65338c3d7c4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:54.574181 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7c6abb6a-1a87-4ed7-bf53-a65338c3d7c4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041724 Aug 25 05:42:54.574732 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 622/1273] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:42:54 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:42:54.686170 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-aaa6e4e6-638d-41ff-9b5a-c7940f983827 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:54.686781 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-aaa6e4e6-638d-41ff-9b5a-c7940f983827 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:54.692804 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-aaa6e4e6-638d-41ff-9b5a-c7940f983827 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:54.693034 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-aaa6e4e6-638d-41ff-9b5a-c7940f983827 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:54.693826 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-aaa6e4e6-638d-41ff-9b5a-c7940f983827 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:54.694258 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-aaa6e4e6-638d-41ff-9b5a-c7940f983827 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:54.818525 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-aaa6e4e6-638d-41ff-9b5a-c7940f983827 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:54.826093 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-aaa6e4e6-638d-41ff-9b5a-c7940f983827 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.144198 Aug 25 05:42:54.826794 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 652/1274] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:54 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:55.534109 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-733fecf2-e995-4cf4-b57e-7c032e56139f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:55.535017 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-733fecf2-e995-4cf4-b57e-7c032e56139f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:55.540819 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-733fecf2-e995-4cf4-b57e-7c032e56139f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:55.541352 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-733fecf2-e995-4cf4-b57e-7c032e56139f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:55.542047 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-733fecf2-e995-4cf4-b57e-7c032e56139f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:55.542481 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-733fecf2-e995-4cf4-b57e-7c032e56139f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:55.572810 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-733fecf2-e995-4cf4-b57e-7c032e56139f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042396 Aug 25 05:42:55.573529 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 623/1275] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:55 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:55.585970 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-66f8a197-20c9-467c-b9c4-f5008fce5849 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:55.586904 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-66f8a197-20c9-467c-b9c4-f5008fce5849 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:55.592704 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-66f8a197-20c9-467c-b9c4-f5008fce5849 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:55.593143 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-66f8a197-20c9-467c-b9c4-f5008fce5849 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:55.593927 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-66f8a197-20c9-467c-b9c4-f5008fce5849 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:55.594366 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-66f8a197-20c9-467c-b9c4-f5008fce5849 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:55.623242 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-66f8a197-20c9-467c-b9c4-f5008fce5849 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040303 Aug 25 05:42:55.623711 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 653/1276] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:42:55 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:42:55.843808 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5372326b-3cd8-4d97-8c16-7cb12ff43fb6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:55.844420 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5372326b-3cd8-4d97-8c16-7cb12ff43fb6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:55.850321 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5372326b-3cd8-4d97-8c16-7cb12ff43fb6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:55.850771 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5372326b-3cd8-4d97-8c16-7cb12ff43fb6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:55.851532 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5372326b-3cd8-4d97-8c16-7cb12ff43fb6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:55.851967 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5372326b-3cd8-4d97-8c16-7cb12ff43fb6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:55.977276 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-5372326b-3cd8-4d97-8c16-7cb12ff43fb6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:55.985672 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5372326b-3cd8-4d97-8c16-7cb12ff43fb6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.146024 Aug 25 05:42:55.986228 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 624/1277] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:55 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:56.584309 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-4f5ee663-82a2-4bdf-acc0-317e7c281f2d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:56.585198 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-4f5ee663-82a2-4bdf-acc0-317e7c281f2d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:56.590873 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4f5ee663-82a2-4bdf-acc0-317e7c281f2d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:56.591458 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4f5ee663-82a2-4bdf-acc0-317e7c281f2d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:56.592055 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4f5ee663-82a2-4bdf-acc0-317e7c281f2d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:56.592970 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4f5ee663-82a2-4bdf-acc0-317e7c281f2d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:56.622632 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-4f5ee663-82a2-4bdf-acc0-317e7c281f2d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042110 Aug 25 05:42:56.623179 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 654/1278] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:56 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:56.634781 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-74935721-0761-460c-91ba-8be0d97348c9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:56.635819 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-74935721-0761-460c-91ba-8be0d97348c9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:56.642022 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-74935721-0761-460c-91ba-8be0d97348c9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:56.642547 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-74935721-0761-460c-91ba-8be0d97348c9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:56.643312 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-74935721-0761-460c-91ba-8be0d97348c9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:56.643732 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-74935721-0761-460c-91ba-8be0d97348c9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:56.675114 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-74935721-0761-460c-91ba-8be0d97348c9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043861 Aug 25 05:42:56.675594 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 625/1279] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:42:56 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:42:57.002508 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-56fa5fc7-a1da-48ac-aaea-9f46146a1635 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:57.003267 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-56fa5fc7-a1da-48ac-aaea-9f46146a1635 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:57.009107 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-56fa5fc7-a1da-48ac-aaea-9f46146a1635 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:57.009570 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-56fa5fc7-a1da-48ac-aaea-9f46146a1635 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:57.010337 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-56fa5fc7-a1da-48ac-aaea-9f46146a1635 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:57.010760 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-56fa5fc7-a1da-48ac-aaea-9f46146a1635 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:57.133607 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-56fa5fc7-a1da-48ac-aaea-9f46146a1635 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:57.141483 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-56fa5fc7-a1da-48ac-aaea-9f46146a1635 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.143043 Aug 25 05:42:57.142232 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 655/1280] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:56 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:57.634389 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-2636ee6a-f6c4-4747-a708-4c40c4aa5771 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:57.635342 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-2636ee6a-f6c4-4747-a708-4c40c4aa5771 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:57.642810 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2636ee6a-f6c4-4747-a708-4c40c4aa5771 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:57.643335 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2636ee6a-f6c4-4747-a708-4c40c4aa5771 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:57.644099 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2636ee6a-f6c4-4747-a708-4c40c4aa5771 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:57.644548 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2636ee6a-f6c4-4747-a708-4c40c4aa5771 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:57.673393 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-2636ee6a-f6c4-4747-a708-4c40c4aa5771 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042798 Aug 25 05:42:57.673964 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 626/1281] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:57 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:57.686189 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-723ac23c-0b69-4110-8f02-4e95ef9af72a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:57.688205 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-723ac23c-0b69-4110-8f02-4e95ef9af72a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:57.694017 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-723ac23c-0b69-4110-8f02-4e95ef9af72a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:57.694458 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-723ac23c-0b69-4110-8f02-4e95ef9af72a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:57.695220 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-723ac23c-0b69-4110-8f02-4e95ef9af72a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:57.695649 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-723ac23c-0b69-4110-8f02-4e95ef9af72a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:57.724502 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-723ac23c-0b69-4110-8f02-4e95ef9af72a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042048 Aug 25 05:42:57.724974 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 656/1282] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:42:57 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:42:58.158939 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-9a13fa5a-7617-4e65-a683-ef2dcf6bed2c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:58.159567 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-9a13fa5a-7617-4e65-a683-ef2dcf6bed2c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:58.165376 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9a13fa5a-7617-4e65-a683-ef2dcf6bed2c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:58.165856 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9a13fa5a-7617-4e65-a683-ef2dcf6bed2c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:58.166797 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9a13fa5a-7617-4e65-a683-ef2dcf6bed2c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:58.167132 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9a13fa5a-7617-4e65-a683-ef2dcf6bed2c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:58.287138 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-9a13fa5a-7617-4e65-a683-ef2dcf6bed2c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:58.294396 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-9a13fa5a-7617-4e65-a683-ef2dcf6bed2c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.139412 Aug 25 05:42:58.294952 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 627/1283] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:58 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:42:58.684996 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6e8cfeca-dd72-4abe-8f9c-f9fa17d9379b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:58.685958 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6e8cfeca-dd72-4abe-8f9c-f9fa17d9379b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:58.692334 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6e8cfeca-dd72-4abe-8f9c-f9fa17d9379b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:58.692910 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6e8cfeca-dd72-4abe-8f9c-f9fa17d9379b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:58.693595 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6e8cfeca-dd72-4abe-8f9c-f9fa17d9379b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:58.694027 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6e8cfeca-dd72-4abe-8f9c-f9fa17d9379b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:58.721824 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6e8cfeca-dd72-4abe-8f9c-f9fa17d9379b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040602 Aug 25 05:42:58.722374 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 657/1284] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:58 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:58.736713 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-06665486-4381-49e2-885b-3f7139b10fb9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:58.737659 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-06665486-4381-49e2-885b-3f7139b10fb9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:58.743470 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-06665486-4381-49e2-885b-3f7139b10fb9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:58.743915 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-06665486-4381-49e2-885b-3f7139b10fb9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:58.744685 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-06665486-4381-49e2-885b-3f7139b10fb9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:58.745119 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-06665486-4381-49e2-885b-3f7139b10fb9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:58.774148 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-06665486-4381-49e2-885b-3f7139b10fb9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042259 Aug 25 05:42:58.774702 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 628/1285] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:42:58 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:42:59.311421 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c4099fae-c173-4081-acd2-831a45ae0f24 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:59.312553 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c4099fae-c173-4081-acd2-831a45ae0f24 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:59.318363 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c4099fae-c173-4081-acd2-831a45ae0f24 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:59.318851 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c4099fae-c173-4081-acd2-831a45ae0f24 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:59.319563 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c4099fae-c173-4081-acd2-831a45ae0f24 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:59.319987 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c4099fae-c173-4081-acd2-831a45ae0f24 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:59.444675 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-c4099fae-c173-4081-acd2-831a45ae0f24 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:42:59.451958 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c4099fae-c173-4081-acd2-831a45ae0f24 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.144220 Aug 25 05:42:59.453163 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 658/1286] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:42:59 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:42:59.733237 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-322ea7e5-d2d3-41fe-a432-18439389206a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:59.734319 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-322ea7e5-d2d3-41fe-a432-18439389206a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:59.740051 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-322ea7e5-d2d3-41fe-a432-18439389206a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:59.740617 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-322ea7e5-d2d3-41fe-a432-18439389206a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:59.741245 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-322ea7e5-d2d3-41fe-a432-18439389206a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:59.741909 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-322ea7e5-d2d3-41fe-a432-18439389206a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:59.771400 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-322ea7e5-d2d3-41fe-a432-18439389206a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042009 Aug 25 05:42:59.771953 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 629/1287] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:42:59 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:42:59.785696 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-edc3ea81-f374-4586-8a1b-ec660c9e084e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:42:59.786665 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-edc3ea81-f374-4586-8a1b-ec660c9e084e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:42:59.792454 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-edc3ea81-f374-4586-8a1b-ec660c9e084e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:59.792898 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-edc3ea81-f374-4586-8a1b-ec660c9e084e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:59.793696 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-edc3ea81-f374-4586-8a1b-ec660c9e084e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:42:59.794133 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-edc3ea81-f374-4586-8a1b-ec660c9e084e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:42:59.822989 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-edc3ea81-f374-4586-8a1b-ec660c9e084e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041173 Aug 25 05:42:59.823542 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 659/1288] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:42:59 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:00.184951 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 05:43:00.185185 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: Wed Aug 25 05:43:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 05:43:00.469754 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-15b78fb1-f62d-4a3b-ba2f-b9e569cb4530 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:00.470528 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-15b78fb1-f62d-4a3b-ba2f-b9e569cb4530 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:00.476163 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-15b78fb1-f62d-4a3b-ba2f-b9e569cb4530 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:00.476612 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-15b78fb1-f62d-4a3b-ba2f-b9e569cb4530 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:00.477372 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-15b78fb1-f62d-4a3b-ba2f-b9e569cb4530 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:00.477830 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-15b78fb1-f62d-4a3b-ba2f-b9e569cb4530 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:00.599594 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-15b78fb1-f62d-4a3b-ba2f-b9e569cb4530 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:00.606866 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-15b78fb1-f62d-4a3b-ba2f-b9e569cb4530 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.141328 Aug 25 05:43:00.607366 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 630/1289] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:00 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:00.783358 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5de12791-01ce-40fb-8867-63a4a58520f3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:00.784293 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5de12791-01ce-40fb-8867-63a4a58520f3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:00.790196 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5de12791-01ce-40fb-8867-63a4a58520f3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:00.790769 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5de12791-01ce-40fb-8867-63a4a58520f3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:00.791389 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5de12791-01ce-40fb-8867-63a4a58520f3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:00.791823 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5de12791-01ce-40fb-8867-63a4a58520f3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:00.820491 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5de12791-01ce-40fb-8867-63a4a58520f3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041627 Aug 25 05:43:00.821050 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 660/1290] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:43:00 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:43:00.834721 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-de7015e3-44ee-4133-8a69-35d0a43cceb1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:00.835633 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-de7015e3-44ee-4133-8a69-35d0a43cceb1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:00.841381 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-de7015e3-44ee-4133-8a69-35d0a43cceb1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:00.841859 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-de7015e3-44ee-4133-8a69-35d0a43cceb1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:00.842627 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-de7015e3-44ee-4133-8a69-35d0a43cceb1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:00.843060 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-de7015e3-44ee-4133-8a69-35d0a43cceb1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:00.872118 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-de7015e3-44ee-4133-8a69-35d0a43cceb1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041129 Aug 25 05:43:00.872669 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 631/1291] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:00 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:01.626623 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a2317800-0b43-4285-b3ad-e775b287b39c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:01.627224 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a2317800-0b43-4285-b3ad-e775b287b39c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:01.633020 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a2317800-0b43-4285-b3ad-e775b287b39c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:01.633459 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a2317800-0b43-4285-b3ad-e775b287b39c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:01.634243 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a2317800-0b43-4285-b3ad-e775b287b39c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:01.634761 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a2317800-0b43-4285-b3ad-e775b287b39c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:01.756424 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-a2317800-0b43-4285-b3ad-e775b287b39c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:01.763550 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a2317800-0b43-4285-b3ad-e775b287b39c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.142340 Aug 25 05:43:01.764093 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 661/1292] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:01 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:01.831693 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-657abce4-e122-46a3-aa50-e65b87595403 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:01.832595 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-657abce4-e122-46a3-aa50-e65b87595403 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:01.838379 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-657abce4-e122-46a3-aa50-e65b87595403 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:01.838950 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-657abce4-e122-46a3-aa50-e65b87595403 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:01.839716 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-657abce4-e122-46a3-aa50-e65b87595403 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:01.840106 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-657abce4-e122-46a3-aa50-e65b87595403 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:01.869106 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-657abce4-e122-46a3-aa50-e65b87595403 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041258 Aug 25 05:43:01.869669 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 632/1293] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:43:01 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:43:01.883806 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1dd92ab3-394e-40be-8271-89360fa0f605 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:01.884718 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1dd92ab3-394e-40be-8271-89360fa0f605 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:01.890661 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1dd92ab3-394e-40be-8271-89360fa0f605 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:01.897065 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1dd92ab3-394e-40be-8271-89360fa0f605 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:01.897065 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1dd92ab3-394e-40be-8271-89360fa0f605 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:01.897065 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1dd92ab3-394e-40be-8271-89360fa0f605 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:01.923192 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1dd92ab3-394e-40be-8271-89360fa0f605 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042459 Aug 25 05:43:01.923752 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 662/1294] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:01 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:02.780187 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7b9c2fbd-f181-4811-90ef-e65f77650886 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:02.780791 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7b9c2fbd-f181-4811-90ef-e65f77650886 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:02.787446 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7b9c2fbd-f181-4811-90ef-e65f77650886 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:02.787828 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7b9c2fbd-f181-4811-90ef-e65f77650886 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:02.788585 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7b9c2fbd-f181-4811-90ef-e65f77650886 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:02.789086 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7b9c2fbd-f181-4811-90ef-e65f77650886 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:02.881062 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-50cd45f8-818e-42a8-88e0-a2a0811ca4ae tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:02.882084 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-50cd45f8-818e-42a8-88e0-a2a0811ca4ae tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:02.888456 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-50cd45f8-818e-42a8-88e0-a2a0811ca4ae tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:02.889089 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-50cd45f8-818e-42a8-88e0-a2a0811ca4ae tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:02.889888 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-50cd45f8-818e-42a8-88e0-a2a0811ca4ae tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:02.890735 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-50cd45f8-818e-42a8-88e0-a2a0811ca4ae tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:02.916368 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-7b9c2fbd-f181-4811-90ef-e65f77650886 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:02.921263 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-50cd45f8-818e-42a8-88e0-a2a0811ca4ae tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044491 Aug 25 05:43:02.921870 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 663/1295] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:43:02 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:43:02.924347 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7b9c2fbd-f181-4811-90ef-e65f77650886 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.147208 Aug 25 05:43:02.924960 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 633/1296] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:02 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:02.934414 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-0400fdcf-9152-498c-ac6d-49942dd80639 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:02.935288 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-0400fdcf-9152-498c-ac6d-49942dd80639 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:02.941816 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0400fdcf-9152-498c-ac6d-49942dd80639 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:02.942250 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0400fdcf-9152-498c-ac6d-49942dd80639 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:02.943003 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0400fdcf-9152-498c-ac6d-49942dd80639 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:02.943431 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0400fdcf-9152-498c-ac6d-49942dd80639 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:02.972519 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-0400fdcf-9152-498c-ac6d-49942dd80639 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041767 Aug 25 05:43:02.973059 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 664/1297] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:02 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:43:03.933090 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-4dd2003a-f69e-44dc-b6e7-43bd00ccb845 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:03.934018 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-4dd2003a-f69e-44dc-b6e7-43bd00ccb845 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:03.940099 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4dd2003a-f69e-44dc-b6e7-43bd00ccb845 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:03.940583 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4dd2003a-f69e-44dc-b6e7-43bd00ccb845 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:03.941008 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5b663fdc-8df2-4758-9e94-5c137d2835c3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:03.941433 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4dd2003a-f69e-44dc-b6e7-43bd00ccb845 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:03.941647 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5b663fdc-8df2-4758-9e94-5c137d2835c3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:03.941783 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4dd2003a-f69e-44dc-b6e7-43bd00ccb845 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:03.947569 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5b663fdc-8df2-4758-9e94-5c137d2835c3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:03.948012 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5b663fdc-8df2-4758-9e94-5c137d2835c3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:03.948780 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5b663fdc-8df2-4758-9e94-5c137d2835c3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:03.949213 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5b663fdc-8df2-4758-9e94-5c137d2835c3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:03.971783 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-4dd2003a-f69e-44dc-b6e7-43bd00ccb845 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042540 Aug 25 05:43:03.972337 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 634/1298] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:43:03 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:43:03.983063 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-081695ff-91ae-4ffd-bc4d-f0574afdfc58 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:03.984134 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-081695ff-91ae-4ffd-bc4d-f0574afdfc58 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:03.990762 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-081695ff-91ae-4ffd-bc4d-f0574afdfc58 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:03.991204 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-081695ff-91ae-4ffd-bc4d-f0574afdfc58 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:03.991975 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-081695ff-91ae-4ffd-bc4d-f0574afdfc58 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:03.992406 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-081695ff-91ae-4ffd-bc4d-f0574afdfc58 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:04.021116 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-081695ff-91ae-4ffd-bc4d-f0574afdfc58 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041631 Aug 25 05:43:04.021711 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 635/1299] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:03 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:43:04.073925 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-5b663fdc-8df2-4758-9e94-5c137d2835c3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:04.081429 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5b663fdc-8df2-4758-9e94-5c137d2835c3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.144347 Aug 25 05:43:04.082010 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 665/1300] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:03 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:43:04.983829 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-f376ef50-a80e-4e24-83d2-f8ab47239398 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:04.984864 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-f376ef50-a80e-4e24-83d2-f8ab47239398 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:04.990995 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f376ef50-a80e-4e24-83d2-f8ab47239398 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:04.991443 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f376ef50-a80e-4e24-83d2-f8ab47239398 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:04.992219 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f376ef50-a80e-4e24-83d2-f8ab47239398 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:04.992658 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f376ef50-a80e-4e24-83d2-f8ab47239398 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:05.022343 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-f376ef50-a80e-4e24-83d2-f8ab47239398 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042252 Aug 25 05:43:05.022900 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 636/1301] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:43:04 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:43:05.031987 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-4fa73b54-a693-407f-8bf7-bb56fce3e99d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:05.032896 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-4fa73b54-a693-407f-8bf7-bb56fce3e99d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:05.039417 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4fa73b54-a693-407f-8bf7-bb56fce3e99d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:05.039858 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4fa73b54-a693-407f-8bf7-bb56fce3e99d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:05.040621 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4fa73b54-a693-407f-8bf7-bb56fce3e99d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:05.041391 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4fa73b54-a693-407f-8bf7-bb56fce3e99d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:05.070689 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-4fa73b54-a693-407f-8bf7-bb56fce3e99d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042313 Aug 25 05:43:05.071161 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 666/1302] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:05 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:05.098258 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-22e62591-eb93-417a-b6b7-3355175f952f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:05.098869 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-22e62591-eb93-417a-b6b7-3355175f952f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:05.104894 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-22e62591-eb93-417a-b6b7-3355175f952f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:05.105344 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-22e62591-eb93-417a-b6b7-3355175f952f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:05.106142 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-22e62591-eb93-417a-b6b7-3355175f952f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:05.106580 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-22e62591-eb93-417a-b6b7-3355175f952f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:05.227750 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-22e62591-eb93-417a-b6b7-3355175f952f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:05.235037 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-22e62591-eb93-417a-b6b7-3355175f952f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.140654 Aug 25 05:43:05.235599 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 637/1303] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:05 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:06.033568 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-3a755d7e-991e-4c28-8060-1acebb2b9509 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:06.034590 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-3a755d7e-991e-4c28-8060-1acebb2b9509 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:06.040397 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3a755d7e-991e-4c28-8060-1acebb2b9509 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:06.040842 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3a755d7e-991e-4c28-8060-1acebb2b9509 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:06.041637 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3a755d7e-991e-4c28-8060-1acebb2b9509 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:06.042073 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3a755d7e-991e-4c28-8060-1acebb2b9509 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:06.071340 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-3a755d7e-991e-4c28-8060-1acebb2b9509 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042124 Aug 25 05:43:06.071889 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 667/1304] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:43:06 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:43:06.082652 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-11bea9c8-3c2c-4d8d-b612-dd91d9cf5d00 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:06.083609 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-11bea9c8-3c2c-4d8d-b612-dd91d9cf5d00 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:06.089408 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-11bea9c8-3c2c-4d8d-b612-dd91d9cf5d00 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:06.089884 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-11bea9c8-3c2c-4d8d-b612-dd91d9cf5d00 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:06.090650 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-11bea9c8-3c2c-4d8d-b612-dd91d9cf5d00 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:06.091084 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-11bea9c8-3c2c-4d8d-b612-dd91d9cf5d00 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:06.120448 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-11bea9c8-3c2c-4d8d-b612-dd91d9cf5d00 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042438 Aug 25 05:43:06.121013 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 638/1305] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:06 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:06.252794 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-457dc068-51ed-4549-b9c3-fb7d8d9b32cb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:06.253298 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-457dc068-51ed-4549-b9c3-fb7d8d9b32cb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:06.259180 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-457dc068-51ed-4549-b9c3-fb7d8d9b32cb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:06.259624 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-457dc068-51ed-4549-b9c3-fb7d8d9b32cb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:06.260390 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-457dc068-51ed-4549-b9c3-fb7d8d9b32cb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:06.260812 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-457dc068-51ed-4549-b9c3-fb7d8d9b32cb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:06.386108 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-457dc068-51ed-4549-b9c3-fb7d8d9b32cb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:06.393943 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-457dc068-51ed-4549-b9c3-fb7d8d9b32cb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.145588 Aug 25 05:43:06.394492 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 668/1306] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:06 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:07.083368 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-9e5aac11-7fe4-4a09-8333-86b5e63ca1f4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:07.084266 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-9e5aac11-7fe4-4a09-8333-86b5e63ca1f4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:07.090009 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9e5aac11-7fe4-4a09-8333-86b5e63ca1f4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:07.090448 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9e5aac11-7fe4-4a09-8333-86b5e63ca1f4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:07.091205 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9e5aac11-7fe4-4a09-8333-86b5e63ca1f4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:07.091628 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9e5aac11-7fe4-4a09-8333-86b5e63ca1f4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:07.120117 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-9e5aac11-7fe4-4a09-8333-86b5e63ca1f4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041118 Aug 25 05:43:07.120662 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 639/1307] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:43:07 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:43:07.132354 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ba00e16a-c0c0-47ab-8d3b-6dbb0de90737 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:07.133419 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ba00e16a-c0c0-47ab-8d3b-6dbb0de90737 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:07.139308 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ba00e16a-c0c0-47ab-8d3b-6dbb0de90737 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:07.139747 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ba00e16a-c0c0-47ab-8d3b-6dbb0de90737 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:07.140502 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ba00e16a-c0c0-47ab-8d3b-6dbb0de90737 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:07.140929 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ba00e16a-c0c0-47ab-8d3b-6dbb0de90737 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:07.170329 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ba00e16a-c0c0-47ab-8d3b-6dbb0de90737 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041779 Aug 25 05:43:07.170880 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 669/1308] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:07 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:07.411276 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8162ce94-f904-4d86-b8f4-628a71b623fc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:07.411916 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8162ce94-f904-4d86-b8f4-628a71b623fc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:07.417722 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8162ce94-f904-4d86-b8f4-628a71b623fc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:07.418163 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8162ce94-f904-4d86-b8f4-628a71b623fc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:07.418921 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8162ce94-f904-4d86-b8f4-628a71b623fc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:07.419345 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8162ce94-f904-4d86-b8f4-628a71b623fc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:07.541489 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-8162ce94-f904-4d86-b8f4-628a71b623fc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:07.548854 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8162ce94-f904-4d86-b8f4-628a71b623fc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.141511 Aug 25 05:43:07.549409 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 640/1309] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:07 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:08.132234 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-642a8ad5-ca30-4374-9ea9-57c7fc5ebbf0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:08.133129 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-642a8ad5-ca30-4374-9ea9-57c7fc5ebbf0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:08.139004 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-642a8ad5-ca30-4374-9ea9-57c7fc5ebbf0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:08.139439 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-642a8ad5-ca30-4374-9ea9-57c7fc5ebbf0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:08.140197 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-642a8ad5-ca30-4374-9ea9-57c7fc5ebbf0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:08.140625 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-642a8ad5-ca30-4374-9ea9-57c7fc5ebbf0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:08.171999 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-642a8ad5-ca30-4374-9ea9-57c7fc5ebbf0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044166 Aug 25 05:43:08.172552 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 670/1310] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:43:08 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:43:08.181710 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-935d9d10-745b-4af0-a989-53b1fd09f6e8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:08.182663 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-935d9d10-745b-4af0-a989-53b1fd09f6e8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:08.188643 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-935d9d10-745b-4af0-a989-53b1fd09f6e8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:08.189079 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-935d9d10-745b-4af0-a989-53b1fd09f6e8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:08.189886 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-935d9d10-745b-4af0-a989-53b1fd09f6e8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:08.190348 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-935d9d10-745b-4af0-a989-53b1fd09f6e8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:08.220692 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-935d9d10-745b-4af0-a989-53b1fd09f6e8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042681 Aug 25 05:43:08.221244 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 641/1311] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:08 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:08.571937 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-8606be66-23e6-470a-bc33-979fd42c4a35 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:08.572577 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-8606be66-23e6-470a-bc33-979fd42c4a35 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:08.578497 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8606be66-23e6-470a-bc33-979fd42c4a35 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:08.578940 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8606be66-23e6-470a-bc33-979fd42c4a35 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:08.579730 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8606be66-23e6-470a-bc33-979fd42c4a35 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:08.580164 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8606be66-23e6-470a-bc33-979fd42c4a35 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:08.703368 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-8606be66-23e6-470a-bc33-979fd42c4a35 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:08.711518 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-8606be66-23e6-470a-bc33-979fd42c4a35 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.143273 Aug 25 05:43:08.712082 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 671/1312] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:08 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:09.185806 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-70cdfb21-c1a1-41bd-b138-f0d15b53f359 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:09.187212 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-70cdfb21-c1a1-41bd-b138-f0d15b53f359 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:09.194969 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-70cdfb21-c1a1-41bd-b138-f0d15b53f359 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:09.195531 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-70cdfb21-c1a1-41bd-b138-f0d15b53f359 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:09.196321 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-70cdfb21-c1a1-41bd-b138-f0d15b53f359 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:09.196881 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-70cdfb21-c1a1-41bd-b138-f0d15b53f359 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:09.232113 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-22a0f826-071e-4058-a829-8e43e6d7a78c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:09.233035 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-22a0f826-071e-4058-a829-8e43e6d7a78c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:09.234430 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-70cdfb21-c1a1-41bd-b138-f0d15b53f359 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053979 Aug 25 05:43:09.235052 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 642/1313] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:43:09 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:43:09.239758 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-22a0f826-071e-4058-a829-8e43e6d7a78c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:09.240206 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-22a0f826-071e-4058-a829-8e43e6d7a78c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:09.240974 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-22a0f826-071e-4058-a829-8e43e6d7a78c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:09.241404 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-22a0f826-071e-4058-a829-8e43e6d7a78c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:09.272799 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-22a0f826-071e-4058-a829-8e43e6d7a78c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044308 Aug 25 05:43:09.273390 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 672/1314] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:09 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:43:09.728701 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e3b367bb-4dbd-4c8f-8f56-bdc9cfdab0da tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:09.729220 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e3b367bb-4dbd-4c8f-8f56-bdc9cfdab0da tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:09.735035 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e3b367bb-4dbd-4c8f-8f56-bdc9cfdab0da tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:09.735475 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e3b367bb-4dbd-4c8f-8f56-bdc9cfdab0da tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:09.736234 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e3b367bb-4dbd-4c8f-8f56-bdc9cfdab0da tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:09.736662 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e3b367bb-4dbd-4c8f-8f56-bdc9cfdab0da tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:09.865305 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e3b367bb-4dbd-4c8f-8f56-bdc9cfdab0da tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:09.872592 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e3b367bb-4dbd-4c8f-8f56-bdc9cfdab0da tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.147661 Aug 25 05:43:09.873146 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 643/1315] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:09 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:10.246428 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ae39fc1b-0094-4889-9332-dc657e1f872d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:10.247320 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ae39fc1b-0094-4889-9332-dc657e1f872d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:10.253519 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ae39fc1b-0094-4889-9332-dc657e1f872d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:10.254606 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ae39fc1b-0094-4889-9332-dc657e1f872d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:10.254606 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ae39fc1b-0094-4889-9332-dc657e1f872d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:10.254606 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ae39fc1b-0094-4889-9332-dc657e1f872d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:10.284114 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ae39fc1b-0094-4889-9332-dc657e1f872d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041501 Aug 25 05:43:10.284376 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7c73566b-9e78-4a15-97f4-70ba252f1218 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:10.284822 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 673/1316] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:43:10 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:43:10.285736 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7c73566b-9e78-4a15-97f4-70ba252f1218 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:10.291536 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7c73566b-9e78-4a15-97f4-70ba252f1218 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:10.291979 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7c73566b-9e78-4a15-97f4-70ba252f1218 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:10.292740 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7c73566b-9e78-4a15-97f4-70ba252f1218 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:10.293253 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7c73566b-9e78-4a15-97f4-70ba252f1218 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:10.323098 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7c73566b-9e78-4a15-97f4-70ba252f1218 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042630 Aug 25 05:43:10.323635 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 644/1317] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:10 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:43:10.889447 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-feaf439a-b71d-4182-b81d-90aa02b094a6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:10.890027 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-feaf439a-b71d-4182-b81d-90aa02b094a6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:10.896897 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-feaf439a-b71d-4182-b81d-90aa02b094a6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:10.897333 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-feaf439a-b71d-4182-b81d-90aa02b094a6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:10.898124 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-feaf439a-b71d-4182-b81d-90aa02b094a6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:10.898550 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-feaf439a-b71d-4182-b81d-90aa02b094a6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:11.019487 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-feaf439a-b71d-4182-b81d-90aa02b094a6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:11.027057 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-feaf439a-b71d-4182-b81d-90aa02b094a6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.141412 Aug 25 05:43:11.027605 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 674/1318] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:10 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:11.295446 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-19086893-8f78-4f55-8b69-54dd1246c73b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:11.296377 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-19086893-8f78-4f55-8b69-54dd1246c73b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:11.302516 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-19086893-8f78-4f55-8b69-54dd1246c73b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:11.302958 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-19086893-8f78-4f55-8b69-54dd1246c73b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:11.303712 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-19086893-8f78-4f55-8b69-54dd1246c73b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:11.304142 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-19086893-8f78-4f55-8b69-54dd1246c73b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:11.334070 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-19086893-8f78-4f55-8b69-54dd1246c73b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042222 Aug 25 05:43:11.334642 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 645/1319] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:43:11 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:43:11.335211 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a6d46a4f-a288-4808-8f4a-e2198341d4d8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:11.336120 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a6d46a4f-a288-4808-8f4a-e2198341d4d8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:11.341916 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a6d46a4f-a288-4808-8f4a-e2198341d4d8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:11.342352 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a6d46a4f-a288-4808-8f4a-e2198341d4d8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:11.343111 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a6d46a4f-a288-4808-8f4a-e2198341d4d8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:11.343553 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a6d46a4f-a288-4808-8f4a-e2198341d4d8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:11.376410 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a6d46a4f-a288-4808-8f4a-e2198341d4d8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045689 Aug 25 05:43:11.376951 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 675/1320] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:11 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:43:12.044291 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-78b5c839-93a3-4d7a-845b-e44178afb8ca tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:12.044893 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-78b5c839-93a3-4d7a-845b-e44178afb8ca tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:12.051166 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-78b5c839-93a3-4d7a-845b-e44178afb8ca tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:12.051602 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-78b5c839-93a3-4d7a-845b-e44178afb8ca tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:12.052358 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-78b5c839-93a3-4d7a-845b-e44178afb8ca tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:12.052780 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-78b5c839-93a3-4d7a-845b-e44178afb8ca tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:12.173287 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-78b5c839-93a3-4d7a-845b-e44178afb8ca tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:12.181169 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-78b5c839-93a3-4d7a-845b-e44178afb8ca tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.140621 Aug 25 05:43:12.181754 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 646/1321] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:12 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:12.345981 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6f71b5e7-e578-48d7-b2aa-dd9f3fa3214a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:12.346878 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6f71b5e7-e578-48d7-b2aa-dd9f3fa3214a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:12.353422 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6f71b5e7-e578-48d7-b2aa-dd9f3fa3214a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:12.353888 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6f71b5e7-e578-48d7-b2aa-dd9f3fa3214a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:12.354637 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6f71b5e7-e578-48d7-b2aa-dd9f3fa3214a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:12.355060 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6f71b5e7-e578-48d7-b2aa-dd9f3fa3214a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:12.384613 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6f71b5e7-e578-48d7-b2aa-dd9f3fa3214a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042471 Aug 25 05:43:12.385185 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 676/1322] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:43:12 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:43:12.388132 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3a4b013f-314d-4361-9134-9ef66eda8c95 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:12.389113 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3a4b013f-314d-4361-9134-9ef66eda8c95 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:12.396265 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3a4b013f-314d-4361-9134-9ef66eda8c95 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:12.396715 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3a4b013f-314d-4361-9134-9ef66eda8c95 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:12.397496 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3a4b013f-314d-4361-9134-9ef66eda8c95 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:12.397975 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3a4b013f-314d-4361-9134-9ef66eda8c95 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:12.427687 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3a4b013f-314d-4361-9134-9ef66eda8c95 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043273 Aug 25 05:43:12.428240 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 647/1323] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:12 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:43:13.198962 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-25b70034-ba17-4055-9269-5ccba0ff5a21 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:13.199564 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-25b70034-ba17-4055-9269-5ccba0ff5a21 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:13.205438 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-25b70034-ba17-4055-9269-5ccba0ff5a21 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:13.205897 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-25b70034-ba17-4055-9269-5ccba0ff5a21 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:13.207263 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-25b70034-ba17-4055-9269-5ccba0ff5a21 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:13.208074 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-25b70034-ba17-4055-9269-5ccba0ff5a21 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:13.331861 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-25b70034-ba17-4055-9269-5ccba0ff5a21 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:13.339188 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-25b70034-ba17-4055-9269-5ccba0ff5a21 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.143858 Aug 25 05:43:13.339743 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 677/1324] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:13 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:13.395714 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e59e74b5-0255-4feb-ba25-ef6768370809 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:13.396622 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e59e74b5-0255-4feb-ba25-ef6768370809 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:13.402884 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e59e74b5-0255-4feb-ba25-ef6768370809 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:13.403359 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e59e74b5-0255-4feb-ba25-ef6768370809 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:13.404127 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e59e74b5-0255-4feb-ba25-ef6768370809 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:13.404556 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e59e74b5-0255-4feb-ba25-ef6768370809 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:13.434127 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e59e74b5-0255-4feb-ba25-ef6768370809 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042219 Aug 25 05:43:13.434685 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 648/1325] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:43:13 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:43:13.439179 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-bbd101f8-3c23-482a-b31a-4e32f6ff6968 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:13.440092 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-bbd101f8-3c23-482a-b31a-4e32f6ff6968 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:13.446561 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bbd101f8-3c23-482a-b31a-4e32f6ff6968 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:13.447006 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bbd101f8-3c23-482a-b31a-4e32f6ff6968 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:13.447773 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bbd101f8-3c23-482a-b31a-4e32f6ff6968 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:13.448204 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bbd101f8-3c23-482a-b31a-4e32f6ff6968 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:13.477095 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-bbd101f8-3c23-482a-b31a-4e32f6ff6968 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041597 Aug 25 05:43:13.477687 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 678/1326] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:13 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:43:14.356158 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-169c5f39-aee8-43e4-aa4d-4479c7da8bd5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:14.356763 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-169c5f39-aee8-43e4-aa4d-4479c7da8bd5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:14.362737 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-169c5f39-aee8-43e4-aa4d-4479c7da8bd5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:14.363184 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-169c5f39-aee8-43e4-aa4d-4479c7da8bd5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:14.363934 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-169c5f39-aee8-43e4-aa4d-4479c7da8bd5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:14.364361 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-169c5f39-aee8-43e4-aa4d-4479c7da8bd5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:14.446343 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-062454d8-30b0-44cf-a0dc-baff9c006627 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:14.447241 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-062454d8-30b0-44cf-a0dc-baff9c006627 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:14.452965 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-062454d8-30b0-44cf-a0dc-baff9c006627 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:14.453445 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-062454d8-30b0-44cf-a0dc-baff9c006627 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:14.454273 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-062454d8-30b0-44cf-a0dc-baff9c006627 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:14.454701 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-062454d8-30b0-44cf-a0dc-baff9c006627 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:14.491294 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-169c5f39-aee8-43e4-aa4d-4479c7da8bd5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:14.493511 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-062454d8-30b0-44cf-a0dc-baff9c006627 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051508 Aug 25 05:43:14.494124 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 679/1327] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 25 05:43:14 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:43:14.498880 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d717faa2-3104-420f-995a-2ad331beb649 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:14.499514 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-169c5f39-aee8-43e4-aa4d-4479c7da8bd5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.147112 Aug 25 05:43:14.499759 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d717faa2-3104-420f-995a-2ad331beb649 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:14.500088 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 649/1328] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:14 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:14.507774 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d717faa2-3104-420f-995a-2ad331beb649 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:14.508563 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d717faa2-3104-420f-995a-2ad331beb649 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:14.509491 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d717faa2-3104-420f-995a-2ad331beb649 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:14.509946 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d717faa2-3104-420f-995a-2ad331beb649 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:14.544507 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d717faa2-3104-420f-995a-2ad331beb649 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049348 Aug 25 05:43:14.545064 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 680/1329] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:14 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:15.506433 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-20a03d12-8c76-4a04-8dbe-12465e55bab2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:43:15.507343 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-20a03d12-8c76-4a04-8dbe-12465e55bab2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:15.513036 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-20a03d12-8c76-4a04-8dbe-12465e55bab2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:15.513471 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-20a03d12-8c76-4a04-8dbe-12465e55bab2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:15.514263 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-20a03d12-8c76-4a04-8dbe-12465e55bab2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:15.514690 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-20a03d12-8c76-4a04-8dbe-12465e55bab2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:15.524542 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5656682b-be7d-4f43-aace-aaf371b8c17c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:15.524542 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5656682b-be7d-4f43-aace-aaf371b8c17c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:15.528090 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5656682b-be7d-4f43-aace-aaf371b8c17c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:15.528656 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5656682b-be7d-4f43-aace-aaf371b8c17c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:15.529480 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5656682b-be7d-4f43-aace-aaf371b8c17c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:15.529949 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5656682b-be7d-4f43-aace-aaf371b8c17c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:15.602635 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-20a03d12-8c76-4a04-8dbe-12465e55bab2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action" status: 200 len: 38307 microversion: 2.20 time: 0.100287 Aug 25 05:43:15.603288 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 650/1330] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:43:15 2021] POST /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da/action => generated 38307 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:43:15.608384 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-cbdcedbc-eae4-4389-9137-6463ebcb6740 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:15.609469 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-cbdcedbc-eae4-4389-9137-6463ebcb6740 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:15.616338 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cbdcedbc-eae4-4389-9137-6463ebcb6740 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:15.616778 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cbdcedbc-eae4-4389-9137-6463ebcb6740 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:15.617575 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cbdcedbc-eae4-4389-9137-6463ebcb6740 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:15.618255 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cbdcedbc-eae4-4389-9137-6463ebcb6740 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:15.648296 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-cbdcedbc-eae4-4389-9137-6463ebcb6740 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043786 Aug 25 05:43:15.652326 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 651/1331] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:15 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:15.656237 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-5656682b-be7d-4f43-aace-aaf371b8c17c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:15.664788 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5656682b-be7d-4f43-aace-aaf371b8c17c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.149218 Aug 25 05:43:15.665360 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 681/1332] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:15 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:43:16.659973 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-4a327a95-5385-4e07-8013-c5b917ef673e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:16.660926 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-4a327a95-5385-4e07-8013-c5b917ef673e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:16.667623 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4a327a95-5385-4e07-8013-c5b917ef673e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:16.668058 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4a327a95-5385-4e07-8013-c5b917ef673e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:16.668815 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4a327a95-5385-4e07-8013-c5b917ef673e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:16.669238 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4a327a95-5385-4e07-8013-c5b917ef673e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:16.680707 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9784e0cd-6cc4-43bd-9d36-9bd6c5c66b8e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:16.681482 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9784e0cd-6cc4-43bd-9d36-9bd6c5c66b8e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:16.687201 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9784e0cd-6cc4-43bd-9d36-9bd6c5c66b8e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:16.687645 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9784e0cd-6cc4-43bd-9d36-9bd6c5c66b8e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:16.688406 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9784e0cd-6cc4-43bd-9d36-9bd6c5c66b8e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:16.688872 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9784e0cd-6cc4-43bd-9d36-9bd6c5c66b8e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:16.699297 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-4a327a95-5385-4e07-8013-c5b917ef673e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043068 Aug 25 05:43:16.700092 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 652/1333] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:16 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:16.818668 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-9784e0cd-6cc4-43bd-9d36-9bd6c5c66b8e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:16.827640 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9784e0cd-6cc4-43bd-9d36-9bd6c5c66b8e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.150739 Aug 25 05:43:16.828201 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 682/1334] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:16 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:43:17.710763 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-dd97fbd7-f911-4a05-9cf6-d4c2b42e79f7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:17.711664 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-dd97fbd7-f911-4a05-9cf6-d4c2b42e79f7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:17.717379 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dd97fbd7-f911-4a05-9cf6-d4c2b42e79f7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:17.717842 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dd97fbd7-f911-4a05-9cf6-d4c2b42e79f7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:17.718591 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dd97fbd7-f911-4a05-9cf6-d4c2b42e79f7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:17.719016 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dd97fbd7-f911-4a05-9cf6-d4c2b42e79f7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:17.748433 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-dd97fbd7-f911-4a05-9cf6-d4c2b42e79f7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041498 Aug 25 05:43:17.748997 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 653/1335] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:17 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:17.845455 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-482a7a42-4968-4de2-9b01-75508cff74f8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:17.846126 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-482a7a42-4968-4de2-9b01-75508cff74f8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:17.853006 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-482a7a42-4968-4de2-9b01-75508cff74f8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:17.866352 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-482a7a42-4968-4de2-9b01-75508cff74f8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:17.866352 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-482a7a42-4968-4de2-9b01-75508cff74f8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:17.866352 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-482a7a42-4968-4de2-9b01-75508cff74f8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:17.975421 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-482a7a42-4968-4de2-9b01-75508cff74f8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:17.983690 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-482a7a42-4968-4de2-9b01-75508cff74f8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.141873 Aug 25 05:43:17.984181 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 683/1336] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:17 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:18.761238 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-4155d8a4-e44f-4ba3-9b85-850f64cb2fb5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:18.762187 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-4155d8a4-e44f-4ba3-9b85-850f64cb2fb5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:18.768945 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4155d8a4-e44f-4ba3-9b85-850f64cb2fb5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:18.769389 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4155d8a4-e44f-4ba3-9b85-850f64cb2fb5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:18.770233 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4155d8a4-e44f-4ba3-9b85-850f64cb2fb5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:18.770661 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4155d8a4-e44f-4ba3-9b85-850f64cb2fb5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:18.802234 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-4155d8a4-e44f-4ba3-9b85-850f64cb2fb5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045568 Aug 25 05:43:18.802953 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 654/1337] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:18 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:18.999901 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f842138a-2bcf-4bd7-bbb9-f47783b70562 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:19.000493 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f842138a-2bcf-4bd7-bbb9-f47783b70562 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:19.006573 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f842138a-2bcf-4bd7-bbb9-f47783b70562 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:19.007021 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f842138a-2bcf-4bd7-bbb9-f47783b70562 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:19.008102 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f842138a-2bcf-4bd7-bbb9-f47783b70562 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:19.008533 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f842138a-2bcf-4bd7-bbb9-f47783b70562 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:19.128227 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-f842138a-2bcf-4bd7-bbb9-f47783b70562 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:19.135730 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f842138a-2bcf-4bd7-bbb9-f47783b70562 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.139505 Aug 25 05:43:19.136294 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 684/1338] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:18 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:19.814594 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8784d3a4-9f55-4c66-bf7b-9c22639e3083 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:19.815519 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8784d3a4-9f55-4c66-bf7b-9c22639e3083 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:19.822042 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8784d3a4-9f55-4c66-bf7b-9c22639e3083 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:19.822505 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8784d3a4-9f55-4c66-bf7b-9c22639e3083 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:19.823278 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8784d3a4-9f55-4c66-bf7b-9c22639e3083 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:19.823704 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8784d3a4-9f55-4c66-bf7b-9c22639e3083 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:19.855482 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8784d3a4-9f55-4c66-bf7b-9c22639e3083 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044639 Aug 25 05:43:19.863251 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 655/1339] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:19 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:43:20.153170 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-38d820a7-4408-4d36-b566-a5645c372a53 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:20.153788 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-38d820a7-4408-4d36-b566-a5645c372a53 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:20.159841 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-38d820a7-4408-4d36-b566-a5645c372a53 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:20.160280 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-38d820a7-4408-4d36-b566-a5645c372a53 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:20.161040 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-38d820a7-4408-4d36-b566-a5645c372a53 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:20.161493 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-38d820a7-4408-4d36-b566-a5645c372a53 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:20.290185 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-38d820a7-4408-4d36-b566-a5645c372a53 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:20.297514 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-38d820a7-4408-4d36-b566-a5645c372a53 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.148249 Aug 25 05:43:20.298136 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 685/1340] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:20 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:20.874189 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-97ab4ba0-2a89-425c-833b-004b9ccfd53d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:20.875093 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-97ab4ba0-2a89-425c-833b-004b9ccfd53d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:20.881044 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-97ab4ba0-2a89-425c-833b-004b9ccfd53d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:20.881490 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-97ab4ba0-2a89-425c-833b-004b9ccfd53d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:20.883438 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-97ab4ba0-2a89-425c-833b-004b9ccfd53d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:20.883871 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-97ab4ba0-2a89-425c-833b-004b9ccfd53d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:20.913318 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-97ab4ba0-2a89-425c-833b-004b9ccfd53d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042776 Aug 25 05:43:20.914079 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 656/1341] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:20 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:21.314321 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-3b8e59ec-4eb7-4ed1-8f2d-09d1f4913815 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:21.314924 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-3b8e59ec-4eb7-4ed1-8f2d-09d1f4913815 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:21.321419 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3b8e59ec-4eb7-4ed1-8f2d-09d1f4913815 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:21.321888 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3b8e59ec-4eb7-4ed1-8f2d-09d1f4913815 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:21.322637 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3b8e59ec-4eb7-4ed1-8f2d-09d1f4913815 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:21.323056 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3b8e59ec-4eb7-4ed1-8f2d-09d1f4913815 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:21.446136 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-3b8e59ec-4eb7-4ed1-8f2d-09d1f4913815 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:21.453658 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-3b8e59ec-4eb7-4ed1-8f2d-09d1f4913815 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.142994 Aug 25 05:43:21.454216 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 686/1342] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:21 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:21.925087 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-9b285f74-c311-4b81-9901-f10af9c3541d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:21.926044 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-9b285f74-c311-4b81-9901-f10af9c3541d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:21.932554 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9b285f74-c311-4b81-9901-f10af9c3541d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:21.932992 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9b285f74-c311-4b81-9901-f10af9c3541d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:21.933812 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9b285f74-c311-4b81-9901-f10af9c3541d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:21.934236 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9b285f74-c311-4b81-9901-f10af9c3541d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:21.961962 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-9b285f74-c311-4b81-9901-f10af9c3541d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040426 Aug 25 05:43:21.962616 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 657/1343] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:21 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:22.470935 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-22a1dc8a-d767-4cd1-a828-583f8b285cf6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:22.471570 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-22a1dc8a-d767-4cd1-a828-583f8b285cf6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:22.480636 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-22a1dc8a-d767-4cd1-a828-583f8b285cf6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:22.481071 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-22a1dc8a-d767-4cd1-a828-583f8b285cf6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:22.481873 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-22a1dc8a-d767-4cd1-a828-583f8b285cf6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:22.482322 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-22a1dc8a-d767-4cd1-a828-583f8b285cf6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:22.602992 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-22a1dc8a-d767-4cd1-a828-583f8b285cf6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:22.610334 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-22a1dc8a-d767-4cd1-a828-583f8b285cf6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.143131 Aug 25 05:43:22.610902 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 687/1344] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:22 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:22.974099 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-4d359445-093f-4a08-a41f-11e35c6a7b24 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:22.975010 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-4d359445-093f-4a08-a41f-11e35c6a7b24 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:22.981534 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4d359445-093f-4a08-a41f-11e35c6a7b24 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:22.981997 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4d359445-093f-4a08-a41f-11e35c6a7b24 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:22.982801 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4d359445-093f-4a08-a41f-11e35c6a7b24 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:22.983230 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4d359445-093f-4a08-a41f-11e35c6a7b24 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:23.013312 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-4d359445-093f-4a08-a41f-11e35c6a7b24 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042850 Aug 25 05:43:23.013952 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 658/1345] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:22 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:23.627551 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-bfd7625c-dd54-4931-8b0b-3361141229ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:23.628154 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-bfd7625c-dd54-4931-8b0b-3361141229ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:23.634072 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bfd7625c-dd54-4931-8b0b-3361141229ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:23.634521 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bfd7625c-dd54-4931-8b0b-3361141229ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:23.635281 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bfd7625c-dd54-4931-8b0b-3361141229ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:23.635715 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bfd7625c-dd54-4931-8b0b-3361141229ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:23.759506 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-bfd7625c-dd54-4931-8b0b-3361141229ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:23.766860 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-bfd7625c-dd54-4931-8b0b-3361141229ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.142972 Aug 25 05:43:23.767417 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 688/1346] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:23 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:24.025964 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d1cdf377-2ccb-4de5-b362-dc9200cbca94 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:24.026782 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-d1cdf377-2ccb-4de5-b362-dc9200cbca94 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:24.032575 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d1cdf377-2ccb-4de5-b362-dc9200cbca94 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:24.033011 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d1cdf377-2ccb-4de5-b362-dc9200cbca94 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:24.033796 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d1cdf377-2ccb-4de5-b362-dc9200cbca94 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:24.034222 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d1cdf377-2ccb-4de5-b362-dc9200cbca94 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:24.063390 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d1cdf377-2ccb-4de5-b362-dc9200cbca94 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042222 Aug 25 05:43:24.063920 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 659/1347] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:24 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:24.784455 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d773d1ad-5379-47b4-bd85-2968a3516fdc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:24.785054 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d773d1ad-5379-47b4-bd85-2968a3516fdc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:24.798821 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d773d1ad-5379-47b4-bd85-2968a3516fdc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:24.799523 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d773d1ad-5379-47b4-bd85-2968a3516fdc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:24.800620 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d773d1ad-5379-47b4-bd85-2968a3516fdc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:24.801056 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d773d1ad-5379-47b4-bd85-2968a3516fdc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:24.928489 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d773d1ad-5379-47b4-bd85-2968a3516fdc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:24.936335 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d773d1ad-5379-47b4-bd85-2968a3516fdc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.155647 Aug 25 05:43:24.936893 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 689/1348] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:24 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:25.075086 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-cfcf96ed-ee0a-4fed-b5ec-84fec2a0f027 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:25.075906 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-cfcf96ed-ee0a-4fed-b5ec-84fec2a0f027 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:25.081875 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cfcf96ed-ee0a-4fed-b5ec-84fec2a0f027 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:25.082317 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cfcf96ed-ee0a-4fed-b5ec-84fec2a0f027 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:25.083078 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cfcf96ed-ee0a-4fed-b5ec-84fec2a0f027 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:25.083506 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cfcf96ed-ee0a-4fed-b5ec-84fec2a0f027 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:25.117678 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-cfcf96ed-ee0a-4fed-b5ec-84fec2a0f027 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045613 Aug 25 05:43:25.118152 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 660/1349] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:25 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:25.953249 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-db2e3baa-4da3-4ec6-975b-0880e117676a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:25.953874 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-db2e3baa-4da3-4ec6-975b-0880e117676a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:25.959639 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-db2e3baa-4da3-4ec6-975b-0880e117676a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:25.960073 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-db2e3baa-4da3-4ec6-975b-0880e117676a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:25.960815 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-db2e3baa-4da3-4ec6-975b-0880e117676a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:25.961239 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-db2e3baa-4da3-4ec6-975b-0880e117676a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:26.081086 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-db2e3baa-4da3-4ec6-975b-0880e117676a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:26.089446 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-db2e3baa-4da3-4ec6-975b-0880e117676a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.139821 Aug 25 05:43:26.090039 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 690/1350] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:25 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:43:26.128195 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-913a14fc-987b-43c9-83b8-5537ac94139d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:26.129094 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-913a14fc-987b-43c9-83b8-5537ac94139d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:26.135685 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-913a14fc-987b-43c9-83b8-5537ac94139d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:26.136120 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-913a14fc-987b-43c9-83b8-5537ac94139d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:26.136963 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-913a14fc-987b-43c9-83b8-5537ac94139d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:26.137321 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-913a14fc-987b-43c9-83b8-5537ac94139d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:26.165874 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-913a14fc-987b-43c9-83b8-5537ac94139d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041324 Aug 25 05:43:26.166433 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 661/1351] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:26 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:27.106556 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-17e7b1b5-9526-49d5-a8b4-f3acb30b55bc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:27.107141 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-17e7b1b5-9526-49d5-a8b4-f3acb30b55bc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:27.113186 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-17e7b1b5-9526-49d5-a8b4-f3acb30b55bc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:27.113666 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-17e7b1b5-9526-49d5-a8b4-f3acb30b55bc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:27.114417 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-17e7b1b5-9526-49d5-a8b4-f3acb30b55bc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:27.114837 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-17e7b1b5-9526-49d5-a8b4-f3acb30b55bc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:27.176317 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-56f7d423-36a9-4e6c-a06d-790b5826a7b0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:27.177224 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-56f7d423-36a9-4e6c-a06d-790b5826a7b0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:27.183106 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-56f7d423-36a9-4e6c-a06d-790b5826a7b0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:27.183558 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-56f7d423-36a9-4e6c-a06d-790b5826a7b0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:27.184325 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-56f7d423-36a9-4e6c-a06d-790b5826a7b0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:27.184751 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-56f7d423-36a9-4e6c-a06d-790b5826a7b0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:27.215644 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-56f7d423-36a9-4e6c-a06d-790b5826a7b0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043068 Aug 25 05:43:27.216222 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 662/1352] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:27 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:43:27.242786 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-17e7b1b5-9526-49d5-a8b4-f3acb30b55bc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:27.250470 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-17e7b1b5-9526-49d5-a8b4-f3acb30b55bc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.147609 Aug 25 05:43:27.251076 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 691/1353] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:27 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:28.226993 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-faf2df2e-db3e-46c9-b4ce-19750d03df93 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:28.228604 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-faf2df2e-db3e-46c9-b4ce-19750d03df93 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:28.234453 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-faf2df2e-db3e-46c9-b4ce-19750d03df93 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:28.234891 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-faf2df2e-db3e-46c9-b4ce-19750d03df93 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:28.235644 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-faf2df2e-db3e-46c9-b4ce-19750d03df93 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:28.236069 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-faf2df2e-db3e-46c9-b4ce-19750d03df93 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:28.265141 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-faf2df2e-db3e-46c9-b4ce-19750d03df93 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041829 Aug 25 05:43:28.265722 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 663/1354] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:28 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:28.268319 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-de70b944-f1e6-4192-bf3a-3f2c421225e6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:28.268931 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-de70b944-f1e6-4192-bf3a-3f2c421225e6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:28.276268 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-de70b944-f1e6-4192-bf3a-3f2c421225e6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:28.276851 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-de70b944-f1e6-4192-bf3a-3f2c421225e6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:28.277644 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-de70b944-f1e6-4192-bf3a-3f2c421225e6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:28.278120 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-de70b944-f1e6-4192-bf3a-3f2c421225e6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:28.401902 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-de70b944-f1e6-4192-bf3a-3f2c421225e6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:28.409083 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-de70b944-f1e6-4192-bf3a-3f2c421225e6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.144727 Aug 25 05:43:28.409671 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 692/1355] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:28 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:43:29.277790 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-70967f81-4863-4b79-b9b7-16279265c5ed tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:29.278643 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-70967f81-4863-4b79-b9b7-16279265c5ed tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:29.284572 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-70967f81-4863-4b79-b9b7-16279265c5ed tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:29.285016 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-70967f81-4863-4b79-b9b7-16279265c5ed tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:29.285806 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-70967f81-4863-4b79-b9b7-16279265c5ed tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:29.286238 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-70967f81-4863-4b79-b9b7-16279265c5ed tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:29.315437 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-70967f81-4863-4b79-b9b7-16279265c5ed tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042626 Aug 25 05:43:29.315996 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 664/1356] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:29 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:29.425840 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6a725c25-af95-4815-8f8c-076491a7f8f0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:29.426438 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6a725c25-af95-4815-8f8c-076491a7f8f0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:29.432455 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6a725c25-af95-4815-8f8c-076491a7f8f0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:29.432889 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6a725c25-af95-4815-8f8c-076491a7f8f0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:29.433700 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6a725c25-af95-4815-8f8c-076491a7f8f0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:29.434127 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6a725c25-af95-4815-8f8c-076491a7f8f0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:29.561048 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-6a725c25-af95-4815-8f8c-076491a7f8f0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:29.568269 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6a725c25-af95-4815-8f8c-076491a7f8f0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.146329 Aug 25 05:43:29.572012 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 693/1357] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:29 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:30.327004 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6748d553-1d2a-4201-ae65-ce0f8ee2ed1c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:30.327998 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6748d553-1d2a-4201-ae65-ce0f8ee2ed1c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:30.334072 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6748d553-1d2a-4201-ae65-ce0f8ee2ed1c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:30.334514 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6748d553-1d2a-4201-ae65-ce0f8ee2ed1c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:30.335312 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6748d553-1d2a-4201-ae65-ce0f8ee2ed1c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:30.335730 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6748d553-1d2a-4201-ae65-ce0f8ee2ed1c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:30.365354 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6748d553-1d2a-4201-ae65-ce0f8ee2ed1c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042123 Aug 25 05:43:30.365925 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 665/1358] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:30 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:30.585677 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-46398e1a-2cf0-4e8e-b12f-b19f8d62c35f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:30.586286 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-46398e1a-2cf0-4e8e-b12f-b19f8d62c35f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:30.592526 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-46398e1a-2cf0-4e8e-b12f-b19f8d62c35f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:30.592967 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-46398e1a-2cf0-4e8e-b12f-b19f8d62c35f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:30.593779 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-46398e1a-2cf0-4e8e-b12f-b19f8d62c35f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:30.594210 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-46398e1a-2cf0-4e8e-b12f-b19f8d62c35f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:30.716951 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-46398e1a-2cf0-4e8e-b12f-b19f8d62c35f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:30.724212 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-46398e1a-2cf0-4e8e-b12f-b19f8d62c35f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.142068 Aug 25 05:43:30.724766 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 694/1359] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:30 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:31.377380 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a6781e69-6568-4100-a643-efe0a2a2a78f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:31.378352 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a6781e69-6568-4100-a643-efe0a2a2a78f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:31.385816 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a6781e69-6568-4100-a643-efe0a2a2a78f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:31.386205 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a6781e69-6568-4100-a643-efe0a2a2a78f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:31.387342 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a6781e69-6568-4100-a643-efe0a2a2a78f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:31.387456 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a6781e69-6568-4100-a643-efe0a2a2a78f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:31.417578 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a6781e69-6568-4100-a643-efe0a2a2a78f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043789 Aug 25 05:43:31.418136 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 666/1360] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:31 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:31.741627 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c8d2ba67-f9a6-44fe-aba4-08beafe17eea tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:31.742232 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c8d2ba67-f9a6-44fe-aba4-08beafe17eea tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:31.748762 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c8d2ba67-f9a6-44fe-aba4-08beafe17eea tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:31.749205 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c8d2ba67-f9a6-44fe-aba4-08beafe17eea tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:31.750032 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c8d2ba67-f9a6-44fe-aba4-08beafe17eea tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:31.750464 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c8d2ba67-f9a6-44fe-aba4-08beafe17eea tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:31.870857 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-c8d2ba67-f9a6-44fe-aba4-08beafe17eea tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:31.878134 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c8d2ba67-f9a6-44fe-aba4-08beafe17eea tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.140185 Aug 25 05:43:31.879362 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 695/1361] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:31 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:32.429123 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d41b9fdf-1cbc-4c48-842b-ad5a4970a4df tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:32.430054 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-d41b9fdf-1cbc-4c48-842b-ad5a4970a4df tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:32.436229 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d41b9fdf-1cbc-4c48-842b-ad5a4970a4df tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:32.436672 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d41b9fdf-1cbc-4c48-842b-ad5a4970a4df tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:32.437427 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d41b9fdf-1cbc-4c48-842b-ad5a4970a4df tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:32.437883 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d41b9fdf-1cbc-4c48-842b-ad5a4970a4df tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:32.467351 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d41b9fdf-1cbc-4c48-842b-ad5a4970a4df tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041953 Aug 25 05:43:32.467901 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 667/1362] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:32 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:32.895675 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1ae1359c-371e-4880-a094-2e496a25f08e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:32.896272 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1ae1359c-371e-4880-a094-2e496a25f08e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:32.902634 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1ae1359c-371e-4880-a094-2e496a25f08e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:32.903066 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1ae1359c-371e-4880-a094-2e496a25f08e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:32.903817 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1ae1359c-371e-4880-a094-2e496a25f08e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:32.904241 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1ae1359c-371e-4880-a094-2e496a25f08e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:33.031446 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-1ae1359c-371e-4880-a094-2e496a25f08e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:33.038976 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1ae1359c-371e-4880-a094-2e496a25f08e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.146932 Aug 25 05:43:33.039533 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 696/1363] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:32 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:33.479205 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7c3329c3-20e1-47fa-8a7c-098551937912 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:33.480120 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7c3329c3-20e1-47fa-8a7c-098551937912 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:33.486976 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7c3329c3-20e1-47fa-8a7c-098551937912 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:33.487568 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7c3329c3-20e1-47fa-8a7c-098551937912 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:33.488318 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7c3329c3-20e1-47fa-8a7c-098551937912 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:33.488749 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7c3329c3-20e1-47fa-8a7c-098551937912 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:33.518402 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7c3329c3-20e1-47fa-8a7c-098551937912 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043635 Aug 25 05:43:33.518976 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 668/1364] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:33 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:34.055813 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-15578ca4-d799-4205-b116-2b5f618b9df2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:34.056603 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-15578ca4-d799-4205-b116-2b5f618b9df2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:34.063274 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-15578ca4-d799-4205-b116-2b5f618b9df2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:34.063711 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-15578ca4-d799-4205-b116-2b5f618b9df2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:34.064462 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-15578ca4-d799-4205-b116-2b5f618b9df2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:34.064886 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-15578ca4-d799-4205-b116-2b5f618b9df2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:34.190053 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-15578ca4-d799-4205-b116-2b5f618b9df2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:34.198528 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-15578ca4-d799-4205-b116-2b5f618b9df2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.146286 Aug 25 05:43:34.199094 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 697/1365] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:34 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:34.531305 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b2586dcd-658a-4215-80b5-2ea6c0ef3e6f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:34.532230 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b2586dcd-658a-4215-80b5-2ea6c0ef3e6f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:34.538214 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b2586dcd-658a-4215-80b5-2ea6c0ef3e6f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:34.538794 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b2586dcd-658a-4215-80b5-2ea6c0ef3e6f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:34.539571 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b2586dcd-658a-4215-80b5-2ea6c0ef3e6f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:34.539980 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b2586dcd-658a-4215-80b5-2ea6c0ef3e6f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:34.569430 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b2586dcd-658a-4215-80b5-2ea6c0ef3e6f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041888 Aug 25 05:43:34.570033 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 669/1366] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:34 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:35.216280 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9aa03dbc-2ec6-4b02-9af8-f939d772ba57 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:35.216863 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9aa03dbc-2ec6-4b02-9af8-f939d772ba57 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:35.222930 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9aa03dbc-2ec6-4b02-9af8-f939d772ba57 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:35.223556 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9aa03dbc-2ec6-4b02-9af8-f939d772ba57 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:35.225191 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9aa03dbc-2ec6-4b02-9af8-f939d772ba57 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:35.225655 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9aa03dbc-2ec6-4b02-9af8-f939d772ba57 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:35.372237 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-9aa03dbc-2ec6-4b02-9af8-f939d772ba57 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:35.379720 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9aa03dbc-2ec6-4b02-9af8-f939d772ba57 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.168211 Aug 25 05:43:35.380302 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 698/1367] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:35 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:35.583177 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-0556c203-d0d2-4dcd-a393-e8a19ec4c499 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:35.584085 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-0556c203-d0d2-4dcd-a393-e8a19ec4c499 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:35.590451 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0556c203-d0d2-4dcd-a393-e8a19ec4c499 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:35.590894 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0556c203-d0d2-4dcd-a393-e8a19ec4c499 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:35.591655 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0556c203-d0d2-4dcd-a393-e8a19ec4c499 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:35.592085 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0556c203-d0d2-4dcd-a393-e8a19ec4c499 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:35.621176 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-0556c203-d0d2-4dcd-a393-e8a19ec4c499 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041597 Aug 25 05:43:35.621809 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 670/1368] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:35 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:43:36.397765 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-74edfaa4-23b5-4358-8d63-fc598a8a5d34 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:36.398358 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-74edfaa4-23b5-4358-8d63-fc598a8a5d34 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:36.404603 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-74edfaa4-23b5-4358-8d63-fc598a8a5d34 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:36.405046 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-74edfaa4-23b5-4358-8d63-fc598a8a5d34 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:36.405839 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-74edfaa4-23b5-4358-8d63-fc598a8a5d34 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:36.406269 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-74edfaa4-23b5-4358-8d63-fc598a8a5d34 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:36.526933 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-74edfaa4-23b5-4358-8d63-fc598a8a5d34 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:36.537514 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-74edfaa4-23b5-4358-8d63-fc598a8a5d34 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.143337 Aug 25 05:43:36.538128 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 699/1369] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:36 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:36.634682 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-dc34e2e9-51c3-4de8-86f1-e84a748f5f19 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:36.635576 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-dc34e2e9-51c3-4de8-86f1-e84a748f5f19 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:36.641427 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dc34e2e9-51c3-4de8-86f1-e84a748f5f19 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:36.641896 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dc34e2e9-51c3-4de8-86f1-e84a748f5f19 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:36.642657 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dc34e2e9-51c3-4de8-86f1-e84a748f5f19 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:36.643083 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dc34e2e9-51c3-4de8-86f1-e84a748f5f19 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:36.672105 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-dc34e2e9-51c3-4de8-86f1-e84a748f5f19 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041581 Aug 25 05:43:36.672569 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 671/1370] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:36 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:37.556236 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-8f784c22-cf32-42e2-8ad1-5ae984ec798b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:37.556847 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-8f784c22-cf32-42e2-8ad1-5ae984ec798b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:37.562783 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8f784c22-cf32-42e2-8ad1-5ae984ec798b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:37.563227 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8f784c22-cf32-42e2-8ad1-5ae984ec798b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:37.563983 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8f784c22-cf32-42e2-8ad1-5ae984ec798b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:37.564408 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8f784c22-cf32-42e2-8ad1-5ae984ec798b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:37.684114 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-4bf362e9-f3df-4050-ac15-c9a617312c6d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:37.685172 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-4bf362e9-f3df-4050-ac15-c9a617312c6d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:37.691267 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4bf362e9-f3df-4050-ac15-c9a617312c6d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:37.691711 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4bf362e9-f3df-4050-ac15-c9a617312c6d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:37.692485 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4bf362e9-f3df-4050-ac15-c9a617312c6d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:37.692929 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4bf362e9-f3df-4050-ac15-c9a617312c6d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:37.701626 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-8f784c22-cf32-42e2-8ad1-5ae984ec798b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:37.708959 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-8f784c22-cf32-42e2-8ad1-5ae984ec798b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.157158 Aug 25 05:43:37.709548 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 700/1371] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:37 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:37.723504 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-4bf362e9-f3df-4050-ac15-c9a617312c6d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043859 Aug 25 05:43:37.724162 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 672/1372] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:37 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:43:38.726758 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-faf2c752-8f43-476a-ad35-0f1ac3ad35a8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:38.727560 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-faf2c752-8f43-476a-ad35-0f1ac3ad35a8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:38.734378 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-faf2c752-8f43-476a-ad35-0f1ac3ad35a8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:38.734939 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-faf2c752-8f43-476a-ad35-0f1ac3ad35a8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:38.735298 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-df9a8fb5-2667-4311-bcb1-531053187397 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:38.736328 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-faf2c752-8f43-476a-ad35-0f1ac3ad35a8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:38.736547 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-df9a8fb5-2667-4311-bcb1-531053187397 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:38.736898 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-faf2c752-8f43-476a-ad35-0f1ac3ad35a8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:38.742170 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-df9a8fb5-2667-4311-bcb1-531053187397 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:38.742621 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-df9a8fb5-2667-4311-bcb1-531053187397 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:38.743925 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-df9a8fb5-2667-4311-bcb1-531053187397 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:38.744355 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-df9a8fb5-2667-4311-bcb1-531053187397 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:38.774299 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-df9a8fb5-2667-4311-bcb1-531053187397 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043035 Aug 25 05:43:38.775152 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 673/1373] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:38 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:38.863629 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-faf2c752-8f43-476a-ad35-0f1ac3ad35a8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:38.871598 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-faf2c752-8f43-476a-ad35-0f1ac3ad35a8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.148537 Aug 25 05:43:38.872156 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 701/1374] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:38 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:39.784937 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-bad7a07a-193d-4f24-9451-d8855818ec97 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:39.785859 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-bad7a07a-193d-4f24-9451-d8855818ec97 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:39.791785 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bad7a07a-193d-4f24-9451-d8855818ec97 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:39.792224 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bad7a07a-193d-4f24-9451-d8855818ec97 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:39.792977 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bad7a07a-193d-4f24-9451-d8855818ec97 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:39.793402 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bad7a07a-193d-4f24-9451-d8855818ec97 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:39.823859 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-bad7a07a-193d-4f24-9451-d8855818ec97 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042600 Aug 25 05:43:39.824413 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 674/1375] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:39 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:39.888550 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ed59ff98-32a7-412e-95cb-40b859691aa1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:39.889150 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ed59ff98-32a7-412e-95cb-40b859691aa1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:39.894901 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ed59ff98-32a7-412e-95cb-40b859691aa1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:39.895340 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ed59ff98-32a7-412e-95cb-40b859691aa1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:39.896101 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ed59ff98-32a7-412e-95cb-40b859691aa1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:39.896526 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ed59ff98-32a7-412e-95cb-40b859691aa1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:40.031095 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ed59ff98-32a7-412e-95cb-40b859691aa1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:40.038840 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ed59ff98-32a7-412e-95cb-40b859691aa1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.153790 Aug 25 05:43:40.039386 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 702/1376] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:39 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:40.835021 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-cd883bc3-fcb7-43ff-9d2a-45ea1fbd17a8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:40.835837 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-cd883bc3-fcb7-43ff-9d2a-45ea1fbd17a8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:40.843465 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cd883bc3-fcb7-43ff-9d2a-45ea1fbd17a8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:40.843904 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cd883bc3-fcb7-43ff-9d2a-45ea1fbd17a8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:40.844660 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cd883bc3-fcb7-43ff-9d2a-45ea1fbd17a8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:40.845085 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cd883bc3-fcb7-43ff-9d2a-45ea1fbd17a8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:40.875967 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-cd883bc3-fcb7-43ff-9d2a-45ea1fbd17a8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044785 Aug 25 05:43:40.876523 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 675/1377] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:40 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:41.055844 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-dcaf0514-2bf3-48bc-b61a-dff2daf91fb2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:41.056486 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-dcaf0514-2bf3-48bc-b61a-dff2daf91fb2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:41.062295 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-dcaf0514-2bf3-48bc-b61a-dff2daf91fb2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:41.062736 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-dcaf0514-2bf3-48bc-b61a-dff2daf91fb2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:41.063545 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-dcaf0514-2bf3-48bc-b61a-dff2daf91fb2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:41.063975 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-dcaf0514-2bf3-48bc-b61a-dff2daf91fb2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:41.198799 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-dcaf0514-2bf3-48bc-b61a-dff2daf91fb2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:41.203124 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-dcaf0514-2bf3-48bc-b61a-dff2daf91fb2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.151368 Aug 25 05:43:41.203806 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 703/1378] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:41 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:41.887254 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-f9f82622-0108-46d9-ba88-51f4f5bfe527 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:41.888178 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-f9f82622-0108-46d9-ba88-51f4f5bfe527 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:41.893902 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f9f82622-0108-46d9-ba88-51f4f5bfe527 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:41.894342 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f9f82622-0108-46d9-ba88-51f4f5bfe527 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:41.895091 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f9f82622-0108-46d9-ba88-51f4f5bfe527 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:41.895512 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f9f82622-0108-46d9-ba88-51f4f5bfe527 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:41.924616 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-f9f82622-0108-46d9-ba88-51f4f5bfe527 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041062 Aug 25 05:43:41.925159 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 676/1379] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:41 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:42.221593 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d600c743-3e83-46cc-bb54-1ddc241435fb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:42.222204 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d600c743-3e83-46cc-bb54-1ddc241435fb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:42.236692 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d600c743-3e83-46cc-bb54-1ddc241435fb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:42.237231 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d600c743-3e83-46cc-bb54-1ddc241435fb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:42.237937 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d600c743-3e83-46cc-bb54-1ddc241435fb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:42.238363 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d600c743-3e83-46cc-bb54-1ddc241435fb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:42.361552 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d600c743-3e83-46cc-bb54-1ddc241435fb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:42.368919 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d600c743-3e83-46cc-bb54-1ddc241435fb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.151311 Aug 25 05:43:42.369542 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 704/1380] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:42 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:42.936948 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-cc51c784-5eb8-4b1d-9003-d2c44450136e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:42.937801 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-cc51c784-5eb8-4b1d-9003-d2c44450136e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:42.943643 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cc51c784-5eb8-4b1d-9003-d2c44450136e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:42.944086 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cc51c784-5eb8-4b1d-9003-d2c44450136e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:42.944852 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cc51c784-5eb8-4b1d-9003-d2c44450136e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:42.945282 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cc51c784-5eb8-4b1d-9003-d2c44450136e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:42.973949 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-cc51c784-5eb8-4b1d-9003-d2c44450136e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041726 Aug 25 05:43:42.974493 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 677/1381] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:42 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:43.386481 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-4e85276a-ba66-446b-b2e2-31baee6710bf tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:43.387079 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-4e85276a-ba66-446b-b2e2-31baee6710bf tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:43.392869 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4e85276a-ba66-446b-b2e2-31baee6710bf tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:43.393307 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4e85276a-ba66-446b-b2e2-31baee6710bf tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:43.394096 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4e85276a-ba66-446b-b2e2-31baee6710bf tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:43.394520 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4e85276a-ba66-446b-b2e2-31baee6710bf tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:43.518554 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-4e85276a-ba66-446b-b2e2-31baee6710bf tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:43.527003 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-4e85276a-ba66-446b-b2e2-31baee6710bf tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.143523 Aug 25 05:43:43.527760 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 705/1382] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:43 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:43:43.984730 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-73110f51-1898-4170-aac8-4978d3114c0e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:43.985655 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-73110f51-1898-4170-aac8-4978d3114c0e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:43.991416 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-73110f51-1898-4170-aac8-4978d3114c0e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:43.991850 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-73110f51-1898-4170-aac8-4978d3114c0e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:43.992641 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-73110f51-1898-4170-aac8-4978d3114c0e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:43.993038 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-73110f51-1898-4170-aac8-4978d3114c0e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:44.022074 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-73110f51-1898-4170-aac8-4978d3114c0e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041048 Aug 25 05:43:44.028951 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 678/1383] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:43 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:44.543700 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b3475d43-4a28-4306-90d2-989d7aea64ae tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:44.544327 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b3475d43-4a28-4306-90d2-989d7aea64ae tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:44.550776 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b3475d43-4a28-4306-90d2-989d7aea64ae tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:44.551165 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b3475d43-4a28-4306-90d2-989d7aea64ae tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:44.551920 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b3475d43-4a28-4306-90d2-989d7aea64ae tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:44.552350 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b3475d43-4a28-4306-90d2-989d7aea64ae tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:44.678955 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-b3475d43-4a28-4306-90d2-989d7aea64ae tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:44.687931 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b3475d43-4a28-4306-90d2-989d7aea64ae tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.147875 Aug 25 05:43:44.688498 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 706/1384] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:44 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:45.034765 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-adaad955-9eba-4cdd-a158-ecd96995eda9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:45.035693 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-adaad955-9eba-4cdd-a158-ecd96995eda9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:45.041685 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-adaad955-9eba-4cdd-a158-ecd96995eda9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:45.042123 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-adaad955-9eba-4cdd-a158-ecd96995eda9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:45.042877 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-adaad955-9eba-4cdd-a158-ecd96995eda9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:45.043303 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-adaad955-9eba-4cdd-a158-ecd96995eda9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:45.073658 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-adaad955-9eba-4cdd-a158-ecd96995eda9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042604 Aug 25 05:43:45.074200 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 679/1385] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:45 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:45.705316 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-52be181f-03a0-4aa9-a5ca-c9125ac6d036 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:45.705902 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-52be181f-03a0-4aa9-a5ca-c9125ac6d036 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:45.711777 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-52be181f-03a0-4aa9-a5ca-c9125ac6d036 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:45.712219 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-52be181f-03a0-4aa9-a5ca-c9125ac6d036 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:45.713027 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-52be181f-03a0-4aa9-a5ca-c9125ac6d036 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:45.713454 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-52be181f-03a0-4aa9-a5ca-c9125ac6d036 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:45.836603 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-52be181f-03a0-4aa9-a5ca-c9125ac6d036 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:45.844060 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-52be181f-03a0-4aa9-a5ca-c9125ac6d036 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.143718 Aug 25 05:43:45.844617 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 707/1386] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:45 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:46.085911 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-942a0231-a256-4811-bb14-9fb9a06ca916 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:46.086833 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-942a0231-a256-4811-bb14-9fb9a06ca916 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:46.093115 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-942a0231-a256-4811-bb14-9fb9a06ca916 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:46.093575 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-942a0231-a256-4811-bb14-9fb9a06ca916 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:46.094339 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-942a0231-a256-4811-bb14-9fb9a06ca916 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:46.094764 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-942a0231-a256-4811-bb14-9fb9a06ca916 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:46.124284 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-942a0231-a256-4811-bb14-9fb9a06ca916 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042228 Aug 25 05:43:46.124840 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 680/1387] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:46 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:46.861771 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d49ffaab-7553-4e0b-9aa9-441aa6e31c3b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:46.862405 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d49ffaab-7553-4e0b-9aa9-441aa6e31c3b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:46.868186 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d49ffaab-7553-4e0b-9aa9-441aa6e31c3b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:46.868627 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d49ffaab-7553-4e0b-9aa9-441aa6e31c3b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:46.869376 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d49ffaab-7553-4e0b-9aa9-441aa6e31c3b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:46.869835 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d49ffaab-7553-4e0b-9aa9-441aa6e31c3b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:46.989734 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d49ffaab-7553-4e0b-9aa9-441aa6e31c3b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:46.997109 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d49ffaab-7553-4e0b-9aa9-441aa6e31c3b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.139731 Aug 25 05:43:46.997705 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 708/1388] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:46 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:47.135741 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7956c238-20b7-4037-864a-122915cd4556 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:47.136557 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7956c238-20b7-4037-864a-122915cd4556 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:47.142403 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7956c238-20b7-4037-864a-122915cd4556 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:47.142837 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7956c238-20b7-4037-864a-122915cd4556 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:47.143626 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7956c238-20b7-4037-864a-122915cd4556 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:47.144050 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7956c238-20b7-4037-864a-122915cd4556 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:47.173347 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7956c238-20b7-4037-864a-122915cd4556 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041451 Aug 25 05:43:47.173918 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 681/1389] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:47 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:48.015025 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-872651f2-f2dd-42c5-add9-69c2e3905893 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:48.016237 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-872651f2-f2dd-42c5-add9-69c2e3905893 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:48.022131 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-872651f2-f2dd-42c5-add9-69c2e3905893 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:48.022576 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-872651f2-f2dd-42c5-add9-69c2e3905893 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:48.023338 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-872651f2-f2dd-42c5-add9-69c2e3905893 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:48.023842 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-872651f2-f2dd-42c5-add9-69c2e3905893 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:48.151425 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-872651f2-f2dd-42c5-add9-69c2e3905893 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:48.158622 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-872651f2-f2dd-42c5-add9-69c2e3905893 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.147791 Aug 25 05:43:48.159183 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 709/1390] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:48 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:48.184024 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-9fb0cbf6-d288-4860-ac60-13c034f06451 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:48.184970 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-9fb0cbf6-d288-4860-ac60-13c034f06451 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:48.191877 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9fb0cbf6-d288-4860-ac60-13c034f06451 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:48.192325 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9fb0cbf6-d288-4860-ac60-13c034f06451 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:48.193091 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9fb0cbf6-d288-4860-ac60-13c034f06451 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:48.193541 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9fb0cbf6-d288-4860-ac60-13c034f06451 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:48.221856 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-9fb0cbf6-d288-4860-ac60-13c034f06451 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041461 Aug 25 05:43:48.222410 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 682/1391] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:48 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:49.175632 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-011c5531-f5dc-4d12-890c-3adc4776f1a8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:49.176223 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-011c5531-f5dc-4d12-890c-3adc4776f1a8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:49.182156 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-011c5531-f5dc-4d12-890c-3adc4776f1a8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:49.182590 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-011c5531-f5dc-4d12-890c-3adc4776f1a8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:49.183418 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-011c5531-f5dc-4d12-890c-3adc4776f1a8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:49.183843 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-011c5531-f5dc-4d12-890c-3adc4776f1a8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:49.233313 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-adfa5b91-61ca-4a16-ae1e-18adf42068c7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:49.234350 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-adfa5b91-61ca-4a16-ae1e-18adf42068c7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:49.240747 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-adfa5b91-61ca-4a16-ae1e-18adf42068c7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:49.241193 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-adfa5b91-61ca-4a16-ae1e-18adf42068c7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:49.241992 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-adfa5b91-61ca-4a16-ae1e-18adf42068c7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:49.242421 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-adfa5b91-61ca-4a16-ae1e-18adf42068c7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:49.274026 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-adfa5b91-61ca-4a16-ae1e-18adf42068c7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044392 Aug 25 05:43:49.274885 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 683/1392] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:49 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:43:49.307583 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-011c5531-f5dc-4d12-890c-3adc4776f1a8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:49.315461 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-011c5531-f5dc-4d12-890c-3adc4776f1a8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.143536 Aug 25 05:43:49.316026 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 710/1393] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:49 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:50.284755 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-f3f7d50b-5b08-495e-b5b9-064bc3dc39cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:50.285766 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-f3f7d50b-5b08-495e-b5b9-064bc3dc39cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:50.292225 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f3f7d50b-5b08-495e-b5b9-064bc3dc39cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:50.292665 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f3f7d50b-5b08-495e-b5b9-064bc3dc39cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:50.293444 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f3f7d50b-5b08-495e-b5b9-064bc3dc39cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:50.293895 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f3f7d50b-5b08-495e-b5b9-064bc3dc39cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:50.322868 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-f3f7d50b-5b08-495e-b5b9-064bc3dc39cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041914 Aug 25 05:43:50.323418 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 684/1394] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:50 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:50.332469 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5182285f-ab0d-480b-a72d-81042946ee85 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:50.333076 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5182285f-ab0d-480b-a72d-81042946ee85 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:50.338870 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5182285f-ab0d-480b-a72d-81042946ee85 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:50.339320 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5182285f-ab0d-480b-a72d-81042946ee85 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:50.340071 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5182285f-ab0d-480b-a72d-81042946ee85 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:50.340498 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5182285f-ab0d-480b-a72d-81042946ee85 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:50.463555 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-5182285f-ab0d-480b-a72d-81042946ee85 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:50.471668 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5182285f-ab0d-480b-a72d-81042946ee85 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.142963 Aug 25 05:43:50.472231 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 711/1395] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:50 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:43:51.334601 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-cee5624a-1c55-4971-9ee1-aca81c7134b2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:51.335588 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-cee5624a-1c55-4971-9ee1-aca81c7134b2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:51.341454 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cee5624a-1c55-4971-9ee1-aca81c7134b2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:51.341981 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cee5624a-1c55-4971-9ee1-aca81c7134b2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:51.342747 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cee5624a-1c55-4971-9ee1-aca81c7134b2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:51.343738 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cee5624a-1c55-4971-9ee1-aca81c7134b2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:51.374066 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-cee5624a-1c55-4971-9ee1-aca81c7134b2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043354 Aug 25 05:43:51.374726 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 685/1396] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:51 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:51.489059 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-150a2dd9-f871-4f40-a4bc-7c143cdc25f4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:51.489689 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-150a2dd9-f871-4f40-a4bc-7c143cdc25f4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:51.495832 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-150a2dd9-f871-4f40-a4bc-7c143cdc25f4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:51.495932 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-150a2dd9-f871-4f40-a4bc-7c143cdc25f4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:51.497273 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-150a2dd9-f871-4f40-a4bc-7c143cdc25f4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:51.497273 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-150a2dd9-f871-4f40-a4bc-7c143cdc25f4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:51.622117 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-150a2dd9-f871-4f40-a4bc-7c143cdc25f4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:51.629857 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-150a2dd9-f871-4f40-a4bc-7c143cdc25f4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.144431 Aug 25 05:43:51.630416 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 712/1397] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:51 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:52.385768 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7adf1d9a-509e-4cd0-ab27-45a14627f453 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:52.386712 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7adf1d9a-509e-4cd0-ab27-45a14627f453 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:52.393206 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7adf1d9a-509e-4cd0-ab27-45a14627f453 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:52.393668 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7adf1d9a-509e-4cd0-ab27-45a14627f453 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:52.394424 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7adf1d9a-509e-4cd0-ab27-45a14627f453 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:52.394848 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7adf1d9a-509e-4cd0-ab27-45a14627f453 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:52.423645 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7adf1d9a-509e-4cd0-ab27-45a14627f453 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041600 Aug 25 05:43:52.425059 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 686/1398] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:52 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:52.647234 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6ec38a22-6c24-4715-a85b-1d4627560942 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:52.647766 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6ec38a22-6c24-4715-a85b-1d4627560942 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:52.653725 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6ec38a22-6c24-4715-a85b-1d4627560942 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:52.654163 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6ec38a22-6c24-4715-a85b-1d4627560942 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:52.654914 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6ec38a22-6c24-4715-a85b-1d4627560942 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:52.655337 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6ec38a22-6c24-4715-a85b-1d4627560942 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:52.780358 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-6ec38a22-6c24-4715-a85b-1d4627560942 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:52.789616 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6ec38a22-6c24-4715-a85b-1d4627560942 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.146251 Aug 25 05:43:52.790487 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 713/1399] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:52 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:53.434915 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-91c96e08-3a52-4f06-9587-5cd13f052eaa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:53.435811 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-91c96e08-3a52-4f06-9587-5cd13f052eaa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:53.445895 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-91c96e08-3a52-4f06-9587-5cd13f052eaa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:53.446339 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-91c96e08-3a52-4f06-9587-5cd13f052eaa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:53.447104 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-91c96e08-3a52-4f06-9587-5cd13f052eaa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:53.447531 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-91c96e08-3a52-4f06-9587-5cd13f052eaa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:53.476976 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-91c96e08-3a52-4f06-9587-5cd13f052eaa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045621 Aug 25 05:43:53.477518 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 687/1400] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:53 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:53.806690 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-83e0bb43-9e97-435e-a2bb-60b8b1e347d1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:53.807279 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-83e0bb43-9e97-435e-a2bb-60b8b1e347d1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:53.813853 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-83e0bb43-9e97-435e-a2bb-60b8b1e347d1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:53.814297 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-83e0bb43-9e97-435e-a2bb-60b8b1e347d1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:53.815080 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-83e0bb43-9e97-435e-a2bb-60b8b1e347d1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:53.815508 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-83e0bb43-9e97-435e-a2bb-60b8b1e347d1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:53.945400 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-83e0bb43-9e97-435e-a2bb-60b8b1e347d1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:53.953883 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-83e0bb43-9e97-435e-a2bb-60b8b1e347d1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.151082 Aug 25 05:43:53.954511 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 714/1401] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:53 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:54.488718 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-11a2abd6-5d8f-46a0-8e28-3fb1da7130b8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:54.489550 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-11a2abd6-5d8f-46a0-8e28-3fb1da7130b8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:54.495576 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-11a2abd6-5d8f-46a0-8e28-3fb1da7130b8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:54.496165 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-11a2abd6-5d8f-46a0-8e28-3fb1da7130b8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:54.496940 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-11a2abd6-5d8f-46a0-8e28-3fb1da7130b8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:54.497490 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-11a2abd6-5d8f-46a0-8e28-3fb1da7130b8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:54.529795 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-11a2abd6-5d8f-46a0-8e28-3fb1da7130b8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044802 Aug 25 05:43:54.530365 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 688/1402] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:54 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:54.970608 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-596fee3d-5b9d-47d7-b9ff-2275b73e08e8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:54.971208 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-596fee3d-5b9d-47d7-b9ff-2275b73e08e8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:54.976972 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-596fee3d-5b9d-47d7-b9ff-2275b73e08e8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:54.977408 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-596fee3d-5b9d-47d7-b9ff-2275b73e08e8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:54.978192 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-596fee3d-5b9d-47d7-b9ff-2275b73e08e8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:54.978612 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-596fee3d-5b9d-47d7-b9ff-2275b73e08e8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:55.112408 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-596fee3d-5b9d-47d7-b9ff-2275b73e08e8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:55.120561 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-596fee3d-5b9d-47d7-b9ff-2275b73e08e8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.153654 Aug 25 05:43:55.121149 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 715/1403] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:54 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:55.541893 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5549c1cb-7fc0-4aca-b298-289670aae011 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:55.543422 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5549c1cb-7fc0-4aca-b298-289670aae011 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:55.552153 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5549c1cb-7fc0-4aca-b298-289670aae011 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:55.552594 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5549c1cb-7fc0-4aca-b298-289670aae011 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:55.553362 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5549c1cb-7fc0-4aca-b298-289670aae011 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:55.553817 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5549c1cb-7fc0-4aca-b298-289670aae011 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:55.585388 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5549c1cb-7fc0-4aca-b298-289670aae011 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047630 Aug 25 05:43:55.585969 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 689/1404] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:55 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:56.137348 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-cf8d4a36-c350-421a-9c60-31709ba5e122 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:56.137961 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-cf8d4a36-c350-421a-9c60-31709ba5e122 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:56.144447 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cf8d4a36-c350-421a-9c60-31709ba5e122 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:56.144884 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cf8d4a36-c350-421a-9c60-31709ba5e122 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:56.145719 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cf8d4a36-c350-421a-9c60-31709ba5e122 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:56.146145 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cf8d4a36-c350-421a-9c60-31709ba5e122 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:56.269334 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-cf8d4a36-c350-421a-9c60-31709ba5e122 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:56.276966 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-cf8d4a36-c350-421a-9c60-31709ba5e122 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.143202 Aug 25 05:43:56.277551 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 716/1405] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:56 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:56.597287 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ead77cd8-7446-45e8-872e-6078d20d7e06 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:56.598222 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ead77cd8-7446-45e8-872e-6078d20d7e06 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:56.604200 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ead77cd8-7446-45e8-872e-6078d20d7e06 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:56.604648 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ead77cd8-7446-45e8-872e-6078d20d7e06 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:56.605409 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ead77cd8-7446-45e8-872e-6078d20d7e06 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:56.605875 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ead77cd8-7446-45e8-872e-6078d20d7e06 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:56.634807 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ead77cd8-7446-45e8-872e-6078d20d7e06 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041889 Aug 25 05:43:56.635353 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 690/1406] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:56 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:57.293620 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9614c0ac-c721-4ddb-a8d6-075b38f15c8e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:57.294224 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9614c0ac-c721-4ddb-a8d6-075b38f15c8e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:57.300236 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9614c0ac-c721-4ddb-a8d6-075b38f15c8e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:57.300678 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9614c0ac-c721-4ddb-a8d6-075b38f15c8e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:57.301429 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9614c0ac-c721-4ddb-a8d6-075b38f15c8e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:57.301883 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9614c0ac-c721-4ddb-a8d6-075b38f15c8e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:57.420601 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-9614c0ac-c721-4ddb-a8d6-075b38f15c8e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:57.427995 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9614c0ac-c721-4ddb-a8d6-075b38f15c8e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.137992 Aug 25 05:43:57.428545 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 717/1407] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:57 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:57.646083 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-005919be-f9ec-4170-9c90-ef22dbf5e121 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:57.646915 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-005919be-f9ec-4170-9c90-ef22dbf5e121 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:57.652944 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-005919be-f9ec-4170-9c90-ef22dbf5e121 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:57.653386 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-005919be-f9ec-4170-9c90-ef22dbf5e121 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:57.654184 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-005919be-f9ec-4170-9c90-ef22dbf5e121 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:57.654619 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-005919be-f9ec-4170-9c90-ef22dbf5e121 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:57.683517 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-005919be-f9ec-4170-9c90-ef22dbf5e121 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041223 Aug 25 05:43:57.684059 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 691/1408] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:57 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:58.445262 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-8457806b-0f28-46cb-a474-d001e015c70a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:58.445889 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-8457806b-0f28-46cb-a474-d001e015c70a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:58.451810 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8457806b-0f28-46cb-a474-d001e015c70a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:58.452618 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8457806b-0f28-46cb-a474-d001e015c70a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:58.453390 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8457806b-0f28-46cb-a474-d001e015c70a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:58.454008 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8457806b-0f28-46cb-a474-d001e015c70a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:58.580064 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-8457806b-0f28-46cb-a474-d001e015c70a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:58.587624 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-8457806b-0f28-46cb-a474-d001e015c70a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.146078 Aug 25 05:43:58.588184 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 718/1409] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:58 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:58.694987 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-97a2c0e1-a2c0-4dc6-829f-e695c8425236 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:58.695936 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-97a2c0e1-a2c0-4dc6-829f-e695c8425236 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:58.701673 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-97a2c0e1-a2c0-4dc6-829f-e695c8425236 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:58.702111 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-97a2c0e1-a2c0-4dc6-829f-e695c8425236 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:58.702860 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-97a2c0e1-a2c0-4dc6-829f-e695c8425236 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:58.703283 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-97a2c0e1-a2c0-4dc6-829f-e695c8425236 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:58.732910 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-97a2c0e1-a2c0-4dc6-829f-e695c8425236 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041648 Aug 25 05:43:58.733456 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 692/1410] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:58 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:43:59.604228 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-29a2e69a-7309-4aa9-9ae4-7fc0d43cc66b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:59.604808 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-29a2e69a-7309-4aa9-9ae4-7fc0d43cc66b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:59.611276 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-29a2e69a-7309-4aa9-9ae4-7fc0d43cc66b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:59.611710 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-29a2e69a-7309-4aa9-9ae4-7fc0d43cc66b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:59.612459 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-29a2e69a-7309-4aa9-9ae4-7fc0d43cc66b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:59.612882 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-29a2e69a-7309-4aa9-9ae4-7fc0d43cc66b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:59.732378 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-29a2e69a-7309-4aa9-9ae4-7fc0d43cc66b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:43:59.740676 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-29a2e69a-7309-4aa9-9ae4-7fc0d43cc66b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.140103 Aug 25 05:43:59.741227 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 719/1411] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:43:59 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:43:59.744244 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c8a23196-1ebc-4a58-b212-cb4f7bb98322 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:43:59.745151 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c8a23196-1ebc-4a58-b212-cb4f7bb98322 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:43:59.751110 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c8a23196-1ebc-4a58-b212-cb4f7bb98322 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:59.751488 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c8a23196-1ebc-4a58-b212-cb4f7bb98322 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:59.752244 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c8a23196-1ebc-4a58-b212-cb4f7bb98322 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:43:59.752667 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c8a23196-1ebc-4a58-b212-cb4f7bb98322 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:43:59.781177 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c8a23196-1ebc-4a58-b212-cb4f7bb98322 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040890 Aug 25 05:43:59.782284 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 693/1412] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:43:59 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:44:00.757499 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-aebacf48-f4f0-4a33-800e-6676b02859ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:00.758109 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-aebacf48-f4f0-4a33-800e-6676b02859ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:00.763947 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-aebacf48-f4f0-4a33-800e-6676b02859ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:00.764388 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-aebacf48-f4f0-4a33-800e-6676b02859ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:00.765142 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-aebacf48-f4f0-4a33-800e-6676b02859ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:00.765600 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-aebacf48-f4f0-4a33-800e-6676b02859ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:00.792388 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-caca98a7-1951-48f9-8210-e970342db18e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:00.793208 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-caca98a7-1951-48f9-8210-e970342db18e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:00.799903 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-caca98a7-1951-48f9-8210-e970342db18e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:00.800340 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-caca98a7-1951-48f9-8210-e970342db18e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:00.801097 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-caca98a7-1951-48f9-8210-e970342db18e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:00.801537 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-caca98a7-1951-48f9-8210-e970342db18e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:00.831327 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-caca98a7-1951-48f9-8210-e970342db18e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042625 Aug 25 05:44:00.831900 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 694/1413] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:00 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:44:00.890478 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-aebacf48-f4f0-4a33-800e-6676b02859ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:00.898190 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-aebacf48-f4f0-4a33-800e-6676b02859ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.144312 Aug 25 05:44:00.898746 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 720/1414] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:00 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:01.842735 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-aaf4beb0-52d7-466c-a3ef-1270318eff1c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:01.843641 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-aaf4beb0-52d7-466c-a3ef-1270318eff1c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:01.849441 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-aaf4beb0-52d7-466c-a3ef-1270318eff1c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:01.849912 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-aaf4beb0-52d7-466c-a3ef-1270318eff1c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:01.850671 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-aaf4beb0-52d7-466c-a3ef-1270318eff1c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:01.851101 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-aaf4beb0-52d7-466c-a3ef-1270318eff1c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:01.879765 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-aaf4beb0-52d7-466c-a3ef-1270318eff1c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040787 Aug 25 05:44:01.880329 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 695/1415] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:01 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:01.915215 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-42fde8a2-5b21-43af-aac5-ddaec8359eb8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:01.915824 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-42fde8a2-5b21-43af-aac5-ddaec8359eb8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:01.921481 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-42fde8a2-5b21-43af-aac5-ddaec8359eb8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:01.921959 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-42fde8a2-5b21-43af-aac5-ddaec8359eb8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:01.922954 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-42fde8a2-5b21-43af-aac5-ddaec8359eb8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:01.923501 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-42fde8a2-5b21-43af-aac5-ddaec8359eb8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:02.052197 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-42fde8a2-5b21-43af-aac5-ddaec8359eb8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:02.059474 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-42fde8a2-5b21-43af-aac5-ddaec8359eb8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.147995 Aug 25 05:44:02.060029 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 721/1416] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:01 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:02.891343 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e2f3431a-24bd-4683-8ba2-2285662c6425 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:02.895139 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e2f3431a-24bd-4683-8ba2-2285662c6425 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:02.898434 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e2f3431a-24bd-4683-8ba2-2285662c6425 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:02.898875 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e2f3431a-24bd-4683-8ba2-2285662c6425 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:02.899900 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e2f3431a-24bd-4683-8ba2-2285662c6425 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:02.900331 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e2f3431a-24bd-4683-8ba2-2285662c6425 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:02.933847 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e2f3431a-24bd-4683-8ba2-2285662c6425 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046271 Aug 25 05:44:02.934423 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 696/1417] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:02 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:03.076021 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ba3800a0-e969-4b20-a0ff-f5ba775356a4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:03.076789 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ba3800a0-e969-4b20-a0ff-f5ba775356a4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:03.083623 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ba3800a0-e969-4b20-a0ff-f5ba775356a4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:03.084057 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ba3800a0-e969-4b20-a0ff-f5ba775356a4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:03.084822 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ba3800a0-e969-4b20-a0ff-f5ba775356a4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:03.085248 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ba3800a0-e969-4b20-a0ff-f5ba775356a4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:03.208384 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ba3800a0-e969-4b20-a0ff-f5ba775356a4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:03.216209 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ba3800a0-e969-4b20-a0ff-f5ba775356a4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.143787 Aug 25 05:44:03.216778 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 722/1418] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:03 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:03.945576 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5d87dee1-3694-4e9e-9470-da6d95e92e53 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:03.946486 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5d87dee1-3694-4e9e-9470-da6d95e92e53 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:03.952231 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5d87dee1-3694-4e9e-9470-da6d95e92e53 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:03.955110 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5d87dee1-3694-4e9e-9470-da6d95e92e53 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:03.955110 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5d87dee1-3694-4e9e-9470-da6d95e92e53 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:03.955110 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5d87dee1-3694-4e9e-9470-da6d95e92e53 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:03.982836 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5d87dee1-3694-4e9e-9470-da6d95e92e53 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041099 Aug 25 05:44:03.983410 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 697/1419] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:03 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:04.246831 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-07cb66ab-c358-446d-8ee4-64b20458f0e3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:04.247344 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-07cb66ab-c358-446d-8ee4-64b20458f0e3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:04.253888 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-07cb66ab-c358-446d-8ee4-64b20458f0e3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:04.254327 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-07cb66ab-c358-446d-8ee4-64b20458f0e3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:04.255075 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-07cb66ab-c358-446d-8ee4-64b20458f0e3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:04.255494 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-07cb66ab-c358-446d-8ee4-64b20458f0e3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:04.374243 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-07cb66ab-c358-446d-8ee4-64b20458f0e3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:04.381820 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-07cb66ab-c358-446d-8ee4-64b20458f0e3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.138617 Aug 25 05:44:04.382386 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 723/1420] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:04 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:04.994155 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6c28db95-a18b-47df-8dd6-a6522cc661d8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:04.995081 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6c28db95-a18b-47df-8dd6-a6522cc661d8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:05.000827 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6c28db95-a18b-47df-8dd6-a6522cc661d8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:05.001262 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6c28db95-a18b-47df-8dd6-a6522cc661d8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:05.002051 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6c28db95-a18b-47df-8dd6-a6522cc661d8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:05.002481 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6c28db95-a18b-47df-8dd6-a6522cc661d8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:05.030171 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6c28db95-a18b-47df-8dd6-a6522cc661d8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039696 Aug 25 05:44:05.030680 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 698/1421] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:04 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:05.398942 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-92adf5ed-fbd6-46ab-bd87-34cc7ca71bcb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:05.399801 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-92adf5ed-fbd6-46ab-bd87-34cc7ca71bcb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:05.405594 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-92adf5ed-fbd6-46ab-bd87-34cc7ca71bcb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:05.406044 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-92adf5ed-fbd6-46ab-bd87-34cc7ca71bcb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:05.407266 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-92adf5ed-fbd6-46ab-bd87-34cc7ca71bcb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:05.407469 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-92adf5ed-fbd6-46ab-bd87-34cc7ca71bcb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:05.534092 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-92adf5ed-fbd6-46ab-bd87-34cc7ca71bcb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:05.541346 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-92adf5ed-fbd6-46ab-bd87-34cc7ca71bcb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.146115 Aug 25 05:44:05.541948 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 724/1422] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:05 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:06.042195 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-18985c4c-1f14-45b7-a50d-8f6f95a44cb2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:06.043093 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-18985c4c-1f14-45b7-a50d-8f6f95a44cb2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:06.049482 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-18985c4c-1f14-45b7-a50d-8f6f95a44cb2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:06.049947 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-18985c4c-1f14-45b7-a50d-8f6f95a44cb2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:06.050690 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-18985c4c-1f14-45b7-a50d-8f6f95a44cb2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:06.051114 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-18985c4c-1f14-45b7-a50d-8f6f95a44cb2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:06.079365 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-18985c4c-1f14-45b7-a50d-8f6f95a44cb2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041113 Aug 25 05:44:06.079898 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 699/1423] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:06 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:06.557425 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-8118705f-b2d0-467b-a8ec-3b4aed3ceadc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:06.558060 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-8118705f-b2d0-467b-a8ec-3b4aed3ceadc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:06.564417 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8118705f-b2d0-467b-a8ec-3b4aed3ceadc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:06.564862 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8118705f-b2d0-467b-a8ec-3b4aed3ceadc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:06.565679 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8118705f-b2d0-467b-a8ec-3b4aed3ceadc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:06.566111 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8118705f-b2d0-467b-a8ec-3b4aed3ceadc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:06.705111 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-8118705f-b2d0-467b-a8ec-3b4aed3ceadc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:06.712343 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-8118705f-b2d0-467b-a8ec-3b4aed3ceadc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.158540 Aug 25 05:44:06.712931 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 725/1424] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:06 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:07.090282 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-44d30836-5c4d-4fee-93e3-409d6d50528f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:07.091181 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-44d30836-5c4d-4fee-93e3-409d6d50528f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:07.097092 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-44d30836-5c4d-4fee-93e3-409d6d50528f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:07.097552 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-44d30836-5c4d-4fee-93e3-409d6d50528f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:07.098309 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-44d30836-5c4d-4fee-93e3-409d6d50528f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:07.098758 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-44d30836-5c4d-4fee-93e3-409d6d50528f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:07.126670 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-44d30836-5c4d-4fee-93e3-409d6d50528f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040143 Aug 25 05:44:07.127209 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 700/1425] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:07 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:07.729829 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e84fbdcd-d3c1-4e46-b2ee-80714d08e510 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:07.730430 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e84fbdcd-d3c1-4e46-b2ee-80714d08e510 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:07.737185 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e84fbdcd-d3c1-4e46-b2ee-80714d08e510 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:07.737665 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e84fbdcd-d3c1-4e46-b2ee-80714d08e510 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:07.738416 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e84fbdcd-d3c1-4e46-b2ee-80714d08e510 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:07.738842 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e84fbdcd-d3c1-4e46-b2ee-80714d08e510 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:07.856932 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-e84fbdcd-d3c1-4e46-b2ee-80714d08e510 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:07.864660 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e84fbdcd-d3c1-4e46-b2ee-80714d08e510 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.138403 Aug 25 05:44:07.865212 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 726/1426] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:07 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:44:08.137981 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-516afc70-b09f-4adb-a2c2-16cb9a3d1e1d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:08.138794 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-516afc70-b09f-4adb-a2c2-16cb9a3d1e1d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:08.145193 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-516afc70-b09f-4adb-a2c2-16cb9a3d1e1d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:08.145656 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-516afc70-b09f-4adb-a2c2-16cb9a3d1e1d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:08.146406 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-516afc70-b09f-4adb-a2c2-16cb9a3d1e1d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:08.146829 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-516afc70-b09f-4adb-a2c2-16cb9a3d1e1d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:08.175319 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-516afc70-b09f-4adb-a2c2-16cb9a3d1e1d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041116 Aug 25 05:44:08.175852 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 701/1427] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:08 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:08.881642 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f90a6041-9114-4837-a3bc-6bba744c8599 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:08.882183 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f90a6041-9114-4837-a3bc-6bba744c8599 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:08.888139 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f90a6041-9114-4837-a3bc-6bba744c8599 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:08.888587 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f90a6041-9114-4837-a3bc-6bba744c8599 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:08.889378 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f90a6041-9114-4837-a3bc-6bba744c8599 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:08.889835 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f90a6041-9114-4837-a3bc-6bba744c8599 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:09.014413 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-f90a6041-9114-4837-a3bc-6bba744c8599 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:09.021873 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f90a6041-9114-4837-a3bc-6bba744c8599 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.143950 Aug 25 05:44:09.022432 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 727/1428] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:08 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:09.186740 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-41cae853-d5c7-40f5-984b-3fa9b9e0936e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:09.187556 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-41cae853-d5c7-40f5-984b-3fa9b9e0936e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:09.194064 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-41cae853-d5c7-40f5-984b-3fa9b9e0936e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:09.194504 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-41cae853-d5c7-40f5-984b-3fa9b9e0936e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:09.195257 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-41cae853-d5c7-40f5-984b-3fa9b9e0936e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:09.195680 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-41cae853-d5c7-40f5-984b-3fa9b9e0936e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:09.226502 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-41cae853-d5c7-40f5-984b-3fa9b9e0936e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043483 Aug 25 05:44:09.227064 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 702/1429] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:09 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:10.039661 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7cfef799-5cac-48b4-8f3c-0e95e7a3995e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:10.040229 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-7cfef799-5cac-48b4-8f3c-0e95e7a3995e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:10.046042 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7cfef799-5cac-48b4-8f3c-0e95e7a3995e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:10.046484 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7cfef799-5cac-48b4-8f3c-0e95e7a3995e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:10.047238 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7cfef799-5cac-48b4-8f3c-0e95e7a3995e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:10.047668 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7cfef799-5cac-48b4-8f3c-0e95e7a3995e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:10.166700 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-7cfef799-5cac-48b4-8f3c-0e95e7a3995e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:10.173825 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-7cfef799-5cac-48b4-8f3c-0e95e7a3995e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.137880 Aug 25 05:44:10.174404 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 728/1430] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:10 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:10.238047 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-9fb86663-8ae5-46f4-a4a1-8735321ac038 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:10.238960 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-9fb86663-8ae5-46f4-a4a1-8735321ac038 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:10.244627 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9fb86663-8ae5-46f4-a4a1-8735321ac038 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:10.245065 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9fb86663-8ae5-46f4-a4a1-8735321ac038 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:10.245860 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9fb86663-8ae5-46f4-a4a1-8735321ac038 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:10.246294 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9fb86663-8ae5-46f4-a4a1-8735321ac038 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:10.276487 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-9fb86663-8ae5-46f4-a4a1-8735321ac038 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042547 Aug 25 05:44:10.277012 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 703/1431] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:10 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:11.190930 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-4958afc5-9eca-4eca-ab84-e2e763da8f79 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:11.191647 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-4958afc5-9eca-4eca-ab84-e2e763da8f79 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:11.197414 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4958afc5-9eca-4eca-ab84-e2e763da8f79 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:11.197944 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4958afc5-9eca-4eca-ab84-e2e763da8f79 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:11.202812 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4958afc5-9eca-4eca-ab84-e2e763da8f79 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:11.202812 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4958afc5-9eca-4eca-ab84-e2e763da8f79 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:11.289064 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8c5eb704-ac5a-4174-827d-68b20850d073 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:11.289999 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8c5eb704-ac5a-4174-827d-68b20850d073 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:11.296333 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8c5eb704-ac5a-4174-827d-68b20850d073 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:11.296782 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8c5eb704-ac5a-4174-827d-68b20850d073 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:11.297574 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8c5eb704-ac5a-4174-827d-68b20850d073 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:11.298017 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8c5eb704-ac5a-4174-827d-68b20850d073 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:11.328585 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8c5eb704-ac5a-4174-827d-68b20850d073 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044404 Aug 25 05:44:11.328760 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-4958afc5-9eca-4eca-ab84-e2e763da8f79 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:11.329153 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 704/1432] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:11 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:44:11.336549 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-4958afc5-9eca-4eca-ab84-e2e763da8f79 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.149328 Aug 25 05:44:11.337093 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 729/1433] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:11 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:12.340455 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-56461e41-df04-4f59-8b59-2c93e5d20e62 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:12.341359 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-56461e41-df04-4f59-8b59-2c93e5d20e62 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:12.347716 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-56461e41-df04-4f59-8b59-2c93e5d20e62 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:12.348457 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-56461e41-df04-4f59-8b59-2c93e5d20e62 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:12.349862 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-56461e41-df04-4f59-8b59-2c93e5d20e62 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:12.350390 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-56461e41-df04-4f59-8b59-2c93e5d20e62 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:12.353740 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-42ef17b4-8fbf-45dc-93bd-08e3c8cd9388 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:12.354340 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-42ef17b4-8fbf-45dc-93bd-08e3c8cd9388 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:12.359963 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-42ef17b4-8fbf-45dc-93bd-08e3c8cd9388 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:12.360399 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-42ef17b4-8fbf-45dc-93bd-08e3c8cd9388 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:12.361153 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-42ef17b4-8fbf-45dc-93bd-08e3c8cd9388 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:12.361601 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-42ef17b4-8fbf-45dc-93bd-08e3c8cd9388 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:12.381032 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-56461e41-df04-4f59-8b59-2c93e5d20e62 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044293 Aug 25 05:44:12.381811 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 705/1434] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:12 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:12.490680 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-42ef17b4-8fbf-45dc-93bd-08e3c8cd9388 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:12.498008 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-42ef17b4-8fbf-45dc-93bd-08e3c8cd9388 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.147963 Aug 25 05:44:12.498567 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 730/1435] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:12 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:44:13.392458 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e870b8fe-2f1c-4d9d-a2c9-c2cb334e005e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:13.393368 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e870b8fe-2f1c-4d9d-a2c9-c2cb334e005e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:13.399566 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e870b8fe-2f1c-4d9d-a2c9-c2cb334e005e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:13.400013 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e870b8fe-2f1c-4d9d-a2c9-c2cb334e005e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:13.400774 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e870b8fe-2f1c-4d9d-a2c9-c2cb334e005e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:13.401207 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e870b8fe-2f1c-4d9d-a2c9-c2cb334e005e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:13.430203 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e870b8fe-2f1c-4d9d-a2c9-c2cb334e005e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041717 Aug 25 05:44:13.430748 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 706/1436] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:13 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:13.515218 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9e60f817-fdac-4ca4-86bf-635180acb8fb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:13.516009 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9e60f817-fdac-4ca4-86bf-635180acb8fb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:13.521961 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9e60f817-fdac-4ca4-86bf-635180acb8fb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:13.523929 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9e60f817-fdac-4ca4-86bf-635180acb8fb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:13.523929 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9e60f817-fdac-4ca4-86bf-635180acb8fb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:13.523929 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9e60f817-fdac-4ca4-86bf-635180acb8fb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:13.648780 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-9e60f817-fdac-4ca4-86bf-635180acb8fb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:13.656283 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9e60f817-fdac-4ca4-86bf-635180acb8fb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.145687 Aug 25 05:44:13.658543 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 731/1437] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:13 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:14.441674 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-179f394f-c5ae-4863-ad85-b94d3cdc7a97 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:14.442569 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-179f394f-c5ae-4863-ad85-b94d3cdc7a97 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:14.448264 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-179f394f-c5ae-4863-ad85-b94d3cdc7a97 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:14.448697 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-179f394f-c5ae-4863-ad85-b94d3cdc7a97 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:14.449474 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-179f394f-c5ae-4863-ad85-b94d3cdc7a97 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:14.449920 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-179f394f-c5ae-4863-ad85-b94d3cdc7a97 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:14.478195 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-179f394f-c5ae-4863-ad85-b94d3cdc7a97 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040343 Aug 25 05:44:14.478728 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 707/1438] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:14 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:14.673380 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-4b039904-9fb6-466d-9d02-89dbd64d641f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:14.674007 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-4b039904-9fb6-466d-9d02-89dbd64d641f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:14.680338 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4b039904-9fb6-466d-9d02-89dbd64d641f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:14.680775 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4b039904-9fb6-466d-9d02-89dbd64d641f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:14.681536 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4b039904-9fb6-466d-9d02-89dbd64d641f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:14.681962 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4b039904-9fb6-466d-9d02-89dbd64d641f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:14.804630 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-4b039904-9fb6-466d-9d02-89dbd64d641f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:14.811957 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-4b039904-9fb6-466d-9d02-89dbd64d641f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.142016 Aug 25 05:44:14.812358 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 732/1439] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:14 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:15.489680 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-dcf87b77-f4f5-4b73-8286-5d46138cd9f8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:15.490484 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-dcf87b77-f4f5-4b73-8286-5d46138cd9f8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:15.497196 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dcf87b77-f4f5-4b73-8286-5d46138cd9f8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:15.497664 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dcf87b77-f4f5-4b73-8286-5d46138cd9f8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:15.498442 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dcf87b77-f4f5-4b73-8286-5d46138cd9f8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:15.498871 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dcf87b77-f4f5-4b73-8286-5d46138cd9f8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:15.533188 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-dcf87b77-f4f5-4b73-8286-5d46138cd9f8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047306 Aug 25 05:44:15.533789 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 708/1440] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:15 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:15.819209 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 05:44:15.819484 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: Wed Aug 25 05:44:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 05:44:15.828108 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2233e3a0-c64f-4fb0-825c-10abee28f366 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:15.828715 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2233e3a0-c64f-4fb0-825c-10abee28f366 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:15.835508 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2233e3a0-c64f-4fb0-825c-10abee28f366 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:15.835947 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2233e3a0-c64f-4fb0-825c-10abee28f366 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:15.836737 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2233e3a0-c64f-4fb0-825c-10abee28f366 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:15.837158 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2233e3a0-c64f-4fb0-825c-10abee28f366 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:15.970127 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-2233e3a0-c64f-4fb0-825c-10abee28f366 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:15.978200 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2233e3a0-c64f-4fb0-825c-10abee28f366 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.153706 Aug 25 05:44:15.978758 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 733/1441] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:15 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:16.544261 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c8dee31e-a5bd-4eaa-8d6c-5a415596992e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:16.545205 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c8dee31e-a5bd-4eaa-8d6c-5a415596992e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:16.551133 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c8dee31e-a5bd-4eaa-8d6c-5a415596992e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:16.551573 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c8dee31e-a5bd-4eaa-8d6c-5a415596992e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:16.552335 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c8dee31e-a5bd-4eaa-8d6c-5a415596992e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:16.552760 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c8dee31e-a5bd-4eaa-8d6c-5a415596992e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:16.581410 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c8dee31e-a5bd-4eaa-8d6c-5a415596992e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040857 Aug 25 05:44:16.582797 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 709/1442] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:16 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:16.994959 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-642eb644-8352-45f7-8219-2aa6dfa6ba37 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:16.995511 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-642eb644-8352-45f7-8219-2aa6dfa6ba37 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:17.001308 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-642eb644-8352-45f7-8219-2aa6dfa6ba37 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:17.001793 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-642eb644-8352-45f7-8219-2aa6dfa6ba37 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:17.002553 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-642eb644-8352-45f7-8219-2aa6dfa6ba37 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:17.003000 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-642eb644-8352-45f7-8219-2aa6dfa6ba37 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:17.129500 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-642eb644-8352-45f7-8219-2aa6dfa6ba37 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:17.136814 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-642eb644-8352-45f7-8219-2aa6dfa6ba37 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.145700 Aug 25 05:44:17.137371 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 734/1443] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:16 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:17.593054 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ce57ecf1-0776-4be5-8f37-97d5b10c9515 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:17.594000 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ce57ecf1-0776-4be5-8f37-97d5b10c9515 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:17.599923 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ce57ecf1-0776-4be5-8f37-97d5b10c9515 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:17.600376 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ce57ecf1-0776-4be5-8f37-97d5b10c9515 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:17.601134 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ce57ecf1-0776-4be5-8f37-97d5b10c9515 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:17.601600 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ce57ecf1-0776-4be5-8f37-97d5b10c9515 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:17.629901 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ce57ecf1-0776-4be5-8f37-97d5b10c9515 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040527 Aug 25 05:44:17.630439 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 710/1444] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:17 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:18.153734 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7c4df599-3037-4992-b323-99b8594e4657 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:18.154166 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-7c4df599-3037-4992-b323-99b8594e4657 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:18.159792 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7c4df599-3037-4992-b323-99b8594e4657 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:18.160961 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7c4df599-3037-4992-b323-99b8594e4657 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:18.161761 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7c4df599-3037-4992-b323-99b8594e4657 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:18.162195 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7c4df599-3037-4992-b323-99b8594e4657 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:18.283064 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-7c4df599-3037-4992-b323-99b8594e4657 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:18.290255 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-7c4df599-3037-4992-b323-99b8594e4657 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.140370 Aug 25 05:44:18.290878 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 735/1445] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:18 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:18.642346 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-60b781fd-acbb-42ca-a889-4b8452e9afa9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:18.643534 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-60b781fd-acbb-42ca-a889-4b8452e9afa9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:18.653389 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-60b781fd-acbb-42ca-a889-4b8452e9afa9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:18.653856 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-60b781fd-acbb-42ca-a889-4b8452e9afa9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:18.654645 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-60b781fd-acbb-42ca-a889-4b8452e9afa9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:18.655056 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-60b781fd-acbb-42ca-a889-4b8452e9afa9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:18.683952 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-60b781fd-acbb-42ca-a889-4b8452e9afa9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046457 Aug 25 05:44:18.684493 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 711/1446] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:18 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:19.308231 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f512688d-1107-468c-a54e-ded7bf758728 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:19.308836 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f512688d-1107-468c-a54e-ded7bf758728 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:19.314719 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f512688d-1107-468c-a54e-ded7bf758728 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:19.315159 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f512688d-1107-468c-a54e-ded7bf758728 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:19.315918 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f512688d-1107-468c-a54e-ded7bf758728 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:19.316753 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f512688d-1107-468c-a54e-ded7bf758728 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:19.448061 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-f512688d-1107-468c-a54e-ded7bf758728 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:19.455281 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f512688d-1107-468c-a54e-ded7bf758728 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.150773 Aug 25 05:44:19.455841 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 736/1447] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:19 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:19.696359 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a5bcac0a-d45b-432c-aa36-eaf92bec89bc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:19.697223 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a5bcac0a-d45b-432c-aa36-eaf92bec89bc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:19.703329 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a5bcac0a-d45b-432c-aa36-eaf92bec89bc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:19.703775 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a5bcac0a-d45b-432c-aa36-eaf92bec89bc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:19.704581 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a5bcac0a-d45b-432c-aa36-eaf92bec89bc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:19.705014 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a5bcac0a-d45b-432c-aa36-eaf92bec89bc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:19.733949 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a5bcac0a-d45b-432c-aa36-eaf92bec89bc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041862 Aug 25 05:44:19.734495 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 712/1448] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:19 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:20.472194 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-767d8407-9768-401d-bd08-b391a0d93412 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:20.473571 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-767d8407-9768-401d-bd08-b391a0d93412 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:20.479336 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-767d8407-9768-401d-bd08-b391a0d93412 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:20.479771 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-767d8407-9768-401d-bd08-b391a0d93412 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:20.480513 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-767d8407-9768-401d-bd08-b391a0d93412 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:20.480932 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-767d8407-9768-401d-bd08-b391a0d93412 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:20.602250 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-767d8407-9768-401d-bd08-b391a0d93412 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:20.609593 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-767d8407-9768-401d-bd08-b391a0d93412 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.140986 Aug 25 05:44:20.610157 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 737/1449] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:20 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:20.745178 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-79c53c3f-3910-4508-bc1d-bb55fd3e7901 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:20.746137 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-79c53c3f-3910-4508-bc1d-bb55fd3e7901 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:20.751916 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-79c53c3f-3910-4508-bc1d-bb55fd3e7901 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:20.752350 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-79c53c3f-3910-4508-bc1d-bb55fd3e7901 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:20.753095 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-79c53c3f-3910-4508-bc1d-bb55fd3e7901 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:20.753684 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-79c53c3f-3910-4508-bc1d-bb55fd3e7901 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:20.784438 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-79c53c3f-3910-4508-bc1d-bb55fd3e7901 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042987 Aug 25 05:44:20.785603 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 713/1450] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:20 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:21.627194 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9c3bdb08-f241-4e4d-bc61-63937ae5f2d1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:21.627758 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9c3bdb08-f241-4e4d-bc61-63937ae5f2d1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:21.634110 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9c3bdb08-f241-4e4d-bc61-63937ae5f2d1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:21.634552 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9c3bdb08-f241-4e4d-bc61-63937ae5f2d1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:21.635311 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9c3bdb08-f241-4e4d-bc61-63937ae5f2d1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:21.635739 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9c3bdb08-f241-4e4d-bc61-63937ae5f2d1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:21.762507 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-9c3bdb08-f241-4e4d-bc61-63937ae5f2d1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:21.770004 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9c3bdb08-f241-4e4d-bc61-63937ae5f2d1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.146490 Aug 25 05:44:21.770563 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 738/1451] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:21 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:21.795826 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-bcb6b655-9731-4299-be76-210755f99b3e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:21.796720 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-bcb6b655-9731-4299-be76-210755f99b3e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:21.803360 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bcb6b655-9731-4299-be76-210755f99b3e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:21.803789 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bcb6b655-9731-4299-be76-210755f99b3e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:21.804536 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bcb6b655-9731-4299-be76-210755f99b3e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:21.804988 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bcb6b655-9731-4299-be76-210755f99b3e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:21.832996 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-bcb6b655-9731-4299-be76-210755f99b3e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040808 Aug 25 05:44:21.833534 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 714/1452] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:21 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:22.787348 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f6037dd5-eb02-4e4c-84e1-d0032772ded9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:22.787944 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f6037dd5-eb02-4e4c-84e1-d0032772ded9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:22.793833 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f6037dd5-eb02-4e4c-84e1-d0032772ded9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:22.794308 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f6037dd5-eb02-4e4c-84e1-d0032772ded9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:22.795059 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f6037dd5-eb02-4e4c-84e1-d0032772ded9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:22.795480 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f6037dd5-eb02-4e4c-84e1-d0032772ded9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:22.844072 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6e3120d4-6b70-457f-98fe-b11a3f8637fa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:22.844968 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6e3120d4-6b70-457f-98fe-b11a3f8637fa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:22.851659 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6e3120d4-6b70-457f-98fe-b11a3f8637fa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:22.852091 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6e3120d4-6b70-457f-98fe-b11a3f8637fa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:22.852881 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6e3120d4-6b70-457f-98fe-b11a3f8637fa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:22.853307 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6e3120d4-6b70-457f-98fe-b11a3f8637fa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:22.882472 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6e3120d4-6b70-457f-98fe-b11a3f8637fa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042098 Aug 25 05:44:22.883036 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 715/1453] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:22 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:44:22.919362 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-f6037dd5-eb02-4e4c-84e1-d0032772ded9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:22.927075 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f6037dd5-eb02-4e4c-84e1-d0032772ded9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.143510 Aug 25 05:44:22.927695 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 739/1454] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:22 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:23.181601 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 05:44:23.181785 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: Wed Aug 25 05:44:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 05:44:23.893940 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a8ec8610-fc32-4f0c-b757-4a76c799b03c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:23.895376 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a8ec8610-fc32-4f0c-b757-4a76c799b03c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:23.901448 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a8ec8610-fc32-4f0c-b757-4a76c799b03c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:23.901912 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a8ec8610-fc32-4f0c-b757-4a76c799b03c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:23.902661 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a8ec8610-fc32-4f0c-b757-4a76c799b03c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:23.903083 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a8ec8610-fc32-4f0c-b757-4a76c799b03c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:23.932566 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a8ec8610-fc32-4f0c-b757-4a76c799b03c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042346 Aug 25 05:44:23.934354 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 716/1455] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:23 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:23.943936 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-05eca5c8-f8aa-41df-bf32-a3f99587275f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:23.944900 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-05eca5c8-f8aa-41df-bf32-a3f99587275f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:23.953713 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-05eca5c8-f8aa-41df-bf32-a3f99587275f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:23.957656 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-05eca5c8-f8aa-41df-bf32-a3f99587275f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:23.957656 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-05eca5c8-f8aa-41df-bf32-a3f99587275f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:23.957656 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-05eca5c8-f8aa-41df-bf32-a3f99587275f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:24.078947 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-05eca5c8-f8aa-41df-bf32-a3f99587275f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:24.086797 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-05eca5c8-f8aa-41df-bf32-a3f99587275f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.147765 Aug 25 05:44:24.087381 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 740/1456] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:23 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:24.945886 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-fa3f7b71-cf3d-4560-aa9a-9fc39579c5b0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:24.946786 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-fa3f7b71-cf3d-4560-aa9a-9fc39579c5b0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:24.952521 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fa3f7b71-cf3d-4560-aa9a-9fc39579c5b0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:24.952959 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fa3f7b71-cf3d-4560-aa9a-9fc39579c5b0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:24.953751 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fa3f7b71-cf3d-4560-aa9a-9fc39579c5b0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:24.954180 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fa3f7b71-cf3d-4560-aa9a-9fc39579c5b0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:24.983247 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-fa3f7b71-cf3d-4560-aa9a-9fc39579c5b0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042389 Aug 25 05:44:24.983795 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 717/1457] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:24 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:25.103697 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5dc7bcda-0d71-4431-8cbb-ee4ba521c2a2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:25.104299 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5dc7bcda-0d71-4431-8cbb-ee4ba521c2a2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:25.110140 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5dc7bcda-0d71-4431-8cbb-ee4ba521c2a2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:25.110580 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5dc7bcda-0d71-4431-8cbb-ee4ba521c2a2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:25.111331 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5dc7bcda-0d71-4431-8cbb-ee4ba521c2a2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:25.111758 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5dc7bcda-0d71-4431-8cbb-ee4ba521c2a2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:25.239283 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-5dc7bcda-0d71-4431-8cbb-ee4ba521c2a2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:25.246428 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5dc7bcda-0d71-4431-8cbb-ee4ba521c2a2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.146349 Aug 25 05:44:25.246987 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 741/1458] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:25 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:25.995562 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-81adc6d8-44fd-4f13-9d67-5048c0ec92c7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:25.996507 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-81adc6d8-44fd-4f13-9d67-5048c0ec92c7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:26.002515 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-81adc6d8-44fd-4f13-9d67-5048c0ec92c7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:26.002958 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-81adc6d8-44fd-4f13-9d67-5048c0ec92c7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:26.003927 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-81adc6d8-44fd-4f13-9d67-5048c0ec92c7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:26.004582 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-81adc6d8-44fd-4f13-9d67-5048c0ec92c7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:26.033507 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-81adc6d8-44fd-4f13-9d67-5048c0ec92c7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041785 Aug 25 05:44:26.034079 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 718/1459] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:25 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:26.263571 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-824230b9-e19e-4e29-ba41-cb3e65003bc6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:26.264089 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-824230b9-e19e-4e29-ba41-cb3e65003bc6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:26.270224 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-824230b9-e19e-4e29-ba41-cb3e65003bc6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:26.270660 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-824230b9-e19e-4e29-ba41-cb3e65003bc6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:26.271415 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-824230b9-e19e-4e29-ba41-cb3e65003bc6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:26.271839 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-824230b9-e19e-4e29-ba41-cb3e65003bc6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:26.403567 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-824230b9-e19e-4e29-ba41-cb3e65003bc6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:26.411295 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-824230b9-e19e-4e29-ba41-cb3e65003bc6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.151373 Aug 25 05:44:26.411840 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 742/1460] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:26 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:44:27.045549 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-715716d1-b473-470e-8b25-7fdcff68fe10 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:27.046462 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-715716d1-b473-470e-8b25-7fdcff68fe10 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:27.052628 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-715716d1-b473-470e-8b25-7fdcff68fe10 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:27.053070 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-715716d1-b473-470e-8b25-7fdcff68fe10 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:27.053868 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-715716d1-b473-470e-8b25-7fdcff68fe10 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:27.054300 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-715716d1-b473-470e-8b25-7fdcff68fe10 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:27.083889 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-715716d1-b473-470e-8b25-7fdcff68fe10 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042093 Aug 25 05:44:27.084444 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 719/1461] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:27 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:27.428587 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-3dcd01d2-9e94-42d2-98e4-f26e2dfde3b3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:27.429134 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-3dcd01d2-9e94-42d2-98e4-f26e2dfde3b3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:27.435025 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3dcd01d2-9e94-42d2-98e4-f26e2dfde3b3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:27.435475 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3dcd01d2-9e94-42d2-98e4-f26e2dfde3b3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:27.436224 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3dcd01d2-9e94-42d2-98e4-f26e2dfde3b3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:27.436644 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3dcd01d2-9e94-42d2-98e4-f26e2dfde3b3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:27.561873 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-3dcd01d2-9e94-42d2-98e4-f26e2dfde3b3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:27.569448 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-3dcd01d2-9e94-42d2-98e4-f26e2dfde3b3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.145261 Aug 25 05:44:27.570047 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 743/1462] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:27 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:28.095439 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d6fd46c5-ec35-49b8-96ac-d48157eacc7a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:28.096348 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-d6fd46c5-ec35-49b8-96ac-d48157eacc7a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:28.102880 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d6fd46c5-ec35-49b8-96ac-d48157eacc7a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:28.103328 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d6fd46c5-ec35-49b8-96ac-d48157eacc7a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:28.104105 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d6fd46c5-ec35-49b8-96ac-d48157eacc7a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:28.104540 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d6fd46c5-ec35-49b8-96ac-d48157eacc7a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:28.132982 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d6fd46c5-ec35-49b8-96ac-d48157eacc7a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041404 Aug 25 05:44:28.133534 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 720/1463] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:28 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:28.586803 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ddf69585-4648-4b9c-b824-36f7c675a221 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:28.587449 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ddf69585-4648-4b9c-b824-36f7c675a221 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:28.593460 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ddf69585-4648-4b9c-b824-36f7c675a221 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:28.594022 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ddf69585-4648-4b9c-b824-36f7c675a221 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:28.594789 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ddf69585-4648-4b9c-b824-36f7c675a221 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:28.595224 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ddf69585-4648-4b9c-b824-36f7c675a221 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:28.720613 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ddf69585-4648-4b9c-b824-36f7c675a221 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:28.728861 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ddf69585-4648-4b9c-b824-36f7c675a221 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.145649 Aug 25 05:44:28.729454 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 744/1464] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:28 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:29.143975 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-4be654cb-4ecc-4ad2-808a-2c5e297327a4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:29.144794 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-4be654cb-4ecc-4ad2-808a-2c5e297327a4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:29.152038 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4be654cb-4ecc-4ad2-808a-2c5e297327a4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:29.152479 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4be654cb-4ecc-4ad2-808a-2c5e297327a4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:29.153244 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4be654cb-4ecc-4ad2-808a-2c5e297327a4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:29.153715 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4be654cb-4ecc-4ad2-808a-2c5e297327a4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:29.183156 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-4be654cb-4ecc-4ad2-808a-2c5e297327a4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043013 Aug 25 05:44:29.183699 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 721/1465] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:29 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:29.745815 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-28abf88c-cd08-48c9-ac2d-49f79a74b33c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:29.746403 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-28abf88c-cd08-48c9-ac2d-49f79a74b33c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:29.752179 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-28abf88c-cd08-48c9-ac2d-49f79a74b33c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:29.752641 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-28abf88c-cd08-48c9-ac2d-49f79a74b33c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:29.753934 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-28abf88c-cd08-48c9-ac2d-49f79a74b33c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:29.754553 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-28abf88c-cd08-48c9-ac2d-49f79a74b33c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:29.889123 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-28abf88c-cd08-48c9-ac2d-49f79a74b33c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:29.897258 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-28abf88c-cd08-48c9-ac2d-49f79a74b33c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.155030 Aug 25 05:44:29.897852 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 745/1466] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:29 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:30.195020 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-aa848dbf-a404-4781-bb83-7d9b9c8fd2b8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:30.195925 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-aa848dbf-a404-4781-bb83-7d9b9c8fd2b8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:30.201742 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-aa848dbf-a404-4781-bb83-7d9b9c8fd2b8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:30.202189 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-aa848dbf-a404-4781-bb83-7d9b9c8fd2b8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:30.202939 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-aa848dbf-a404-4781-bb83-7d9b9c8fd2b8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:30.203369 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-aa848dbf-a404-4781-bb83-7d9b9c8fd2b8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:30.232115 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-aa848dbf-a404-4781-bb83-7d9b9c8fd2b8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041115 Aug 25 05:44:30.232660 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 722/1467] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:30 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:30.914504 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-76ed9a4d-ee46-4d67-b04b-19ec13328e00 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:30.915098 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-76ed9a4d-ee46-4d67-b04b-19ec13328e00 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:30.920838 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-76ed9a4d-ee46-4d67-b04b-19ec13328e00 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:30.921273 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-76ed9a4d-ee46-4d67-b04b-19ec13328e00 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:30.922061 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-76ed9a4d-ee46-4d67-b04b-19ec13328e00 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:30.922485 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-76ed9a4d-ee46-4d67-b04b-19ec13328e00 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:31.050970 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-76ed9a4d-ee46-4d67-b04b-19ec13328e00 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:31.063338 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-76ed9a4d-ee46-4d67-b04b-19ec13328e00 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.152364 Aug 25 05:44:31.063894 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 746/1468] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:30 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:31.244121 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-06cdbd97-87e7-470b-ae8d-ec6d4c8e4219 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:31.244944 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-06cdbd97-87e7-470b-ae8d-ec6d4c8e4219 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:31.250728 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-06cdbd97-87e7-470b-ae8d-ec6d4c8e4219 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:31.251180 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-06cdbd97-87e7-470b-ae8d-ec6d4c8e4219 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:31.251974 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-06cdbd97-87e7-470b-ae8d-ec6d4c8e4219 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:31.252361 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-06cdbd97-87e7-470b-ae8d-ec6d4c8e4219 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:31.281450 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-06cdbd97-87e7-470b-ae8d-ec6d4c8e4219 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041116 Aug 25 05:44:31.282028 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 723/1469] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:31 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:32.080050 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-af9e802b-f5b9-49f7-afdf-5e5341cdf57e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:32.080952 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-af9e802b-f5b9-49f7-afdf-5e5341cdf57e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:32.087395 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-af9e802b-f5b9-49f7-afdf-5e5341cdf57e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:32.087843 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-af9e802b-f5b9-49f7-afdf-5e5341cdf57e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:32.088593 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-af9e802b-f5b9-49f7-afdf-5e5341cdf57e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:32.089014 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-af9e802b-f5b9-49f7-afdf-5e5341cdf57e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:32.212171 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-af9e802b-f5b9-49f7-afdf-5e5341cdf57e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:32.219999 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-af9e802b-f5b9-49f7-afdf-5e5341cdf57e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.143444 Aug 25 05:44:32.220637 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 747/1470] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:32 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:32.294306 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-92ce6b20-3c92-4648-b591-f07e7cfca52f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:32.295217 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-92ce6b20-3c92-4648-b591-f07e7cfca52f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:32.301859 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-92ce6b20-3c92-4648-b591-f07e7cfca52f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:32.302332 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-92ce6b20-3c92-4648-b591-f07e7cfca52f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:32.303142 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-92ce6b20-3c92-4648-b591-f07e7cfca52f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:32.303573 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-92ce6b20-3c92-4648-b591-f07e7cfca52f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:32.332712 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-92ce6b20-3c92-4648-b591-f07e7cfca52f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042204 Aug 25 05:44:32.333274 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 724/1471] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:32 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:33.237683 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e6de2740-845b-43dd-a2b4-4fdfdd54c2cf tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:33.239060 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e6de2740-845b-43dd-a2b4-4fdfdd54c2cf tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:33.244937 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e6de2740-845b-43dd-a2b4-4fdfdd54c2cf tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:33.245374 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e6de2740-845b-43dd-a2b4-4fdfdd54c2cf tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:33.246154 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e6de2740-845b-43dd-a2b4-4fdfdd54c2cf tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:33.246581 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e6de2740-845b-43dd-a2b4-4fdfdd54c2cf tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:33.344041 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d1e0cb1d-9344-4dd2-9fbc-bb846462f510 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:33.345652 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-d1e0cb1d-9344-4dd2-9fbc-bb846462f510 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:33.353506 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d1e0cb1d-9344-4dd2-9fbc-bb846462f510 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:33.354067 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d1e0cb1d-9344-4dd2-9fbc-bb846462f510 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:33.355142 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d1e0cb1d-9344-4dd2-9fbc-bb846462f510 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:33.355804 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d1e0cb1d-9344-4dd2-9fbc-bb846462f510 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:33.383859 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-e6de2740-845b-43dd-a2b4-4fdfdd54c2cf tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:33.392030 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d1e0cb1d-9344-4dd2-9fbc-bb846462f510 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051692 Aug 25 05:44:33.392224 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e6de2740-845b-43dd-a2b4-4fdfdd54c2cf tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.159140 Aug 25 05:44:33.401573 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 748/1472] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:33 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:33.401784 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 725/1473] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:33 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:44:34.408718 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7f0f6fc5-f80b-453f-9920-6b9ce7947a1d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:34.409308 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d5d86ea6-4184-4eb5-ba17-22d5ba9ed4f8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:34.409758 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-d5d86ea6-4184-4eb5-ba17-22d5ba9ed4f8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:34.409920 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-7f0f6fc5-f80b-453f-9920-6b9ce7947a1d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:34.415363 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d5d86ea6-4184-4eb5-ba17-22d5ba9ed4f8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:34.415531 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7f0f6fc5-f80b-453f-9920-6b9ce7947a1d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:34.415807 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d5d86ea6-4184-4eb5-ba17-22d5ba9ed4f8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:34.415998 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7f0f6fc5-f80b-453f-9920-6b9ce7947a1d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:34.416557 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d5d86ea6-4184-4eb5-ba17-22d5ba9ed4f8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:34.416673 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7f0f6fc5-f80b-453f-9920-6b9ce7947a1d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:34.416977 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7f0f6fc5-f80b-453f-9920-6b9ce7947a1d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:34.417079 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d5d86ea6-4184-4eb5-ba17-22d5ba9ed4f8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:34.446955 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-7f0f6fc5-f80b-453f-9920-6b9ce7947a1d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042061 Aug 25 05:44:34.447507 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 749/1474] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:34 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:34.540680 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-d5d86ea6-4184-4eb5-ba17-22d5ba9ed4f8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:34.547862 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d5d86ea6-4184-4eb5-ba17-22d5ba9ed4f8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.142779 Aug 25 05:44:34.548424 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 726/1475] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:34 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:44:35.458205 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a6c88d69-d37e-4797-865d-68341da9c171 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:35.459658 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a6c88d69-d37e-4797-865d-68341da9c171 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:35.465483 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a6c88d69-d37e-4797-865d-68341da9c171 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:35.465958 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a6c88d69-d37e-4797-865d-68341da9c171 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:35.466718 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a6c88d69-d37e-4797-865d-68341da9c171 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:35.467144 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a6c88d69-d37e-4797-865d-68341da9c171 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:35.503203 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a6c88d69-d37e-4797-865d-68341da9c171 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048941 Aug 25 05:44:35.504791 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 750/1476] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:35 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:35.564901 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e5ea30b9-0fae-4a99-8be9-850420fc66fa tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:35.565627 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e5ea30b9-0fae-4a99-8be9-850420fc66fa tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:35.571928 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e5ea30b9-0fae-4a99-8be9-850420fc66fa tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:35.572369 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e5ea30b9-0fae-4a99-8be9-850420fc66fa tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:35.573120 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e5ea30b9-0fae-4a99-8be9-850420fc66fa tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:35.573561 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e5ea30b9-0fae-4a99-8be9-850420fc66fa tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:35.714475 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e5ea30b9-0fae-4a99-8be9-850420fc66fa tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:35.721787 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e5ea30b9-0fae-4a99-8be9-850420fc66fa tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.160641 Aug 25 05:44:35.722418 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 727/1477] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:35 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:36.515373 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f1942f59-d0c5-4e6c-9431-fb59987b790c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:36.516191 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f1942f59-d0c5-4e6c-9431-fb59987b790c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:36.522927 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f1942f59-d0c5-4e6c-9431-fb59987b790c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:36.523361 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f1942f59-d0c5-4e6c-9431-fb59987b790c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:36.524376 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f1942f59-d0c5-4e6c-9431-fb59987b790c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:36.524801 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f1942f59-d0c5-4e6c-9431-fb59987b790c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:36.555667 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f1942f59-d0c5-4e6c-9431-fb59987b790c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044096 Aug 25 05:44:36.556209 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 751/1478] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:36 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:44:36.738776 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-60cd274d-8484-46dc-a24e-8e28aef7c319 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:36.739525 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-60cd274d-8484-46dc-a24e-8e28aef7c319 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:36.746203 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-60cd274d-8484-46dc-a24e-8e28aef7c319 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:36.746651 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-60cd274d-8484-46dc-a24e-8e28aef7c319 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:36.747419 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-60cd274d-8484-46dc-a24e-8e28aef7c319 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:36.747847 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-60cd274d-8484-46dc-a24e-8e28aef7c319 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:36.880295 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-60cd274d-8484-46dc-a24e-8e28aef7c319 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:36.887727 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-60cd274d-8484-46dc-a24e-8e28aef7c319 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.152567 Aug 25 05:44:36.888284 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 728/1479] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:36 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:37.567477 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-871388c1-0b52-4380-affa-68f5a2a05c02 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:37.568371 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-871388c1-0b52-4380-affa-68f5a2a05c02 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:37.574529 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-871388c1-0b52-4380-affa-68f5a2a05c02 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:37.574971 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-871388c1-0b52-4380-affa-68f5a2a05c02 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:37.575735 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-871388c1-0b52-4380-affa-68f5a2a05c02 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:37.576168 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-871388c1-0b52-4380-affa-68f5a2a05c02 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:37.607625 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-871388c1-0b52-4380-affa-68f5a2a05c02 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044277 Aug 25 05:44:37.608194 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 752/1480] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:37 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:37.904637 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1b795339-2b38-4042-8534-530e1169baf7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:37.905235 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1b795339-2b38-4042-8534-530e1169baf7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:37.911160 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1b795339-2b38-4042-8534-530e1169baf7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:37.911598 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1b795339-2b38-4042-8534-530e1169baf7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:37.912354 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1b795339-2b38-4042-8534-530e1169baf7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:37.912780 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1b795339-2b38-4042-8534-530e1169baf7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:38.035958 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-1b795339-2b38-4042-8534-530e1169baf7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:38.043410 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1b795339-2b38-4042-8534-530e1169baf7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.142394 Aug 25 05:44:38.043961 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 729/1481] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:37 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:38.619715 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ab820147-0c6e-4758-97ce-d6b095c6606a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:38.620612 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ab820147-0c6e-4758-97ce-d6b095c6606a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:38.626640 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ab820147-0c6e-4758-97ce-d6b095c6606a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:38.627081 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ab820147-0c6e-4758-97ce-d6b095c6606a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:38.627847 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ab820147-0c6e-4758-97ce-d6b095c6606a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:38.628518 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ab820147-0c6e-4758-97ce-d6b095c6606a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:38.657453 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ab820147-0c6e-4758-97ce-d6b095c6606a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041340 Aug 25 05:44:38.658039 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 753/1482] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:38 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:39.059977 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a837ae98-998c-4e14-9b5b-f3468cf4e30d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:39.060570 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a837ae98-998c-4e14-9b5b-f3468cf4e30d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:39.066365 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a837ae98-998c-4e14-9b5b-f3468cf4e30d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:39.066809 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a837ae98-998c-4e14-9b5b-f3468cf4e30d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:39.068118 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a837ae98-998c-4e14-9b5b-f3468cf4e30d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:39.068583 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a837ae98-998c-4e14-9b5b-f3468cf4e30d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:39.188196 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-a837ae98-998c-4e14-9b5b-f3468cf4e30d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:39.196304 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a837ae98-998c-4e14-9b5b-f3468cf4e30d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.139927 Aug 25 05:44:39.196863 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 730/1483] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:39 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:39.669470 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2564f781-62b4-411b-96e9-37712412ba96 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:39.670399 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2564f781-62b4-411b-96e9-37712412ba96 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:39.676844 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2564f781-62b4-411b-96e9-37712412ba96 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:39.677520 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2564f781-62b4-411b-96e9-37712412ba96 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:39.678304 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2564f781-62b4-411b-96e9-37712412ba96 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:39.678731 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2564f781-62b4-411b-96e9-37712412ba96 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:39.708237 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2564f781-62b4-411b-96e9-37712412ba96 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042466 Aug 25 05:44:39.708781 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 754/1484] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:39 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:40.213482 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-f1b2cf0f-55d9-4359-a867-bf3c37005d95 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:40.214132 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-f1b2cf0f-55d9-4359-a867-bf3c37005d95 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:40.219908 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f1b2cf0f-55d9-4359-a867-bf3c37005d95 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:40.220346 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f1b2cf0f-55d9-4359-a867-bf3c37005d95 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:40.221101 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f1b2cf0f-55d9-4359-a867-bf3c37005d95 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:40.221546 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f1b2cf0f-55d9-4359-a867-bf3c37005d95 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:40.352041 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-f1b2cf0f-55d9-4359-a867-bf3c37005d95 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:40.359399 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-f1b2cf0f-55d9-4359-a867-bf3c37005d95 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.149486 Aug 25 05:44:40.359958 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 731/1485] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:40 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:44:40.719812 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c08c6241-998a-447a-8822-de7a47652809 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:40.720712 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c08c6241-998a-447a-8822-de7a47652809 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:40.726550 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c08c6241-998a-447a-8822-de7a47652809 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:40.727000 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c08c6241-998a-447a-8822-de7a47652809 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:40.727765 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c08c6241-998a-447a-8822-de7a47652809 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:40.728199 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c08c6241-998a-447a-8822-de7a47652809 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:40.756993 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c08c6241-998a-447a-8822-de7a47652809 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040815 Aug 25 05:44:40.757464 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 755/1486] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:40 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:41.376064 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-46f67b8e-e168-4fe8-ab99-d45b01809edd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:41.376656 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-46f67b8e-e168-4fe8-ab99-d45b01809edd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:41.383585 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-46f67b8e-e168-4fe8-ab99-d45b01809edd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:41.384021 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-46f67b8e-e168-4fe8-ab99-d45b01809edd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:41.384807 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-46f67b8e-e168-4fe8-ab99-d45b01809edd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:41.385227 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-46f67b8e-e168-4fe8-ab99-d45b01809edd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:41.509058 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-46f67b8e-e168-4fe8-ab99-d45b01809edd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:41.516277 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-46f67b8e-e168-4fe8-ab99-d45b01809edd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.143901 Aug 25 05:44:41.516837 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 732/1487] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:41 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:41.768540 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-dc5edb53-c783-4276-a0e1-94a0883abe29 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:41.769351 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-dc5edb53-c783-4276-a0e1-94a0883abe29 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:41.775625 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-dc5edb53-c783-4276-a0e1-94a0883abe29 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:41.776068 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-dc5edb53-c783-4276-a0e1-94a0883abe29 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:41.776853 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-dc5edb53-c783-4276-a0e1-94a0883abe29 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:41.777301 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-dc5edb53-c783-4276-a0e1-94a0883abe29 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:41.806237 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-dc5edb53-c783-4276-a0e1-94a0883abe29 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041536 Aug 25 05:44:41.806783 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 756/1488] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:41 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:42.533761 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a1baca8e-06e7-4fb6-81f3-64256662a699 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:42.534368 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a1baca8e-06e7-4fb6-81f3-64256662a699 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:42.540910 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a1baca8e-06e7-4fb6-81f3-64256662a699 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:42.541349 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a1baca8e-06e7-4fb6-81f3-64256662a699 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:42.542161 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a1baca8e-06e7-4fb6-81f3-64256662a699 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:42.542584 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a1baca8e-06e7-4fb6-81f3-64256662a699 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:42.664021 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-a1baca8e-06e7-4fb6-81f3-64256662a699 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:42.670446 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a1baca8e-06e7-4fb6-81f3-64256662a699 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.140358 Aug 25 05:44:42.671009 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 733/1489] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:42 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:42.817797 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-39c1a1bb-de94-4cca-89b5-5838a6ec0941 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:42.818700 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-39c1a1bb-de94-4cca-89b5-5838a6ec0941 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:42.824615 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-39c1a1bb-de94-4cca-89b5-5838a6ec0941 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:42.825053 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-39c1a1bb-de94-4cca-89b5-5838a6ec0941 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:42.825846 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-39c1a1bb-de94-4cca-89b5-5838a6ec0941 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:42.826276 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-39c1a1bb-de94-4cca-89b5-5838a6ec0941 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:42.855284 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-39c1a1bb-de94-4cca-89b5-5838a6ec0941 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041438 Aug 25 05:44:42.855891 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 757/1490] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:42 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:44:43.687448 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-be633a03-0d31-44a0-87b7-6cf318adc9e9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:43.688058 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-be633a03-0d31-44a0-87b7-6cf318adc9e9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:43.694367 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-be633a03-0d31-44a0-87b7-6cf318adc9e9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:43.694938 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-be633a03-0d31-44a0-87b7-6cf318adc9e9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:43.695551 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-be633a03-0d31-44a0-87b7-6cf318adc9e9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:43.695984 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-be633a03-0d31-44a0-87b7-6cf318adc9e9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:43.819917 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-be633a03-0d31-44a0-87b7-6cf318adc9e9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:43.827227 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-be633a03-0d31-44a0-87b7-6cf318adc9e9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.143382 Aug 25 05:44:43.827785 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 734/1491] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:43 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:43.867280 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9cb729ef-0379-4bc0-a4fb-4b64b484f746 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:43.868177 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9cb729ef-0379-4bc0-a4fb-4b64b484f746 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:43.874102 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9cb729ef-0379-4bc0-a4fb-4b64b484f746 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:43.874536 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9cb729ef-0379-4bc0-a4fb-4b64b484f746 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:43.875310 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9cb729ef-0379-4bc0-a4fb-4b64b484f746 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:43.875732 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9cb729ef-0379-4bc0-a4fb-4b64b484f746 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:43.905544 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9cb729ef-0379-4bc0-a4fb-4b64b484f746 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042725 Aug 25 05:44:43.906083 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 758/1492] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:43 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:44.844430 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1c4a8cd1-3aca-46f8-9dd7-acf633f90914 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:44.845008 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1c4a8cd1-3aca-46f8-9dd7-acf633f90914 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:44.851464 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1c4a8cd1-3aca-46f8-9dd7-acf633f90914 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:44.851900 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1c4a8cd1-3aca-46f8-9dd7-acf633f90914 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:44.852662 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1c4a8cd1-3aca-46f8-9dd7-acf633f90914 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:44.853086 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1c4a8cd1-3aca-46f8-9dd7-acf633f90914 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:44.916853 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6b166fbd-defd-4775-a9a1-a65b945607a7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:44.917931 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6b166fbd-defd-4775-a9a1-a65b945607a7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:44.923614 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6b166fbd-defd-4775-a9a1-a65b945607a7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:44.924072 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6b166fbd-defd-4775-a9a1-a65b945607a7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:44.924825 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6b166fbd-defd-4775-a9a1-a65b945607a7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:44.925248 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6b166fbd-defd-4775-a9a1-a65b945607a7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:44.954876 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6b166fbd-defd-4775-a9a1-a65b945607a7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041726 Aug 25 05:44:44.955438 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 759/1493] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:44 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:44:44.975673 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-1c4a8cd1-3aca-46f8-9dd7-acf633f90914 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:44.982994 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1c4a8cd1-3aca-46f8-9dd7-acf633f90914 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.142550 Aug 25 05:44:44.983547 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 735/1494] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:44 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:45.966592 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9600671e-c732-4f28-a633-f68c75896487 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:45.967499 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9600671e-c732-4f28-a633-f68c75896487 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:45.973269 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9600671e-c732-4f28-a633-f68c75896487 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:45.973748 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9600671e-c732-4f28-a633-f68c75896487 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:45.974997 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9600671e-c732-4f28-a633-f68c75896487 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:45.975429 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9600671e-c732-4f28-a633-f68c75896487 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:45.999877 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-36c3c584-e33f-4078-9a9f-9ad0cd2efdea tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:46.000493 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-36c3c584-e33f-4078-9a9f-9ad0cd2efdea tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:46.004537 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9600671e-c732-4f28-a633-f68c75896487 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041600 Aug 25 05:44:46.005453 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 760/1495] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:45 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:46.006922 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-36c3c584-e33f-4078-9a9f-9ad0cd2efdea tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:46.007367 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-36c3c584-e33f-4078-9a9f-9ad0cd2efdea tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:46.008143 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-36c3c584-e33f-4078-9a9f-9ad0cd2efdea tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:46.008569 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-36c3c584-e33f-4078-9a9f-9ad0cd2efdea tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:46.132012 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-36c3c584-e33f-4078-9a9f-9ad0cd2efdea tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:46.139463 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-36c3c584-e33f-4078-9a9f-9ad0cd2efdea tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.143236 Aug 25 05:44:46.140028 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 736/1496] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:45 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:44:47.016460 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-26838492-8860-42d2-914e-ebdb29f81e12 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:47.017367 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-26838492-8860-42d2-914e-ebdb29f81e12 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:47.023303 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-26838492-8860-42d2-914e-ebdb29f81e12 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:47.023751 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-26838492-8860-42d2-914e-ebdb29f81e12 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:47.024817 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-26838492-8860-42d2-914e-ebdb29f81e12 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:47.025256 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-26838492-8860-42d2-914e-ebdb29f81e12 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:47.054805 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-26838492-8860-42d2-914e-ebdb29f81e12 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042117 Aug 25 05:44:47.055377 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 761/1497] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:47 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:47.156286 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-19b6b61c-b14f-4eaa-a4d0-0058a782e35e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:47.156820 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-19b6b61c-b14f-4eaa-a4d0-0058a782e35e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:47.162632 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-19b6b61c-b14f-4eaa-a4d0-0058a782e35e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:47.163076 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-19b6b61c-b14f-4eaa-a4d0-0058a782e35e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:47.163835 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-19b6b61c-b14f-4eaa-a4d0-0058a782e35e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:47.164265 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-19b6b61c-b14f-4eaa-a4d0-0058a782e35e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:47.289232 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-19b6b61c-b14f-4eaa-a4d0-0058a782e35e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:47.296844 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-19b6b61c-b14f-4eaa-a4d0-0058a782e35e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.144251 Aug 25 05:44:47.297768 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 737/1498] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:47 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:48.066297 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-83a09e92-b91c-4bc3-a548-00ee4dc1508d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:48.067141 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-83a09e92-b91c-4bc3-a548-00ee4dc1508d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:48.073218 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-83a09e92-b91c-4bc3-a548-00ee4dc1508d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:48.073715 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-83a09e92-b91c-4bc3-a548-00ee4dc1508d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:48.074452 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-83a09e92-b91c-4bc3-a548-00ee4dc1508d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:48.074878 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-83a09e92-b91c-4bc3-a548-00ee4dc1508d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:48.105790 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-83a09e92-b91c-4bc3-a548-00ee4dc1508d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043190 Aug 25 05:44:48.106435 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 762/1499] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:48 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:48.314724 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-53f7f6f2-e5e8-4394-91c3-fcbacace25ad tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:48.315336 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-53f7f6f2-e5e8-4394-91c3-fcbacace25ad tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:48.321845 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-53f7f6f2-e5e8-4394-91c3-fcbacace25ad tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:48.322231 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-53f7f6f2-e5e8-4394-91c3-fcbacace25ad tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:48.322992 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-53f7f6f2-e5e8-4394-91c3-fcbacace25ad tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:48.323428 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-53f7f6f2-e5e8-4394-91c3-fcbacace25ad tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:48.445126 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-53f7f6f2-e5e8-4394-91c3-fcbacace25ad tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:48.452249 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-53f7f6f2-e5e8-4394-91c3-fcbacace25ad tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.141249 Aug 25 05:44:48.452797 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 738/1500] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:48 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:49.118074 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a6b11767-adee-43a6-9f5c-838e6d5b17f8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:49.119078 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a6b11767-adee-43a6-9f5c-838e6d5b17f8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:49.124877 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a6b11767-adee-43a6-9f5c-838e6d5b17f8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:49.125316 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a6b11767-adee-43a6-9f5c-838e6d5b17f8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:49.126178 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a6b11767-adee-43a6-9f5c-838e6d5b17f8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:49.126606 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a6b11767-adee-43a6-9f5c-838e6d5b17f8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:49.154762 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a6b11767-adee-43a6-9f5c-838e6d5b17f8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041336 Aug 25 05:44:49.155302 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 763/1501] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:49 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:49.470170 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8fdf10bf-75f5-4dc9-b2be-53eef9c3eb18 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:49.470717 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8fdf10bf-75f5-4dc9-b2be-53eef9c3eb18 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:49.477286 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8fdf10bf-75f5-4dc9-b2be-53eef9c3eb18 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:49.477745 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8fdf10bf-75f5-4dc9-b2be-53eef9c3eb18 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:49.478607 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8fdf10bf-75f5-4dc9-b2be-53eef9c3eb18 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:49.479039 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8fdf10bf-75f5-4dc9-b2be-53eef9c3eb18 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:49.600346 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-8fdf10bf-75f5-4dc9-b2be-53eef9c3eb18 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:49.607839 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8fdf10bf-75f5-4dc9-b2be-53eef9c3eb18 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.141931 Aug 25 05:44:49.608392 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 739/1502] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:49 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:50.166727 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e20bd737-5245-4c30-a067-c160051354b6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:50.167562 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e20bd737-5245-4c30-a067-c160051354b6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:50.173342 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e20bd737-5245-4c30-a067-c160051354b6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:50.173808 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e20bd737-5245-4c30-a067-c160051354b6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:50.174557 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e20bd737-5245-4c30-a067-c160051354b6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:50.174984 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e20bd737-5245-4c30-a067-c160051354b6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:50.204665 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e20bd737-5245-4c30-a067-c160051354b6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042260 Aug 25 05:44:50.205196 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 764/1503] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:50 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:50.626047 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-200f6a00-3fe8-4495-a850-4348853c8a9d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:50.626651 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-200f6a00-3fe8-4495-a850-4348853c8a9d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:50.632648 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-200f6a00-3fe8-4495-a850-4348853c8a9d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:50.633094 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-200f6a00-3fe8-4495-a850-4348853c8a9d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:50.633877 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-200f6a00-3fe8-4495-a850-4348853c8a9d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:50.634305 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-200f6a00-3fe8-4495-a850-4348853c8a9d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:50.757344 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-200f6a00-3fe8-4495-a850-4348853c8a9d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:50.764717 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-200f6a00-3fe8-4495-a850-4348853c8a9d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.142353 Aug 25 05:44:50.765325 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 740/1504] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:50 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:51.217314 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-8565d1c5-4874-41e2-9369-9da2aebce698 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:51.218159 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-8565d1c5-4874-41e2-9369-9da2aebce698 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:51.223905 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8565d1c5-4874-41e2-9369-9da2aebce698 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:51.224343 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8565d1c5-4874-41e2-9369-9da2aebce698 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:51.225157 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8565d1c5-4874-41e2-9369-9da2aebce698 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:51.225609 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8565d1c5-4874-41e2-9369-9da2aebce698 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:51.254240 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-8565d1c5-4874-41e2-9369-9da2aebce698 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040759 Aug 25 05:44:51.254794 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 765/1505] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:51 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:51.782478 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5e6d87ba-6981-4a18-aca9-364f6fdd2537 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:51.783034 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5e6d87ba-6981-4a18-aca9-364f6fdd2537 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:51.788871 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5e6d87ba-6981-4a18-aca9-364f6fdd2537 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:51.789420 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5e6d87ba-6981-4a18-aca9-364f6fdd2537 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:51.790212 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5e6d87ba-6981-4a18-aca9-364f6fdd2537 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:51.790641 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5e6d87ba-6981-4a18-aca9-364f6fdd2537 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:51.910043 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-5e6d87ba-6981-4a18-aca9-364f6fdd2537 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:51.918296 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5e6d87ba-6981-4a18-aca9-364f6fdd2537 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.139532 Aug 25 05:44:51.918855 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 741/1506] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:51 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:44:52.266286 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-470124b9-a148-4dcb-b5b2-3a0615dda9c7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:52.267193 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-470124b9-a148-4dcb-b5b2-3a0615dda9c7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:52.273650 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-470124b9-a148-4dcb-b5b2-3a0615dda9c7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:52.274497 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-470124b9-a148-4dcb-b5b2-3a0615dda9c7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:52.275191 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-470124b9-a148-4dcb-b5b2-3a0615dda9c7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:52.275630 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-470124b9-a148-4dcb-b5b2-3a0615dda9c7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:52.304940 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-470124b9-a148-4dcb-b5b2-3a0615dda9c7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042409 Aug 25 05:44:52.305483 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 766/1507] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:52 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:52.934874 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-23115718-b4a6-49b6-9413-0d145250c69b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:52.935430 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-23115718-b4a6-49b6-9413-0d145250c69b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:52.941268 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-23115718-b4a6-49b6-9413-0d145250c69b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:52.941740 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-23115718-b4a6-49b6-9413-0d145250c69b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:52.942494 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-23115718-b4a6-49b6-9413-0d145250c69b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:52.942919 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-23115718-b4a6-49b6-9413-0d145250c69b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:53.070177 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-23115718-b4a6-49b6-9413-0d145250c69b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:53.077710 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-23115718-b4a6-49b6-9413-0d145250c69b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.146493 Aug 25 05:44:53.078288 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 742/1508] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:52 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:53.316181 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7f52a928-3eef-4068-84ef-6c79f3bf586b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:53.317078 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-7f52a928-3eef-4068-84ef-6c79f3bf586b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:53.323429 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7f52a928-3eef-4068-84ef-6c79f3bf586b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:53.323854 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7f52a928-3eef-4068-84ef-6c79f3bf586b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:53.324598 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7f52a928-3eef-4068-84ef-6c79f3bf586b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:53.325020 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7f52a928-3eef-4068-84ef-6c79f3bf586b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:53.354663 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-7f52a928-3eef-4068-84ef-6c79f3bf586b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042074 Aug 25 05:44:53.355394 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 767/1509] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:53 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:54.094996 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7b71ad4a-4f42-41b8-bfb0-677d8875a805 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:54.095630 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7b71ad4a-4f42-41b8-bfb0-677d8875a805 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:54.101832 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7b71ad4a-4f42-41b8-bfb0-677d8875a805 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:54.102285 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7b71ad4a-4f42-41b8-bfb0-677d8875a805 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:54.103064 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7b71ad4a-4f42-41b8-bfb0-677d8875a805 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:54.103501 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7b71ad4a-4f42-41b8-bfb0-677d8875a805 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:54.234362 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-7b71ad4a-4f42-41b8-bfb0-677d8875a805 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:54.240924 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7b71ad4a-4f42-41b8-bfb0-677d8875a805 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.149815 Aug 25 05:44:54.245589 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 743/1510] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:54 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:54.366710 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-8cc5e20f-7ca3-478f-970b-c849da7e3294 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:54.367591 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-8cc5e20f-7ca3-478f-970b-c849da7e3294 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:54.373413 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8cc5e20f-7ca3-478f-970b-c849da7e3294 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:54.373883 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8cc5e20f-7ca3-478f-970b-c849da7e3294 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:54.374645 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8cc5e20f-7ca3-478f-970b-c849da7e3294 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:54.375075 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8cc5e20f-7ca3-478f-970b-c849da7e3294 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:54.405830 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-8cc5e20f-7ca3-478f-970b-c849da7e3294 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042841 Aug 25 05:44:54.406394 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 768/1511] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:54 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:55.257819 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-55f3ba05-8136-4d28-9004-476b06fdd90c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:55.258432 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-55f3ba05-8136-4d28-9004-476b06fdd90c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:55.264246 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-55f3ba05-8136-4d28-9004-476b06fdd90c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:55.264693 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-55f3ba05-8136-4d28-9004-476b06fdd90c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:55.265485 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-55f3ba05-8136-4d28-9004-476b06fdd90c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:55.265955 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-55f3ba05-8136-4d28-9004-476b06fdd90c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:55.387628 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-55f3ba05-8136-4d28-9004-476b06fdd90c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:55.394896 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-55f3ba05-8136-4d28-9004-476b06fdd90c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.140750 Aug 25 05:44:55.395474 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 744/1512] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:55 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:55.418096 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9c5160ea-65b3-4f3f-a4d8-8072bc28ad1b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:55.418912 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9c5160ea-65b3-4f3f-a4d8-8072bc28ad1b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:55.424645 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9c5160ea-65b3-4f3f-a4d8-8072bc28ad1b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:55.425109 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9c5160ea-65b3-4f3f-a4d8-8072bc28ad1b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:55.425892 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9c5160ea-65b3-4f3f-a4d8-8072bc28ad1b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:55.426314 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9c5160ea-65b3-4f3f-a4d8-8072bc28ad1b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:55.455170 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9c5160ea-65b3-4f3f-a4d8-8072bc28ad1b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041808 Aug 25 05:44:55.455724 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 769/1513] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:55 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:56.411913 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c67fb593-8651-4b6d-a289-14ad3128cff6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:56.412523 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c67fb593-8651-4b6d-a289-14ad3128cff6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:56.419629 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c67fb593-8651-4b6d-a289-14ad3128cff6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:56.420070 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c67fb593-8651-4b6d-a289-14ad3128cff6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:56.420833 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c67fb593-8651-4b6d-a289-14ad3128cff6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:56.421264 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c67fb593-8651-4b6d-a289-14ad3128cff6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:56.466475 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-071fa56e-a6b4-41e6-849e-4b0d29ee4407 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:56.467291 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-071fa56e-a6b4-41e6-849e-4b0d29ee4407 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:56.473026 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-071fa56e-a6b4-41e6-849e-4b0d29ee4407 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:56.473466 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-071fa56e-a6b4-41e6-849e-4b0d29ee4407 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:56.474252 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-071fa56e-a6b4-41e6-849e-4b0d29ee4407 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:56.474681 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-071fa56e-a6b4-41e6-849e-4b0d29ee4407 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:56.506563 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-071fa56e-a6b4-41e6-849e-4b0d29ee4407 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043879 Aug 25 05:44:56.507190 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 770/1514] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:56 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:44:56.545299 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-c67fb593-8651-4b6d-a289-14ad3128cff6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:56.552570 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c67fb593-8651-4b6d-a289-14ad3128cff6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.144293 Aug 25 05:44:56.553129 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 745/1515] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:56 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:57.517954 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e0b07f82-b43b-47a2-b4e3-c7f02852faec tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:57.518859 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e0b07f82-b43b-47a2-b4e3-c7f02852faec tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:57.525005 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e0b07f82-b43b-47a2-b4e3-c7f02852faec tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:57.525396 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e0b07f82-b43b-47a2-b4e3-c7f02852faec tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:57.526459 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e0b07f82-b43b-47a2-b4e3-c7f02852faec tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:57.526885 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e0b07f82-b43b-47a2-b4e3-c7f02852faec tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:57.557721 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e0b07f82-b43b-47a2-b4e3-c7f02852faec tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043496 Aug 25 05:44:57.558273 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 771/1516] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:57 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:57.570329 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6155b199-23ec-4c35-9167-d23e51214120 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:57.571048 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6155b199-23ec-4c35-9167-d23e51214120 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:57.576812 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6155b199-23ec-4c35-9167-d23e51214120 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:57.577259 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6155b199-23ec-4c35-9167-d23e51214120 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:57.578081 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6155b199-23ec-4c35-9167-d23e51214120 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:57.578504 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6155b199-23ec-4c35-9167-d23e51214120 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:57.705325 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6155b199-23ec-4c35-9167-d23e51214120 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:57.712928 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6155b199-23ec-4c35-9167-d23e51214120 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.146155 Aug 25 05:44:57.713489 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 746/1517] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:57 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:58.568144 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-441feee0-5ffe-42eb-854e-1b1fac0b3623 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:58.569041 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-441feee0-5ffe-42eb-854e-1b1fac0b3623 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:58.575571 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-441feee0-5ffe-42eb-854e-1b1fac0b3623 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:58.576004 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-441feee0-5ffe-42eb-854e-1b1fac0b3623 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:58.576751 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-441feee0-5ffe-42eb-854e-1b1fac0b3623 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:58.577173 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-441feee0-5ffe-42eb-854e-1b1fac0b3623 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:58.605365 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-441feee0-5ffe-42eb-854e-1b1fac0b3623 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040838 Aug 25 05:44:58.605787 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 772/1518] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:58 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:58.729623 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-0b764141-eebb-469a-a602-7e48a7792da8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:58.730239 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-0b764141-eebb-469a-a602-7e48a7792da8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:58.736154 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0b764141-eebb-469a-a602-7e48a7792da8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:58.736600 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0b764141-eebb-469a-a602-7e48a7792da8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:58.737359 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0b764141-eebb-469a-a602-7e48a7792da8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:58.737822 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0b764141-eebb-469a-a602-7e48a7792da8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:58.857007 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-0b764141-eebb-469a-a602-7e48a7792da8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:44:58.864512 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-0b764141-eebb-469a-a602-7e48a7792da8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.138538 Aug 25 05:44:58.865078 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 747/1519] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:58 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:44:59.616484 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c9c69296-58c8-447e-8dd3-cf199888edbc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:59.617374 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c9c69296-58c8-447e-8dd3-cf199888edbc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:59.623884 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c9c69296-58c8-447e-8dd3-cf199888edbc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:59.624320 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c9c69296-58c8-447e-8dd3-cf199888edbc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:59.625064 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c9c69296-58c8-447e-8dd3-cf199888edbc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:59.625844 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c9c69296-58c8-447e-8dd3-cf199888edbc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:59.655388 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c9c69296-58c8-447e-8dd3-cf199888edbc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042504 Aug 25 05:44:59.655868 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 773/1520] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:44:59 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:44:59.882600 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-9e1c5e0d-de2d-4fae-9ce6-2dcd4b5094d4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:44:59.883219 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-9e1c5e0d-de2d-4fae-9ce6-2dcd4b5094d4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:44:59.889255 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9e1c5e0d-de2d-4fae-9ce6-2dcd4b5094d4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:59.889740 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9e1c5e0d-de2d-4fae-9ce6-2dcd4b5094d4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:44:59.890607 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9e1c5e0d-de2d-4fae-9ce6-2dcd4b5094d4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:44:59.891042 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9e1c5e0d-de2d-4fae-9ce6-2dcd4b5094d4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:00.012981 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-9e1c5e0d-de2d-4fae-9ce6-2dcd4b5094d4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:00.020446 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-9e1c5e0d-de2d-4fae-9ce6-2dcd4b5094d4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.142177 Aug 25 05:45:00.021011 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 748/1521] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:44:59 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:00.666626 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c64b21e6-aa8e-4ce1-9b8b-d3b2521f91b1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:00.667547 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c64b21e6-aa8e-4ce1-9b8b-d3b2521f91b1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:00.673377 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c64b21e6-aa8e-4ce1-9b8b-d3b2521f91b1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:00.673845 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c64b21e6-aa8e-4ce1-9b8b-d3b2521f91b1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:00.674650 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c64b21e6-aa8e-4ce1-9b8b-d3b2521f91b1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:00.675073 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c64b21e6-aa8e-4ce1-9b8b-d3b2521f91b1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:00.703726 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c64b21e6-aa8e-4ce1-9b8b-d3b2521f91b1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040846 Aug 25 05:45:00.704283 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 774/1522] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:00 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:01.037572 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-01c7ce28-e124-45a8-a234-a092c0d9b0f1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:01.038219 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-01c7ce28-e124-45a8-a234-a092c0d9b0f1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:01.044157 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-01c7ce28-e124-45a8-a234-a092c0d9b0f1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:01.044608 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-01c7ce28-e124-45a8-a234-a092c0d9b0f1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:01.045357 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-01c7ce28-e124-45a8-a234-a092c0d9b0f1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:01.045806 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-01c7ce28-e124-45a8-a234-a092c0d9b0f1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:01.170748 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-01c7ce28-e124-45a8-a234-a092c0d9b0f1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:01.178057 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-01c7ce28-e124-45a8-a234-a092c0d9b0f1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.144206 Aug 25 05:45:01.178617 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 749/1523] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:01 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:01.714588 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-190c2726-6809-4379-8ce3-e6b75ba8aa16 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:01.715487 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-190c2726-6809-4379-8ce3-e6b75ba8aa16 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:01.721269 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-190c2726-6809-4379-8ce3-e6b75ba8aa16 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:01.721742 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-190c2726-6809-4379-8ce3-e6b75ba8aa16 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:01.722491 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-190c2726-6809-4379-8ce3-e6b75ba8aa16 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:01.722913 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-190c2726-6809-4379-8ce3-e6b75ba8aa16 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:01.752138 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-190c2726-6809-4379-8ce3-e6b75ba8aa16 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041825 Aug 25 05:45:01.752705 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 775/1524] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:01 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:02.195694 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a8386763-09d9-41f9-a30c-da4fe6798f2c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:02.197099 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a8386763-09d9-41f9-a30c-da4fe6798f2c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:02.203096 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a8386763-09d9-41f9-a30c-da4fe6798f2c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:02.203557 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a8386763-09d9-41f9-a30c-da4fe6798f2c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:02.204296 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a8386763-09d9-41f9-a30c-da4fe6798f2c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:02.204727 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a8386763-09d9-41f9-a30c-da4fe6798f2c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:02.328807 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-a8386763-09d9-41f9-a30c-da4fe6798f2c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:02.336112 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a8386763-09d9-41f9-a30c-da4fe6798f2c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.144392 Aug 25 05:45:02.336721 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 750/1525] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:02 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:02.763749 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-58fbde74-c9ff-4b37-abd2-184d32fb832e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:02.765090 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-58fbde74-c9ff-4b37-abd2-184d32fb832e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:02.770782 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-58fbde74-c9ff-4b37-abd2-184d32fb832e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:02.771225 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-58fbde74-c9ff-4b37-abd2-184d32fb832e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:02.772103 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-58fbde74-c9ff-4b37-abd2-184d32fb832e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:02.772507 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-58fbde74-c9ff-4b37-abd2-184d32fb832e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:02.801982 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-58fbde74-c9ff-4b37-abd2-184d32fb832e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041899 Aug 25 05:45:02.802454 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 776/1526] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:02 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:03.353404 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8e04991e-8bad-4fda-a5e7-efc17965954f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:03.354078 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8e04991e-8bad-4fda-a5e7-efc17965954f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:03.359961 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8e04991e-8bad-4fda-a5e7-efc17965954f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:03.360424 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8e04991e-8bad-4fda-a5e7-efc17965954f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:03.361174 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8e04991e-8bad-4fda-a5e7-efc17965954f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:03.361620 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8e04991e-8bad-4fda-a5e7-efc17965954f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:03.486182 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-8e04991e-8bad-4fda-a5e7-efc17965954f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:03.494046 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8e04991e-8bad-4fda-a5e7-efc17965954f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.144363 Aug 25 05:45:03.494677 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 751/1527] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:03 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:03.813824 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-0bf97aa6-9c20-49ed-8440-bfcbbe32c176 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:03.814730 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-0bf97aa6-9c20-49ed-8440-bfcbbe32c176 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:03.820472 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0bf97aa6-9c20-49ed-8440-bfcbbe32c176 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:03.821032 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0bf97aa6-9c20-49ed-8440-bfcbbe32c176 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:03.822458 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0bf97aa6-9c20-49ed-8440-bfcbbe32c176 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:03.822892 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0bf97aa6-9c20-49ed-8440-bfcbbe32c176 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:03.850869 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-0bf97aa6-9c20-49ed-8440-bfcbbe32c176 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040724 Aug 25 05:45:03.851417 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 777/1528] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:03 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:04.512215 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-930c48aa-7600-4039-88da-b5e449de2fc6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:04.512839 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-930c48aa-7600-4039-88da-b5e449de2fc6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:04.519081 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-930c48aa-7600-4039-88da-b5e449de2fc6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:04.519543 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-930c48aa-7600-4039-88da-b5e449de2fc6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:04.520288 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-930c48aa-7600-4039-88da-b5e449de2fc6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:04.520793 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-930c48aa-7600-4039-88da-b5e449de2fc6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:04.646520 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-930c48aa-7600-4039-88da-b5e449de2fc6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:04.654723 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-930c48aa-7600-4039-88da-b5e449de2fc6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.146288 Aug 25 05:45:04.655282 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 752/1529] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:04 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:04.862461 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7bb73826-4c60-420f-8c47-4131621add67 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:04.863406 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-7bb73826-4c60-420f-8c47-4131621add67 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:04.869942 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7bb73826-4c60-420f-8c47-4131621add67 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:04.870402 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7bb73826-4c60-420f-8c47-4131621add67 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:04.871193 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7bb73826-4c60-420f-8c47-4131621add67 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:04.871619 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7bb73826-4c60-420f-8c47-4131621add67 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:04.900366 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-7bb73826-4c60-420f-8c47-4131621add67 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041867 Aug 25 05:45:04.900905 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 778/1530] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:04 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:05.671180 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-754f62ab-7fdc-4589-8706-311c71688f8d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:05.671818 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-754f62ab-7fdc-4589-8706-311c71688f8d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:05.678158 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-754f62ab-7fdc-4589-8706-311c71688f8d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:05.678599 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-754f62ab-7fdc-4589-8706-311c71688f8d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:05.679362 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-754f62ab-7fdc-4589-8706-311c71688f8d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:05.679795 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-754f62ab-7fdc-4589-8706-311c71688f8d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:05.800534 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-754f62ab-7fdc-4589-8706-311c71688f8d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:05.808588 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-754f62ab-7fdc-4589-8706-311c71688f8d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.140936 Aug 25 05:45:05.809268 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 753/1531] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:05 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:05.912100 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b5dbde07-b781-4ceb-9ee9-d86653287162 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:05.913103 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b5dbde07-b781-4ceb-9ee9-d86653287162 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:05.918853 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b5dbde07-b781-4ceb-9ee9-d86653287162 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:05.919298 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b5dbde07-b781-4ceb-9ee9-d86653287162 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:05.920063 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b5dbde07-b781-4ceb-9ee9-d86653287162 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:05.920500 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b5dbde07-b781-4ceb-9ee9-d86653287162 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:05.949629 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b5dbde07-b781-4ceb-9ee9-d86653287162 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041294 Aug 25 05:45:05.950171 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 779/1532] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:05 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:06.825666 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-76b3be86-586e-4bb8-a7b9-32e4e0057620 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:06.826283 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-76b3be86-586e-4bb8-a7b9-32e4e0057620 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:06.831931 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-76b3be86-586e-4bb8-a7b9-32e4e0057620 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:06.832379 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-76b3be86-586e-4bb8-a7b9-32e4e0057620 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:06.833155 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-76b3be86-586e-4bb8-a7b9-32e4e0057620 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:06.833623 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-76b3be86-586e-4bb8-a7b9-32e4e0057620 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:06.956764 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-76b3be86-586e-4bb8-a7b9-32e4e0057620 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:06.960127 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1fc52abf-6bee-42e4-a124-20c9adffadc2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:06.961033 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1fc52abf-6bee-42e4-a124-20c9adffadc2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:06.965075 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-76b3be86-586e-4bb8-a7b9-32e4e0057620 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.143681 Aug 25 05:45:06.965664 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 754/1533] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:06 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:06.967768 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1fc52abf-6bee-42e4-a124-20c9adffadc2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:06.968238 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1fc52abf-6bee-42e4-a124-20c9adffadc2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:06.969070 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1fc52abf-6bee-42e4-a124-20c9adffadc2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:06.969500 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1fc52abf-6bee-42e4-a124-20c9adffadc2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:06.998740 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1fc52abf-6bee-42e4-a124-20c9adffadc2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042378 Aug 25 05:45:06.999318 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 780/1534] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:06 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:45:07.981745 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a00759ec-3b4f-4089-9591-c3bc4400e610 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:07.982362 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a00759ec-3b4f-4089-9591-c3bc4400e610 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:07.988311 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a00759ec-3b4f-4089-9591-c3bc4400e610 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:07.988824 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a00759ec-3b4f-4089-9591-c3bc4400e610 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:07.989686 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a00759ec-3b4f-4089-9591-c3bc4400e610 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:07.990188 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a00759ec-3b4f-4089-9591-c3bc4400e610 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:08.010104 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-76bc230c-9ca1-4b33-b43e-7a69f74d3932 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:08.011704 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-76bc230c-9ca1-4b33-b43e-7a69f74d3932 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:08.017487 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-76bc230c-9ca1-4b33-b43e-7a69f74d3932 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:08.017955 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-76bc230c-9ca1-4b33-b43e-7a69f74d3932 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:08.018709 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-76bc230c-9ca1-4b33-b43e-7a69f74d3932 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:08.019135 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-76bc230c-9ca1-4b33-b43e-7a69f74d3932 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:08.048659 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-76bc230c-9ca1-4b33-b43e-7a69f74d3932 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042331 Aug 25 05:45:08.049214 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 781/1535] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:08 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:45:08.116677 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-a00759ec-3b4f-4089-9591-c3bc4400e610 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:08.123970 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a00759ec-3b4f-4089-9591-c3bc4400e610 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.145880 Aug 25 05:45:08.124551 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 755/1536] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:07 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:09.060920 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-3612e7f1-615e-4739-a7d0-8e7c8b2cef39 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:09.061986 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-3612e7f1-615e-4739-a7d0-8e7c8b2cef39 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:09.067777 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3612e7f1-615e-4739-a7d0-8e7c8b2cef39 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:09.068221 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3612e7f1-615e-4739-a7d0-8e7c8b2cef39 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:09.068978 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3612e7f1-615e-4739-a7d0-8e7c8b2cef39 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:09.069643 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3612e7f1-615e-4739-a7d0-8e7c8b2cef39 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:09.097947 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-3612e7f1-615e-4739-a7d0-8e7c8b2cef39 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041654 Aug 25 05:45:09.098487 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 782/1537] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:09 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:09.141797 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ab49e296-edbb-4eeb-a1e5-73c95688c8d6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:09.141797 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ab49e296-edbb-4eeb-a1e5-73c95688c8d6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:09.147579 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ab49e296-edbb-4eeb-a1e5-73c95688c8d6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:09.148020 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ab49e296-edbb-4eeb-a1e5-73c95688c8d6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:09.149031 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ab49e296-edbb-4eeb-a1e5-73c95688c8d6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:09.149462 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ab49e296-edbb-4eeb-a1e5-73c95688c8d6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:09.311214 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ab49e296-edbb-4eeb-a1e5-73c95688c8d6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:09.318900 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ab49e296-edbb-4eeb-a1e5-73c95688c8d6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.181754 Aug 25 05:45:09.319476 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 756/1538] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:09 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:10.109587 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f1fb01e8-7504-4f3f-9570-c2a8fc631d32 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:10.110541 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f1fb01e8-7504-4f3f-9570-c2a8fc631d32 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:10.116393 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f1fb01e8-7504-4f3f-9570-c2a8fc631d32 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:10.116842 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f1fb01e8-7504-4f3f-9570-c2a8fc631d32 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:10.117706 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f1fb01e8-7504-4f3f-9570-c2a8fc631d32 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:10.118143 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f1fb01e8-7504-4f3f-9570-c2a8fc631d32 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:10.147486 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f1fb01e8-7504-4f3f-9570-c2a8fc631d32 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041604 Aug 25 05:45:10.148038 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 783/1539] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:10 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:10.335352 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-46d648cd-35d0-493f-b90a-9dd3d6b145b8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:10.335985 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-46d648cd-35d0-493f-b90a-9dd3d6b145b8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:10.342555 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-46d648cd-35d0-493f-b90a-9dd3d6b145b8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:10.342989 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-46d648cd-35d0-493f-b90a-9dd3d6b145b8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:10.343740 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-46d648cd-35d0-493f-b90a-9dd3d6b145b8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:10.344166 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-46d648cd-35d0-493f-b90a-9dd3d6b145b8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:10.466695 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-46d648cd-35d0-493f-b90a-9dd3d6b145b8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:10.474848 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-46d648cd-35d0-493f-b90a-9dd3d6b145b8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.143118 Aug 25 05:45:10.475436 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 757/1540] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:10 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:11.164118 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2e866d9e-d6b0-471a-a191-cd8016caa78e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:11.165158 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2e866d9e-d6b0-471a-a191-cd8016caa78e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:11.171046 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2e866d9e-d6b0-471a-a191-cd8016caa78e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:11.171486 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2e866d9e-d6b0-471a-a191-cd8016caa78e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:11.172246 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2e866d9e-d6b0-471a-a191-cd8016caa78e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:11.172674 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2e866d9e-d6b0-471a-a191-cd8016caa78e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:11.206241 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2e866d9e-d6b0-471a-a191-cd8016caa78e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047610 Aug 25 05:45:11.207167 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 784/1541] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:11 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:11.492317 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-bdf8ca10-fa34-448c-a999-d42a581b6010 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:11.492924 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-bdf8ca10-fa34-448c-a999-d42a581b6010 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:11.499487 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bdf8ca10-fa34-448c-a999-d42a581b6010 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:11.499931 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bdf8ca10-fa34-448c-a999-d42a581b6010 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:11.500687 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bdf8ca10-fa34-448c-a999-d42a581b6010 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:11.501116 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bdf8ca10-fa34-448c-a999-d42a581b6010 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:11.646635 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-bdf8ca10-fa34-448c-a999-d42a581b6010 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:11.656266 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-bdf8ca10-fa34-448c-a999-d42a581b6010 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.167493 Aug 25 05:45:11.656832 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 758/1542] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:11 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:12.218579 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-36ff2b64-4f04-4867-b0a1-de2f9f8988eb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:12.220168 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-36ff2b64-4f04-4867-b0a1-de2f9f8988eb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:12.226129 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-36ff2b64-4f04-4867-b0a1-de2f9f8988eb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:12.226572 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-36ff2b64-4f04-4867-b0a1-de2f9f8988eb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:12.227334 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-36ff2b64-4f04-4867-b0a1-de2f9f8988eb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:12.227756 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-36ff2b64-4f04-4867-b0a1-de2f9f8988eb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:12.256734 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-36ff2b64-4f04-4867-b0a1-de2f9f8988eb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041919 Aug 25 05:45:12.257280 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 785/1543] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:12 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:12.672075 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-305f6a02-20f2-4c03-8240-b64b6915ca9c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:12.689905 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-305f6a02-20f2-4c03-8240-b64b6915ca9c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:12.689905 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-305f6a02-20f2-4c03-8240-b64b6915ca9c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:12.689905 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-305f6a02-20f2-4c03-8240-b64b6915ca9c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:12.689905 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-305f6a02-20f2-4c03-8240-b64b6915ca9c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:12.690350 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-305f6a02-20f2-4c03-8240-b64b6915ca9c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:12.815730 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-305f6a02-20f2-4c03-8240-b64b6915ca9c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:12.823333 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-305f6a02-20f2-4c03-8240-b64b6915ca9c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.154691 Aug 25 05:45:12.824037 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 759/1544] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:12 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:13.268292 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f4498bbe-d935-447b-bf56-e7f26de53526 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:13.269224 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f4498bbe-d935-447b-bf56-e7f26de53526 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:13.275396 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f4498bbe-d935-447b-bf56-e7f26de53526 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:13.276377 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f4498bbe-d935-447b-bf56-e7f26de53526 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:13.277131 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f4498bbe-d935-447b-bf56-e7f26de53526 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:13.277763 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f4498bbe-d935-447b-bf56-e7f26de53526 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:13.306200 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f4498bbe-d935-447b-bf56-e7f26de53526 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041627 Aug 25 05:45:13.306739 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 786/1545] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:13 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:13.841025 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e29e8baf-f963-490f-a682-4e20365af206 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:13.841596 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e29e8baf-f963-490f-a682-4e20365af206 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:13.847465 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e29e8baf-f963-490f-a682-4e20365af206 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:13.847906 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e29e8baf-f963-490f-a682-4e20365af206 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:13.848652 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e29e8baf-f963-490f-a682-4e20365af206 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:13.849074 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e29e8baf-f963-490f-a682-4e20365af206 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:13.968048 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e29e8baf-f963-490f-a682-4e20365af206 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:13.975368 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e29e8baf-f963-490f-a682-4e20365af206 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.138650 Aug 25 05:45:14.027638 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 760/1546] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:13 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:14.317668 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b560b694-0e69-40f9-95b3-5946f81d7acf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:14.318585 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b560b694-0e69-40f9-95b3-5946f81d7acf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:14.324396 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b560b694-0e69-40f9-95b3-5946f81d7acf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:14.324838 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b560b694-0e69-40f9-95b3-5946f81d7acf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:14.325751 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b560b694-0e69-40f9-95b3-5946f81d7acf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:14.326053 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b560b694-0e69-40f9-95b3-5946f81d7acf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:14.354283 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b560b694-0e69-40f9-95b3-5946f81d7acf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040347 Aug 25 05:45:14.354817 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 787/1547] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:14 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:14.994067 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1ff544f5-bb2c-4c30-a121-e310c4c89a63 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:14.994682 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1ff544f5-bb2c-4c30-a121-e310c4c89a63 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:15.000933 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1ff544f5-bb2c-4c30-a121-e310c4c89a63 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:15.001374 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1ff544f5-bb2c-4c30-a121-e310c4c89a63 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:15.002167 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1ff544f5-bb2c-4c30-a121-e310c4c89a63 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:15.002587 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1ff544f5-bb2c-4c30-a121-e310c4c89a63 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:15.126661 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-1ff544f5-bb2c-4c30-a121-e310c4c89a63 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:15.134360 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1ff544f5-bb2c-4c30-a121-e310c4c89a63 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.143807 Aug 25 05:45:15.134940 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 761/1548] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:14 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:15.366328 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c4294652-684d-4eb4-8a5a-a167f7abaa8c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:15.367230 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c4294652-684d-4eb4-8a5a-a167f7abaa8c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:15.373875 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c4294652-684d-4eb4-8a5a-a167f7abaa8c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:15.374320 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c4294652-684d-4eb4-8a5a-a167f7abaa8c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:15.375080 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c4294652-684d-4eb4-8a5a-a167f7abaa8c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:15.375518 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c4294652-684d-4eb4-8a5a-a167f7abaa8c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:15.406013 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c4294652-684d-4eb4-8a5a-a167f7abaa8c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043288 Aug 25 05:45:15.406560 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 788/1549] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:15 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:16.152062 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5be2b412-7f83-4b8c-92b0-f8862ae539d1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:16.152661 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5be2b412-7f83-4b8c-92b0-f8862ae539d1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:16.159010 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5be2b412-7f83-4b8c-92b0-f8862ae539d1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:16.159443 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5be2b412-7f83-4b8c-92b0-f8862ae539d1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:16.160192 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5be2b412-7f83-4b8c-92b0-f8862ae539d1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:16.160613 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5be2b412-7f83-4b8c-92b0-f8862ae539d1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:16.281501 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-5be2b412-7f83-4b8c-92b0-f8862ae539d1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:16.288719 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5be2b412-7f83-4b8c-92b0-f8862ae539d1 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.140566 Aug 25 05:45:16.289308 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 762/1550] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:16 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:16.417340 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-da01351c-d5ec-43d3-9665-e91ed305ca42 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:16.418272 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-da01351c-d5ec-43d3-9665-e91ed305ca42 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:16.424701 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-da01351c-d5ec-43d3-9665-e91ed305ca42 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:16.425144 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-da01351c-d5ec-43d3-9665-e91ed305ca42 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:16.425933 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-da01351c-d5ec-43d3-9665-e91ed305ca42 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:16.426368 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-da01351c-d5ec-43d3-9665-e91ed305ca42 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:16.455599 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-da01351c-d5ec-43d3-9665-e91ed305ca42 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042144 Aug 25 05:45:16.456160 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 789/1551] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:16 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:17.305715 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8fb87278-6d77-417e-884a-acb4c38af9df tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:17.306326 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8fb87278-6d77-417e-884a-acb4c38af9df tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:17.312948 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8fb87278-6d77-417e-884a-acb4c38af9df tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:17.313432 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8fb87278-6d77-417e-884a-acb4c38af9df tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:17.314478 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8fb87278-6d77-417e-884a-acb4c38af9df tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:17.314664 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8fb87278-6d77-417e-884a-acb4c38af9df tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:17.437078 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-8fb87278-6d77-417e-884a-acb4c38af9df tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:17.444230 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8fb87278-6d77-417e-884a-acb4c38af9df tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.142138 Aug 25 05:45:17.444785 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 763/1552] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:17 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:17.467413 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2b85c2fb-4250-498a-bb52-66677cc210b9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:17.468358 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2b85c2fb-4250-498a-bb52-66677cc210b9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:17.474421 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2b85c2fb-4250-498a-bb52-66677cc210b9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:17.474861 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2b85c2fb-4250-498a-bb52-66677cc210b9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:17.475633 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2b85c2fb-4250-498a-bb52-66677cc210b9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:17.476063 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2b85c2fb-4250-498a-bb52-66677cc210b9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:17.507017 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2b85c2fb-4250-498a-bb52-66677cc210b9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044040 Aug 25 05:45:17.507570 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 790/1553] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:17 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:18.461588 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-44e4794f-80fb-4705-95aa-dece17d34f95 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:18.462255 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-44e4794f-80fb-4705-95aa-dece17d34f95 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:18.467957 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-44e4794f-80fb-4705-95aa-dece17d34f95 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:18.468404 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-44e4794f-80fb-4705-95aa-dece17d34f95 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:18.469160 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-44e4794f-80fb-4705-95aa-dece17d34f95 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:18.469678 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-44e4794f-80fb-4705-95aa-dece17d34f95 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:18.518880 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5b227564-2492-41f6-a571-2fa3a2cfcb8e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:18.519797 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5b227564-2492-41f6-a571-2fa3a2cfcb8e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:18.526268 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5b227564-2492-41f6-a571-2fa3a2cfcb8e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:18.526747 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5b227564-2492-41f6-a571-2fa3a2cfcb8e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:18.527522 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5b227564-2492-41f6-a571-2fa3a2cfcb8e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:18.527955 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5b227564-2492-41f6-a571-2fa3a2cfcb8e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:18.563302 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5b227564-2492-41f6-a571-2fa3a2cfcb8e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048079 Aug 25 05:45:18.564099 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 791/1554] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:18 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:45:18.600114 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-44e4794f-80fb-4705-95aa-dece17d34f95 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:18.607660 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-44e4794f-80fb-4705-95aa-dece17d34f95 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.149744 Aug 25 05:45:18.608254 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 764/1555] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:18 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:19.574414 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-63e37dd3-f3ca-4336-98d3-3e50fa0db80b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:19.575421 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-63e37dd3-f3ca-4336-98d3-3e50fa0db80b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:19.581404 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-63e37dd3-f3ca-4336-98d3-3e50fa0db80b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:19.581880 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-63e37dd3-f3ca-4336-98d3-3e50fa0db80b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:19.582626 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-63e37dd3-f3ca-4336-98d3-3e50fa0db80b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:19.583049 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-63e37dd3-f3ca-4336-98d3-3e50fa0db80b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:19.611946 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-63e37dd3-f3ca-4336-98d3-3e50fa0db80b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041184 Aug 25 05:45:19.612702 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 792/1556] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:19 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:19.625709 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-909cdac3-fe03-4223-ad0e-d477ca659301 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:19.626471 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-909cdac3-fe03-4223-ad0e-d477ca659301 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:19.632196 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-909cdac3-fe03-4223-ad0e-d477ca659301 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:19.632642 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-909cdac3-fe03-4223-ad0e-d477ca659301 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:19.633398 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-909cdac3-fe03-4223-ad0e-d477ca659301 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:19.633867 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-909cdac3-fe03-4223-ad0e-d477ca659301 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:19.757122 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-909cdac3-fe03-4223-ad0e-d477ca659301 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:19.771116 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-909cdac3-fe03-4223-ad0e-d477ca659301 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.150937 Aug 25 05:45:19.771684 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 765/1557] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:19 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:20.622884 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-02aee419-7834-4cc9-8eca-f195ce694510 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:20.623775 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-02aee419-7834-4cc9-8eca-f195ce694510 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:20.629556 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-02aee419-7834-4cc9-8eca-f195ce694510 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:20.630010 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-02aee419-7834-4cc9-8eca-f195ce694510 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:20.630753 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-02aee419-7834-4cc9-8eca-f195ce694510 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:20.631175 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-02aee419-7834-4cc9-8eca-f195ce694510 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:20.661592 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-02aee419-7834-4cc9-8eca-f195ce694510 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042808 Aug 25 05:45:20.662176 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 793/1558] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:20 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:20.788506 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-568dbecf-1642-495e-b7fa-5d9c277f6a7a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:20.789084 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-568dbecf-1642-495e-b7fa-5d9c277f6a7a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:20.795073 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-568dbecf-1642-495e-b7fa-5d9c277f6a7a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:20.795520 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-568dbecf-1642-495e-b7fa-5d9c277f6a7a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:20.796282 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-568dbecf-1642-495e-b7fa-5d9c277f6a7a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:20.796718 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-568dbecf-1642-495e-b7fa-5d9c277f6a7a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:20.917553 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-568dbecf-1642-495e-b7fa-5d9c277f6a7a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:20.925155 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-568dbecf-1642-495e-b7fa-5d9c277f6a7a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.140388 Aug 25 05:45:20.925774 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 766/1559] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:20 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:21.674041 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-35a03420-7c6b-4072-9a4f-99af87d770ff tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:21.674966 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-35a03420-7c6b-4072-9a4f-99af87d770ff tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:21.680643 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-35a03420-7c6b-4072-9a4f-99af87d770ff tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:21.681080 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-35a03420-7c6b-4072-9a4f-99af87d770ff tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:21.681852 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-35a03420-7c6b-4072-9a4f-99af87d770ff tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:21.682278 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-35a03420-7c6b-4072-9a4f-99af87d770ff tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:21.711626 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-35a03420-7c6b-4072-9a4f-99af87d770ff tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042329 Aug 25 05:45:21.712174 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 794/1560] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:21 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:21.942167 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-bc894dfb-d6fe-4396-986b-106d5d7e925e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:21.942720 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-bc894dfb-d6fe-4396-986b-106d5d7e925e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:21.948475 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bc894dfb-d6fe-4396-986b-106d5d7e925e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:21.948923 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bc894dfb-d6fe-4396-986b-106d5d7e925e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:21.949711 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bc894dfb-d6fe-4396-986b-106d5d7e925e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:21.950147 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bc894dfb-d6fe-4396-986b-106d5d7e925e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:22.075172 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-bc894dfb-d6fe-4396-986b-106d5d7e925e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:22.083048 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-bc894dfb-d6fe-4396-986b-106d5d7e925e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.144598 Aug 25 05:45:22.083640 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 767/1561] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:21 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:22.722762 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-93de5bb6-db77-4878-acd3-f959dc15cfe2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:22.723653 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-93de5bb6-db77-4878-acd3-f959dc15cfe2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:22.729638 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-93de5bb6-db77-4878-acd3-f959dc15cfe2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:22.730077 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-93de5bb6-db77-4878-acd3-f959dc15cfe2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:22.730823 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-93de5bb6-db77-4878-acd3-f959dc15cfe2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:22.731243 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-93de5bb6-db77-4878-acd3-f959dc15cfe2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:22.761139 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-93de5bb6-db77-4878-acd3-f959dc15cfe2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041953 Aug 25 05:45:22.761722 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 795/1562] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:22 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:23.100237 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-f8a33e26-515c-42a2-a73b-7bb994e8b7f0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:23.100782 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-f8a33e26-515c-42a2-a73b-7bb994e8b7f0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:23.106564 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f8a33e26-515c-42a2-a73b-7bb994e8b7f0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:23.107004 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f8a33e26-515c-42a2-a73b-7bb994e8b7f0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:23.108405 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f8a33e26-515c-42a2-a73b-7bb994e8b7f0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:23.108835 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f8a33e26-515c-42a2-a73b-7bb994e8b7f0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:23.229469 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-f8a33e26-515c-42a2-a73b-7bb994e8b7f0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:23.236900 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-f8a33e26-515c-42a2-a73b-7bb994e8b7f0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.140327 Aug 25 05:45:23.237452 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 768/1563] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:23 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:23.775790 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a711365c-3b8a-4fd9-96df-a505c154d1b5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:23.776693 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a711365c-3b8a-4fd9-96df-a505c154d1b5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:23.783752 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a711365c-3b8a-4fd9-96df-a505c154d1b5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:23.784195 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a711365c-3b8a-4fd9-96df-a505c154d1b5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:23.784954 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a711365c-3b8a-4fd9-96df-a505c154d1b5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:23.785381 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a711365c-3b8a-4fd9-96df-a505c154d1b5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:23.819269 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a711365c-3b8a-4fd9-96df-a505c154d1b5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047360 Aug 25 05:45:23.819847 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 796/1564] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:23 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:24.254358 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-13f8a12f-4c79-41b6-b61e-4f954078b287 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:24.254931 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-13f8a12f-4c79-41b6-b61e-4f954078b287 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:24.260706 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-13f8a12f-4c79-41b6-b61e-4f954078b287 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:24.261148 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-13f8a12f-4c79-41b6-b61e-4f954078b287 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:24.261958 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-13f8a12f-4c79-41b6-b61e-4f954078b287 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:24.262387 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-13f8a12f-4c79-41b6-b61e-4f954078b287 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:24.382676 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-13f8a12f-4c79-41b6-b61e-4f954078b287 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:24.389884 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-13f8a12f-4c79-41b6-b61e-4f954078b287 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.139370 Aug 25 05:45:24.390441 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 769/1565] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:24 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:24.833540 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ecfad9fb-feac-4e81-b7e4-d2b99cd8807f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:24.835122 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ecfad9fb-feac-4e81-b7e4-d2b99cd8807f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:24.843554 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ecfad9fb-feac-4e81-b7e4-d2b99cd8807f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:24.844007 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ecfad9fb-feac-4e81-b7e4-d2b99cd8807f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:24.844798 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ecfad9fb-feac-4e81-b7e4-d2b99cd8807f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:24.845936 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ecfad9fb-feac-4e81-b7e4-d2b99cd8807f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:24.879572 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ecfad9fb-feac-4e81-b7e4-d2b99cd8807f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052031 Aug 25 05:45:24.880059 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 797/1566] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:24 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:25.406977 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-86ac5c8e-0f96-4a84-b59d-c7f68b449269 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:25.407570 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-86ac5c8e-0f96-4a84-b59d-c7f68b449269 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:25.413438 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-86ac5c8e-0f96-4a84-b59d-c7f68b449269 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:25.413916 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-86ac5c8e-0f96-4a84-b59d-c7f68b449269 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:25.414682 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-86ac5c8e-0f96-4a84-b59d-c7f68b449269 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:25.415116 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-86ac5c8e-0f96-4a84-b59d-c7f68b449269 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:25.540894 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-86ac5c8e-0f96-4a84-b59d-c7f68b449269 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:25.549791 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-86ac5c8e-0f96-4a84-b59d-c7f68b449269 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.146485 Aug 25 05:45:25.550381 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 770/1567] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:25 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:25.891621 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7766e2b0-72b2-4732-bb18-de5c28b68fd5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:25.892563 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-7766e2b0-72b2-4732-bb18-de5c28b68fd5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:25.898809 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7766e2b0-72b2-4732-bb18-de5c28b68fd5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:25.899225 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7766e2b0-72b2-4732-bb18-de5c28b68fd5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:25.900005 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7766e2b0-72b2-4732-bb18-de5c28b68fd5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:25.900474 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7766e2b0-72b2-4732-bb18-de5c28b68fd5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:25.930110 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-7766e2b0-72b2-4732-bb18-de5c28b68fd5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042973 Aug 25 05:45:25.930859 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 798/1568] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:25 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:26.567630 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-2bcc6ee5-6379-41cb-a203-5964d50a7b26 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:26.568242 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-2bcc6ee5-6379-41cb-a203-5964d50a7b26 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:26.574182 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2bcc6ee5-6379-41cb-a203-5964d50a7b26 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:26.574625 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2bcc6ee5-6379-41cb-a203-5964d50a7b26 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:26.575394 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2bcc6ee5-6379-41cb-a203-5964d50a7b26 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:26.575894 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2bcc6ee5-6379-41cb-a203-5964d50a7b26 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:26.705322 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-2bcc6ee5-6379-41cb-a203-5964d50a7b26 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:26.712643 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-2bcc6ee5-6379-41cb-a203-5964d50a7b26 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.148768 Aug 25 05:45:26.713211 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 771/1569] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:26 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:26.941987 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-8e4f1935-9035-4495-b3b0-f4a26fc03950 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:26.942879 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-8e4f1935-9035-4495-b3b0-f4a26fc03950 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:26.948607 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8e4f1935-9035-4495-b3b0-f4a26fc03950 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:26.949040 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8e4f1935-9035-4495-b3b0-f4a26fc03950 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:26.949841 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8e4f1935-9035-4495-b3b0-f4a26fc03950 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:26.950259 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8e4f1935-9035-4495-b3b0-f4a26fc03950 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:26.982237 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-8e4f1935-9035-4495-b3b0-f4a26fc03950 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043929 Aug 25 05:45:26.982891 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 799/1570] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:26 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:27.729834 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d0c8458d-c300-4db8-ad82-77977663d09a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:27.730488 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-d0c8458d-c300-4db8-ad82-77977663d09a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:27.736807 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d0c8458d-c300-4db8-ad82-77977663d09a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:27.737250 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d0c8458d-c300-4db8-ad82-77977663d09a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:27.738045 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d0c8458d-c300-4db8-ad82-77977663d09a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:27.738475 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d0c8458d-c300-4db8-ad82-77977663d09a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:27.860148 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-d0c8458d-c300-4db8-ad82-77977663d09a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:27.869334 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d0c8458d-c300-4db8-ad82-77977663d09a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.142960 Aug 25 05:45:27.870061 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 772/1571] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:27 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:27.994299 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-12ee4459-a951-48fe-9467-2ba484e2e1e5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:27.995208 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-12ee4459-a951-48fe-9467-2ba484e2e1e5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:28.002177 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-12ee4459-a951-48fe-9467-2ba484e2e1e5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:28.002620 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-12ee4459-a951-48fe-9467-2ba484e2e1e5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:28.003386 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-12ee4459-a951-48fe-9467-2ba484e2e1e5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:28.003970 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-12ee4459-a951-48fe-9467-2ba484e2e1e5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:28.034192 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-12ee4459-a951-48fe-9467-2ba484e2e1e5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043884 Aug 25 05:45:28.034743 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 800/1572] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:27 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:28.897031 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-2793ea5d-5ecc-464b-9da2-10c78f294768 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:28.897666 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-2793ea5d-5ecc-464b-9da2-10c78f294768 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:28.903828 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2793ea5d-5ecc-464b-9da2-10c78f294768 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:28.904309 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2793ea5d-5ecc-464b-9da2-10c78f294768 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:28.905155 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2793ea5d-5ecc-464b-9da2-10c78f294768 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:28.905610 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2793ea5d-5ecc-464b-9da2-10c78f294768 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:29.036138 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-2793ea5d-5ecc-464b-9da2-10c78f294768 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:29.043750 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-2793ea5d-5ecc-464b-9da2-10c78f294768 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.150290 Aug 25 05:45:29.044565 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 773/1573] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:28 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:45:29.046000 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-507cabcf-d5b9-4360-876a-e5876d0fab7b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:29.046917 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-507cabcf-d5b9-4360-876a-e5876d0fab7b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:29.052741 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-507cabcf-d5b9-4360-876a-e5876d0fab7b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:29.053176 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-507cabcf-d5b9-4360-876a-e5876d0fab7b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:29.054050 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-507cabcf-d5b9-4360-876a-e5876d0fab7b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:29.054479 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-507cabcf-d5b9-4360-876a-e5876d0fab7b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:29.084982 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-507cabcf-d5b9-4360-876a-e5876d0fab7b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043078 Aug 25 05:45:29.085467 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 801/1574] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:29 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:30.061768 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6a8d984f-f0a7-485d-9957-e26e4f85694c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:30.062383 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6a8d984f-f0a7-485d-9957-e26e4f85694c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:30.068179 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6a8d984f-f0a7-485d-9957-e26e4f85694c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:30.068630 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6a8d984f-f0a7-485d-9957-e26e4f85694c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:30.069387 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6a8d984f-f0a7-485d-9957-e26e4f85694c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:30.069849 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6a8d984f-f0a7-485d-9957-e26e4f85694c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:30.095719 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-13625591-85f2-43ee-9108-5a0aeecd44aa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:30.096632 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-13625591-85f2-43ee-9108-5a0aeecd44aa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:30.102583 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-13625591-85f2-43ee-9108-5a0aeecd44aa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:30.103027 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-13625591-85f2-43ee-9108-5a0aeecd44aa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:30.103844 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-13625591-85f2-43ee-9108-5a0aeecd44aa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:30.104473 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-13625591-85f2-43ee-9108-5a0aeecd44aa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:30.133913 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-13625591-85f2-43ee-9108-5a0aeecd44aa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042537 Aug 25 05:45:30.137939 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 802/1575] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:30 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:45:30.195874 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6a8d984f-f0a7-485d-9957-e26e4f85694c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:30.204252 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6a8d984f-f0a7-485d-9957-e26e4f85694c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.146817 Aug 25 05:45:30.204832 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 774/1576] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:30 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:31.145639 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-748d97d1-c0a0-472a-b229-d8d3de440440 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:31.146540 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-748d97d1-c0a0-472a-b229-d8d3de440440 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:31.152594 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-748d97d1-c0a0-472a-b229-d8d3de440440 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:31.153035 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-748d97d1-c0a0-472a-b229-d8d3de440440 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:31.154050 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-748d97d1-c0a0-472a-b229-d8d3de440440 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:31.154316 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-748d97d1-c0a0-472a-b229-d8d3de440440 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:31.184373 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-748d97d1-c0a0-472a-b229-d8d3de440440 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042473 Aug 25 05:45:31.184927 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 803/1577] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:31 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:31.220648 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b1aa37df-f363-4a3a-aff5-88c15572db17 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:31.221426 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b1aa37df-f363-4a3a-aff5-88c15572db17 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:31.227619 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b1aa37df-f363-4a3a-aff5-88c15572db17 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:31.228183 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b1aa37df-f363-4a3a-aff5-88c15572db17 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:31.229003 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b1aa37df-f363-4a3a-aff5-88c15572db17 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:31.229452 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b1aa37df-f363-4a3a-aff5-88c15572db17 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:31.355311 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-b1aa37df-f363-4a3a-aff5-88c15572db17 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:31.363384 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b1aa37df-f363-4a3a-aff5-88c15572db17 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.147053 Aug 25 05:45:31.363942 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 775/1578] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:31 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:32.195731 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-75dda733-85e2-4d0f-baae-ceef155627fb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:32.196677 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-75dda733-85e2-4d0f-baae-ceef155627fb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:32.202320 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-75dda733-85e2-4d0f-baae-ceef155627fb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:32.202866 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-75dda733-85e2-4d0f-baae-ceef155627fb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:32.203730 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-75dda733-85e2-4d0f-baae-ceef155627fb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:32.204152 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-75dda733-85e2-4d0f-baae-ceef155627fb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:32.233854 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-75dda733-85e2-4d0f-baae-ceef155627fb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041750 Aug 25 05:45:32.235270 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 804/1579] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:32 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:32.380825 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ceabd3eb-621b-4746-b7e3-1988fe541c90 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:32.381416 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ceabd3eb-621b-4746-b7e3-1988fe541c90 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:32.387300 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ceabd3eb-621b-4746-b7e3-1988fe541c90 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:32.387738 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ceabd3eb-621b-4746-b7e3-1988fe541c90 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:32.388618 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ceabd3eb-621b-4746-b7e3-1988fe541c90 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:32.389038 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ceabd3eb-621b-4746-b7e3-1988fe541c90 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:32.513721 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ceabd3eb-621b-4746-b7e3-1988fe541c90 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:32.521417 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ceabd3eb-621b-4746-b7e3-1988fe541c90 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.144251 Aug 25 05:45:32.522008 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 776/1580] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:32 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:33.246086 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d8ca4afe-716c-427e-8fc9-75dea7ade537 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:33.246962 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d8ca4afe-716c-427e-8fc9-75dea7ade537 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:33.252934 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d8ca4afe-716c-427e-8fc9-75dea7ade537 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:33.253366 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d8ca4afe-716c-427e-8fc9-75dea7ade537 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:33.254176 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d8ca4afe-716c-427e-8fc9-75dea7ade537 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:33.254711 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d8ca4afe-716c-427e-8fc9-75dea7ade537 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:33.289391 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d8ca4afe-716c-427e-8fc9-75dea7ade537 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047018 Aug 25 05:45:33.289984 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 805/1581] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:33 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:33.538459 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5b439dfa-2e11-4943-b5c4-162e248f675e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:33.539091 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5b439dfa-2e11-4943-b5c4-162e248f675e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:33.544758 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5b439dfa-2e11-4943-b5c4-162e248f675e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:33.545201 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5b439dfa-2e11-4943-b5c4-162e248f675e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:33.545981 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5b439dfa-2e11-4943-b5c4-162e248f675e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:33.546448 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5b439dfa-2e11-4943-b5c4-162e248f675e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:33.680647 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-5b439dfa-2e11-4943-b5c4-162e248f675e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:33.689255 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5b439dfa-2e11-4943-b5c4-162e248f675e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.154416 Aug 25 05:45:33.690172 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 777/1582] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:33 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:45:34.300539 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2801c6b9-2dc3-43a8-92ad-c6f0ae10d70a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:34.301455 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2801c6b9-2dc3-43a8-92ad-c6f0ae10d70a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:34.307551 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2801c6b9-2dc3-43a8-92ad-c6f0ae10d70a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:34.307971 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2801c6b9-2dc3-43a8-92ad-c6f0ae10d70a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:34.308742 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2801c6b9-2dc3-43a8-92ad-c6f0ae10d70a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:34.309171 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2801c6b9-2dc3-43a8-92ad-c6f0ae10d70a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:34.340384 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2801c6b9-2dc3-43a8-92ad-c6f0ae10d70a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043847 Aug 25 05:45:34.340952 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 806/1583] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:34 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:34.706481 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-626b26bd-b5d5-4ccf-b48f-ed80d6cd41f6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:34.707170 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-626b26bd-b5d5-4ccf-b48f-ed80d6cd41f6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:34.712954 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-626b26bd-b5d5-4ccf-b48f-ed80d6cd41f6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:34.713393 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-626b26bd-b5d5-4ccf-b48f-ed80d6cd41f6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:34.716922 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-626b26bd-b5d5-4ccf-b48f-ed80d6cd41f6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:34.716922 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-626b26bd-b5d5-4ccf-b48f-ed80d6cd41f6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:34.839529 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-626b26bd-b5d5-4ccf-b48f-ed80d6cd41f6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:34.848003 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-626b26bd-b5d5-4ccf-b48f-ed80d6cd41f6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.145694 Aug 25 05:45:34.848568 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 778/1584] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:34 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:35.352044 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-746306e7-8948-4a7d-b266-63422c45999d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:35.352974 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-746306e7-8948-4a7d-b266-63422c45999d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:35.359368 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-746306e7-8948-4a7d-b266-63422c45999d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:35.359815 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-746306e7-8948-4a7d-b266-63422c45999d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:35.360562 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-746306e7-8948-4a7d-b266-63422c45999d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:35.360997 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-746306e7-8948-4a7d-b266-63422c45999d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:35.389647 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-746306e7-8948-4a7d-b266-63422c45999d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041275 Aug 25 05:45:35.390202 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 807/1585] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:35 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:35.865143 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-51708092-4539-4232-be56-097e4a93acd6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:35.865768 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-51708092-4539-4232-be56-097e4a93acd6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:35.868079 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4945947b-868a-4594-a167-64b475d876a3] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 25 05:45:35.872529 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-51708092-4539-4232-be56-097e4a93acd6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:35.872972 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-51708092-4539-4232-be56-097e4a93acd6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:35.873755 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-51708092-4539-4232-be56-097e4a93acd6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:35.874179 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-51708092-4539-4232-be56-097e4a93acd6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:35.999868 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-51708092-4539-4232-be56-097e4a93acd6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:36.007118 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-51708092-4539-4232-be56-097e4a93acd6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.145669 Aug 25 05:45:36.007670 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 779/1586] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:35 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:36.400419 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-03d02b58-ba3e-4ebe-a1f6-f714c433fdc1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:36.401316 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-03d02b58-ba3e-4ebe-a1f6-f714c433fdc1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:36.407520 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-03d02b58-ba3e-4ebe-a1f6-f714c433fdc1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:36.407961 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-03d02b58-ba3e-4ebe-a1f6-f714c433fdc1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:36.408721 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-03d02b58-ba3e-4ebe-a1f6-f714c433fdc1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:36.409151 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-03d02b58-ba3e-4ebe-a1f6-f714c433fdc1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:36.438041 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-03d02b58-ba3e-4ebe-a1f6-f714c433fdc1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040881 Aug 25 05:45:36.438691 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 808/1587] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:36 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:37.024384 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-284e8ba6-b876-40f2-8d19-c5411b0a96ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:37.025150 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-284e8ba6-b876-40f2-8d19-c5411b0a96ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:37.050229 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-284e8ba6-b876-40f2-8d19-c5411b0a96ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:37.050663 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-284e8ba6-b876-40f2-8d19-c5411b0a96ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:37.051438 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-284e8ba6-b876-40f2-8d19-c5411b0a96ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:37.051869 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-284e8ba6-b876-40f2-8d19-c5411b0a96ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:37.052505 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [-] [4945947b-868a-4594-a167-64b475d876a3] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 37356. Aug 25 05:45:37.185111 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-284e8ba6-b876-40f2-8d19-c5411b0a96ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:37.194720 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-284e8ba6-b876-40f2-8d19-c5411b0a96ec tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.174215 Aug 25 05:45:37.195295 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 780/1588] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:37 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:37.449606 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-77488853-f3e0-41f7-83ec-61ae3ba38cdb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:37.450526 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-77488853-f3e0-41f7-83ec-61ae3ba38cdb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:37.456877 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-77488853-f3e0-41f7-83ec-61ae3ba38cdb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:37.457312 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-77488853-f3e0-41f7-83ec-61ae3ba38cdb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:37.458113 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-77488853-f3e0-41f7-83ec-61ae3ba38cdb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:37.458544 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-77488853-f3e0-41f7-83ec-61ae3ba38cdb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:37.487804 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-77488853-f3e0-41f7-83ec-61ae3ba38cdb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042087 Aug 25 05:45:37.488356 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 809/1589] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:37 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:38.211514 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5f37cb75-abf2-4463-898e-62963303b11b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:38.212126 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5f37cb75-abf2-4463-898e-62963303b11b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:38.218009 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5f37cb75-abf2-4463-898e-62963303b11b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:38.219071 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5f37cb75-abf2-4463-898e-62963303b11b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:38.219916 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5f37cb75-abf2-4463-898e-62963303b11b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:38.220341 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5f37cb75-abf2-4463-898e-62963303b11b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:38.339559 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-5f37cb75-abf2-4463-898e-62963303b11b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:38.347399 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5f37cb75-abf2-4463-898e-62963303b11b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.139529 Aug 25 05:45:38.347960 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 781/1590] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:38 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:38.499105 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c0078413-9f90-487f-81d1-32d6d8a1e8be tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:38.500122 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c0078413-9f90-487f-81d1-32d6d8a1e8be tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:38.505793 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c0078413-9f90-487f-81d1-32d6d8a1e8be tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:38.506234 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c0078413-9f90-487f-81d1-32d6d8a1e8be tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:38.506995 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c0078413-9f90-487f-81d1-32d6d8a1e8be tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:38.507455 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c0078413-9f90-487f-81d1-32d6d8a1e8be tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:38.537995 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c0078413-9f90-487f-81d1-32d6d8a1e8be tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042559 Aug 25 05:45:38.538556 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 810/1591] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:38 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:39.364560 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3fc064f0-4f2f-486c-8b71-c3688859c57c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:39.365142 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3fc064f0-4f2f-486c-8b71-c3688859c57c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:39.370968 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3fc064f0-4f2f-486c-8b71-c3688859c57c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:39.371402 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3fc064f0-4f2f-486c-8b71-c3688859c57c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:39.372154 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3fc064f0-4f2f-486c-8b71-c3688859c57c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:39.372572 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3fc064f0-4f2f-486c-8b71-c3688859c57c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:39.497141 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-3fc064f0-4f2f-486c-8b71-c3688859c57c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:39.504388 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3fc064f0-4f2f-486c-8b71-c3688859c57c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.143538 Aug 25 05:45:39.504937 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 782/1592] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:39 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:39.549447 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-cb1b81b8-4387-4360-b062-c7fdb905f3b0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:39.551527 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-cb1b81b8-4387-4360-b062-c7fdb905f3b0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:39.557174 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cb1b81b8-4387-4360-b062-c7fdb905f3b0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:39.557835 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cb1b81b8-4387-4360-b062-c7fdb905f3b0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:39.558616 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cb1b81b8-4387-4360-b062-c7fdb905f3b0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:39.559030 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cb1b81b8-4387-4360-b062-c7fdb905f3b0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:39.589362 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-cb1b81b8-4387-4360-b062-c7fdb905f3b0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044790 Aug 25 05:45:39.590029 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 811/1593] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:39 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:40.521873 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d4323183-bcb4-48a3-9d94-6abab66bdec5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:40.522490 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-d4323183-bcb4-48a3-9d94-6abab66bdec5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:40.528518 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d4323183-bcb4-48a3-9d94-6abab66bdec5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:40.528959 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d4323183-bcb4-48a3-9d94-6abab66bdec5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:40.529770 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d4323183-bcb4-48a3-9d94-6abab66bdec5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:40.530197 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d4323183-bcb4-48a3-9d94-6abab66bdec5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:40.600578 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5660d44b-d64c-4ede-9145-5e02f4782026 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:40.601487 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5660d44b-d64c-4ede-9145-5e02f4782026 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:40.607166 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5660d44b-d64c-4ede-9145-5e02f4782026 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:40.607612 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5660d44b-d64c-4ede-9145-5e02f4782026 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:40.608383 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5660d44b-d64c-4ede-9145-5e02f4782026 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:40.608837 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5660d44b-d64c-4ede-9145-5e02f4782026 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:40.637695 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5660d44b-d64c-4ede-9145-5e02f4782026 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040806 Aug 25 05:45:40.638391 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 812/1594] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:40 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:45:40.664214 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-d4323183-bcb4-48a3-9d94-6abab66bdec5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:40.671508 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d4323183-bcb4-48a3-9d94-6abab66bdec5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.153269 Aug 25 05:45:40.672315 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 783/1595] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:40 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:41.649200 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-433d6dac-a88f-4fda-bd9c-5171975695a1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:41.650140 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-433d6dac-a88f-4fda-bd9c-5171975695a1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:41.655957 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-433d6dac-a88f-4fda-bd9c-5171975695a1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:41.656397 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-433d6dac-a88f-4fda-bd9c-5171975695a1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:41.657178 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-433d6dac-a88f-4fda-bd9c-5171975695a1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:41.657635 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-433d6dac-a88f-4fda-bd9c-5171975695a1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:41.685393 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-433d6dac-a88f-4fda-bd9c-5171975695a1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040129 Aug 25 05:45:41.685981 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 813/1596] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:41 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:41.688432 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a8d62304-4932-47b5-a16f-a8bb7219c772 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:41.689189 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a8d62304-4932-47b5-a16f-a8bb7219c772 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:41.695043 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a8d62304-4932-47b5-a16f-a8bb7219c772 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:41.695486 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a8d62304-4932-47b5-a16f-a8bb7219c772 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:41.696240 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a8d62304-4932-47b5-a16f-a8bb7219c772 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:41.696675 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a8d62304-4932-47b5-a16f-a8bb7219c772 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:42.025508 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-a8d62304-4932-47b5-a16f-a8bb7219c772 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:42.033156 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a8d62304-4932-47b5-a16f-a8bb7219c772 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.348906 Aug 25 05:45:42.033750 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 784/1597] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:41 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:45:42.697111 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-8ebaf116-eeaf-4027-99ee-bcbfecae2423 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:42.698037 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-8ebaf116-eeaf-4027-99ee-bcbfecae2423 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:42.704071 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8ebaf116-eeaf-4027-99ee-bcbfecae2423 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:42.704509 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8ebaf116-eeaf-4027-99ee-bcbfecae2423 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:42.705268 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8ebaf116-eeaf-4027-99ee-bcbfecae2423 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:42.705731 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8ebaf116-eeaf-4027-99ee-bcbfecae2423 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:42.733397 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-8ebaf116-eeaf-4027-99ee-bcbfecae2423 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040054 Aug 25 05:45:42.733963 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 814/1598] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:42 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:43.050936 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5a4bfbd2-08b8-4ac8-932a-e09483d738ba tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:43.051454 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5a4bfbd2-08b8-4ac8-932a-e09483d738ba tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:43.057158 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5a4bfbd2-08b8-4ac8-932a-e09483d738ba tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:43.057638 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5a4bfbd2-08b8-4ac8-932a-e09483d738ba tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:43.058397 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5a4bfbd2-08b8-4ac8-932a-e09483d738ba tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:43.058826 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5a4bfbd2-08b8-4ac8-932a-e09483d738ba tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:43.184281 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-5a4bfbd2-08b8-4ac8-932a-e09483d738ba tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:43.191428 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5a4bfbd2-08b8-4ac8-932a-e09483d738ba tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.145475 Aug 25 05:45:43.191978 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 785/1599] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:43 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:43.745408 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1fd352e8-7532-4797-8552-700a99f39789 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:43.746324 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1fd352e8-7532-4797-8552-700a99f39789 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:43.752480 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1fd352e8-7532-4797-8552-700a99f39789 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:43.752922 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1fd352e8-7532-4797-8552-700a99f39789 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:43.753789 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1fd352e8-7532-4797-8552-700a99f39789 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:43.754223 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1fd352e8-7532-4797-8552-700a99f39789 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:43.783840 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1fd352e8-7532-4797-8552-700a99f39789 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042153 Aug 25 05:45:43.784378 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 815/1600] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:43 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:44.208481 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a24cee36-30c7-40ca-84d6-f80978d94f38 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:44.209032 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a24cee36-30c7-40ca-84d6-f80978d94f38 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:44.214744 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a24cee36-30c7-40ca-84d6-f80978d94f38 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:44.215181 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a24cee36-30c7-40ca-84d6-f80978d94f38 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:44.215925 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a24cee36-30c7-40ca-84d6-f80978d94f38 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:44.216347 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a24cee36-30c7-40ca-84d6-f80978d94f38 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:44.334280 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-a24cee36-30c7-40ca-84d6-f80978d94f38 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:44.341394 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a24cee36-30c7-40ca-84d6-f80978d94f38 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.136695 Aug 25 05:45:44.341979 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 786/1601] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:44 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:44.795295 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-bc8ddd47-e390-4747-8a4a-9e3424873060 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:44.796120 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-bc8ddd47-e390-4747-8a4a-9e3424873060 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:44.802625 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bc8ddd47-e390-4747-8a4a-9e3424873060 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:44.803068 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bc8ddd47-e390-4747-8a4a-9e3424873060 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:44.803953 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bc8ddd47-e390-4747-8a4a-9e3424873060 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:44.804385 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bc8ddd47-e390-4747-8a4a-9e3424873060 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:44.832646 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-bc8ddd47-e390-4747-8a4a-9e3424873060 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041406 Aug 25 05:45:44.833192 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 816/1602] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:44 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:44.939527 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 05:45:44.939708 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: Wed Aug 25 05:45:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 05:45:45.358954 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-f427b958-b372-48b9-98f1-1200a5ecaa58 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:45.359615 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-f427b958-b372-48b9-98f1-1200a5ecaa58 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:45.365863 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f427b958-b372-48b9-98f1-1200a5ecaa58 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:45.366311 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f427b958-b372-48b9-98f1-1200a5ecaa58 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:45.367106 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f427b958-b372-48b9-98f1-1200a5ecaa58 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:45.367540 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f427b958-b372-48b9-98f1-1200a5ecaa58 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:45.486017 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-f427b958-b372-48b9-98f1-1200a5ecaa58 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:45.493303 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-f427b958-b372-48b9-98f1-1200a5ecaa58 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.138054 Aug 25 05:45:45.493897 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 787/1603] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:45 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:45.844233 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2bdf8331-c8d7-4546-af6b-8ec6770c4ab2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:45.845967 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2bdf8331-c8d7-4546-af6b-8ec6770c4ab2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:45.851991 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2bdf8331-c8d7-4546-af6b-8ec6770c4ab2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:45.852431 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2bdf8331-c8d7-4546-af6b-8ec6770c4ab2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:45.853186 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2bdf8331-c8d7-4546-af6b-8ec6770c4ab2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:45.853657 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2bdf8331-c8d7-4546-af6b-8ec6770c4ab2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:45.881801 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2bdf8331-c8d7-4546-af6b-8ec6770c4ab2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041479 Aug 25 05:45:45.882342 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 817/1604] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:45 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:46.509727 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-f3fd781a-eaad-40e1-972c-daa11dd0c7d8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:46.510269 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-f3fd781a-eaad-40e1-972c-daa11dd0c7d8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:46.516200 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f3fd781a-eaad-40e1-972c-daa11dd0c7d8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:46.516640 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f3fd781a-eaad-40e1-972c-daa11dd0c7d8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:46.517464 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f3fd781a-eaad-40e1-972c-daa11dd0c7d8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:46.517920 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f3fd781a-eaad-40e1-972c-daa11dd0c7d8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:46.640376 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-f3fd781a-eaad-40e1-972c-daa11dd0c7d8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:46.648108 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-f3fd781a-eaad-40e1-972c-daa11dd0c7d8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.142080 Aug 25 05:45:46.648920 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 788/1605] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:46 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:46.893703 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-56ebf92f-1ffb-467b-b023-f32ee8a31662 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:46.894635 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-56ebf92f-1ffb-467b-b023-f32ee8a31662 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:46.900618 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-56ebf92f-1ffb-467b-b023-f32ee8a31662 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:46.901064 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-56ebf92f-1ffb-467b-b023-f32ee8a31662 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:46.901845 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-56ebf92f-1ffb-467b-b023-f32ee8a31662 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:46.902274 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-56ebf92f-1ffb-467b-b023-f32ee8a31662 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:46.930324 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-56ebf92f-1ffb-467b-b023-f32ee8a31662 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040934 Aug 25 05:45:46.930866 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 818/1606] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:46 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:47.795377 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b4cd4118-57f0-462d-be6d-642347ab74da tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:47.795982 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b4cd4118-57f0-462d-be6d-642347ab74da tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:47.802373 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b4cd4118-57f0-462d-be6d-642347ab74da tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:47.802809 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b4cd4118-57f0-462d-be6d-642347ab74da tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:47.803558 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b4cd4118-57f0-462d-be6d-642347ab74da tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:47.804007 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b4cd4118-57f0-462d-be6d-642347ab74da tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:47.942625 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-0364b0c8-7931-45a6-9561-43fb40dd0322 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:47.943595 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-0364b0c8-7931-45a6-9561-43fb40dd0322 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:47.949679 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0364b0c8-7931-45a6-9561-43fb40dd0322 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:47.950121 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0364b0c8-7931-45a6-9561-43fb40dd0322 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:47.950894 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0364b0c8-7931-45a6-9561-43fb40dd0322 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:47.951324 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0364b0c8-7931-45a6-9561-43fb40dd0322 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:48.081897 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-b4cd4118-57f0-462d-be6d-642347ab74da tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:48.089683 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b4cd4118-57f0-462d-be6d-642347ab74da tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.427436 Aug 25 05:45:48.094770 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 789/1607] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:47 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:48.134766 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-0364b0c8-7931-45a6-9561-43fb40dd0322 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.196754 Aug 25 05:45:48.135315 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 819/1608] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:47 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:45:49.107253 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-710beb8c-44eb-4044-9728-b01a7d659a59 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:49.107969 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-710beb8c-44eb-4044-9728-b01a7d659a59 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:49.114831 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-710beb8c-44eb-4044-9728-b01a7d659a59 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:49.114831 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-710beb8c-44eb-4044-9728-b01a7d659a59 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:49.115484 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-710beb8c-44eb-4044-9728-b01a7d659a59 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:49.115906 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-710beb8c-44eb-4044-9728-b01a7d659a59 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:49.146459 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-8ad3d78e-e680-4a4c-a40b-02717a621a46 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:49.147576 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-8ad3d78e-e680-4a4c-a40b-02717a621a46 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:49.153564 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8ad3d78e-e680-4a4c-a40b-02717a621a46 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:49.154066 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8ad3d78e-e680-4a4c-a40b-02717a621a46 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:49.154833 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8ad3d78e-e680-4a4c-a40b-02717a621a46 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:49.155262 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8ad3d78e-e680-4a4c-a40b-02717a621a46 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:49.188007 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-8ad3d78e-e680-4a4c-a40b-02717a621a46 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046075 Aug 25 05:45:49.188703 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 820/1609] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:49 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:45:49.244965 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-710beb8c-44eb-4044-9728-b01a7d659a59 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:49.252856 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-710beb8c-44eb-4044-9728-b01a7d659a59 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.149150 Aug 25 05:45:49.253793 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 790/1610] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:49 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:50.199954 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-327b28d6-dc94-4ab1-80a2-0f714769ce75 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:50.200880 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-327b28d6-dc94-4ab1-80a2-0f714769ce75 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:50.207181 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-327b28d6-dc94-4ab1-80a2-0f714769ce75 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:50.207617 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-327b28d6-dc94-4ab1-80a2-0f714769ce75 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:50.208366 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-327b28d6-dc94-4ab1-80a2-0f714769ce75 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:50.208791 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-327b28d6-dc94-4ab1-80a2-0f714769ce75 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:50.238032 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-327b28d6-dc94-4ab1-80a2-0f714769ce75 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041715 Aug 25 05:45:50.238572 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 821/1611] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:50 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:50.273939 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c131a382-9436-4934-b91f-8deccef93c77 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:50.274701 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c131a382-9436-4934-b91f-8deccef93c77 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:50.280523 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c131a382-9436-4934-b91f-8deccef93c77 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:50.280971 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c131a382-9436-4934-b91f-8deccef93c77 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:50.281768 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c131a382-9436-4934-b91f-8deccef93c77 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:50.282203 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c131a382-9436-4934-b91f-8deccef93c77 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:50.405498 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-c131a382-9436-4934-b91f-8deccef93c77 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:50.412881 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c131a382-9436-4934-b91f-8deccef93c77 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.142846 Aug 25 05:45:50.413436 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 791/1612] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:50 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:51.249294 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-4f9acd96-10f6-48b7-b164-e8d42b96c52b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:51.250296 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-4f9acd96-10f6-48b7-b164-e8d42b96c52b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:51.256772 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4f9acd96-10f6-48b7-b164-e8d42b96c52b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:51.257218 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4f9acd96-10f6-48b7-b164-e8d42b96c52b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:51.258008 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4f9acd96-10f6-48b7-b164-e8d42b96c52b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:51.258436 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4f9acd96-10f6-48b7-b164-e8d42b96c52b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:51.290252 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-4f9acd96-10f6-48b7-b164-e8d42b96c52b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044645 Aug 25 05:45:51.290799 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 822/1613] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:51 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:51.429369 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-dab1906f-1b95-41a7-bc3d-bd7db7601e24 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:51.430028 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-dab1906f-1b95-41a7-bc3d-bd7db7601e24 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:51.435768 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dab1906f-1b95-41a7-bc3d-bd7db7601e24 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:51.436207 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dab1906f-1b95-41a7-bc3d-bd7db7601e24 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:51.436965 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dab1906f-1b95-41a7-bc3d-bd7db7601e24 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:51.437396 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dab1906f-1b95-41a7-bc3d-bd7db7601e24 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:51.558855 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-dab1906f-1b95-41a7-bc3d-bd7db7601e24 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:51.570242 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-dab1906f-1b95-41a7-bc3d-bd7db7601e24 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.144473 Aug 25 05:45:51.571929 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 792/1614] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:51 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:52.301081 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e6c959e6-6496-4920-9204-f75abed2a177 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:52.301995 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e6c959e6-6496-4920-9204-f75abed2a177 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:52.307584 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e6c959e6-6496-4920-9204-f75abed2a177 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:52.308018 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e6c959e6-6496-4920-9204-f75abed2a177 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:52.308763 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e6c959e6-6496-4920-9204-f75abed2a177 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:52.309183 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e6c959e6-6496-4920-9204-f75abed2a177 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:52.337547 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e6c959e6-6496-4920-9204-f75abed2a177 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040659 Aug 25 05:45:52.338087 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 823/1615] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:52 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:52.589383 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-224de723-310d-4eab-aa69-dc05b4133941 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:52.589937 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-224de723-310d-4eab-aa69-dc05b4133941 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:52.596520 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-224de723-310d-4eab-aa69-dc05b4133941 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:52.596972 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-224de723-310d-4eab-aa69-dc05b4133941 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:52.597819 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-224de723-310d-4eab-aa69-dc05b4133941 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:52.598286 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-224de723-310d-4eab-aa69-dc05b4133941 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:52.718233 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-224de723-310d-4eab-aa69-dc05b4133941 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:52.726235 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-224de723-310d-4eab-aa69-dc05b4133941 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.140674 Aug 25 05:45:52.726819 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 793/1616] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:52 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:53.348805 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-abbf5e39-9fba-4690-af29-744e19a3f9ca tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:53.349696 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-abbf5e39-9fba-4690-af29-744e19a3f9ca tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:53.351690 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: ERROR oslo.messaging._drivers.impl_rabbit [-] [024c7946-b47b-4a06-aa5e-7d5b6a13301d] AMQP server on 10.222.0.42:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 25 05:45:53.355945 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-abbf5e39-9fba-4690-af29-744e19a3f9ca tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:53.356382 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-abbf5e39-9fba-4690-af29-744e19a3f9ca tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:53.357138 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-abbf5e39-9fba-4690-af29-744e19a3f9ca tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:53.357599 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-abbf5e39-9fba-4690-af29-744e19a3f9ca tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:53.386700 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-abbf5e39-9fba-4690-af29-744e19a3f9ca tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041591 Aug 25 05:45:53.387243 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 824/1617] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:53 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:53.742835 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8bc7a816-10cf-4643-87e1-c95be163cf90 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:53.743364 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8bc7a816-10cf-4643-87e1-c95be163cf90 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:53.749056 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8bc7a816-10cf-4643-87e1-c95be163cf90 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:53.749495 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8bc7a816-10cf-4643-87e1-c95be163cf90 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:53.750288 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8bc7a816-10cf-4643-87e1-c95be163cf90 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:53.750710 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8bc7a816-10cf-4643-87e1-c95be163cf90 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:53.875056 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-8bc7a816-10cf-4643-87e1-c95be163cf90 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:53.883245 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8bc7a816-10cf-4643-87e1-c95be163cf90 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.144088 Aug 25 05:45:53.883809 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 794/1618] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:53 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:54.397982 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f402caaf-7b54-401d-aa40-94b37d72c131 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:54.399133 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f402caaf-7b54-401d-aa40-94b37d72c131 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:54.416548 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f402caaf-7b54-401d-aa40-94b37d72c131 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:54.417001 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f402caaf-7b54-401d-aa40-94b37d72c131 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:54.417795 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f402caaf-7b54-401d-aa40-94b37d72c131 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:54.418222 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f402caaf-7b54-401d-aa40-94b37d72c131 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:54.422973 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO oslo.messaging._drivers.impl_rabbit [-] [024c7946-b47b-4a06-aa5e-7d5b6a13301d] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 37500. Aug 25 05:45:54.449171 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f402caaf-7b54-401d-aa40-94b37d72c131 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054900 Aug 25 05:45:54.449748 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 825/1619] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:54 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:54.899865 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6092ba4e-cbdd-414c-be90-2545c1f111a4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:54.900499 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6092ba4e-cbdd-414c-be90-2545c1f111a4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:54.906283 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6092ba4e-cbdd-414c-be90-2545c1f111a4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:54.906722 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6092ba4e-cbdd-414c-be90-2545c1f111a4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:54.907468 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6092ba4e-cbdd-414c-be90-2545c1f111a4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:54.907892 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6092ba4e-cbdd-414c-be90-2545c1f111a4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:55.043207 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6092ba4e-cbdd-414c-be90-2545c1f111a4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:55.051289 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6092ba4e-cbdd-414c-be90-2545c1f111a4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.155354 Aug 25 05:45:55.051884 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 795/1620] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:54 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:55.461328 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-8ae2f807-3918-47de-aeb4-f11f25ce65c6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:55.462311 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-8ae2f807-3918-47de-aeb4-f11f25ce65c6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:55.468222 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8ae2f807-3918-47de-aeb4-f11f25ce65c6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:55.468663 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8ae2f807-3918-47de-aeb4-f11f25ce65c6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:55.469459 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8ae2f807-3918-47de-aeb4-f11f25ce65c6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:55.470142 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8ae2f807-3918-47de-aeb4-f11f25ce65c6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:55.499856 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-8ae2f807-3918-47de-aeb4-f11f25ce65c6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042329 Aug 25 05:45:55.500412 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 826/1621] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:55 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:56.068453 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3a180971-67b9-4d6e-ab27-a99f0c73f486 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:56.069069 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3a180971-67b9-4d6e-ab27-a99f0c73f486 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:56.075005 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3a180971-67b9-4d6e-ab27-a99f0c73f486 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:56.075452 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3a180971-67b9-4d6e-ab27-a99f0c73f486 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:56.076246 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3a180971-67b9-4d6e-ab27-a99f0c73f486 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:56.076682 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3a180971-67b9-4d6e-ab27-a99f0c73f486 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:56.195189 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-3a180971-67b9-4d6e-ab27-a99f0c73f486 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:56.202659 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3a180971-67b9-4d6e-ab27-a99f0c73f486 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.138530 Aug 25 05:45:56.203217 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 796/1622] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:56 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:56.511704 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-eaf240ae-792a-4ce2-b7e5-6e7377a592fc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:56.512618 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-eaf240ae-792a-4ce2-b7e5-6e7377a592fc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:56.518648 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-eaf240ae-792a-4ce2-b7e5-6e7377a592fc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:56.519086 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-eaf240ae-792a-4ce2-b7e5-6e7377a592fc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:56.519860 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-eaf240ae-792a-4ce2-b7e5-6e7377a592fc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:56.520288 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-eaf240ae-792a-4ce2-b7e5-6e7377a592fc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:56.550887 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-eaf240ae-792a-4ce2-b7e5-6e7377a592fc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042969 Aug 25 05:45:56.551439 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 827/1623] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:56 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:57.219349 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-13646e09-f5cb-4554-a0a5-0c12898b182a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:57.219943 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-13646e09-f5cb-4554-a0a5-0c12898b182a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:57.226854 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-13646e09-f5cb-4554-a0a5-0c12898b182a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:57.227304 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-13646e09-f5cb-4554-a0a5-0c12898b182a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:57.228164 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-13646e09-f5cb-4554-a0a5-0c12898b182a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:57.228513 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-13646e09-f5cb-4554-a0a5-0c12898b182a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:57.355936 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-13646e09-f5cb-4554-a0a5-0c12898b182a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:57.363547 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-13646e09-f5cb-4554-a0a5-0c12898b182a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.147872 Aug 25 05:45:57.364438 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 797/1624] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:57 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:45:57.562266 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6f126ad0-3da8-427b-9f41-2d5d0d225e1c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:57.563153 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6f126ad0-3da8-427b-9f41-2d5d0d225e1c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:57.569774 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6f126ad0-3da8-427b-9f41-2d5d0d225e1c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:57.570313 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6f126ad0-3da8-427b-9f41-2d5d0d225e1c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:57.571018 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6f126ad0-3da8-427b-9f41-2d5d0d225e1c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:57.571357 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6f126ad0-3da8-427b-9f41-2d5d0d225e1c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:57.602547 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6f126ad0-3da8-427b-9f41-2d5d0d225e1c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043989 Aug 25 05:45:57.603101 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 828/1625] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:57 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:58.380974 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-030bad44-8fb4-42dc-bec6-d69e03f4e392 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:58.381604 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-030bad44-8fb4-42dc-bec6-d69e03f4e392 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:58.387405 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-030bad44-8fb4-42dc-bec6-d69e03f4e392 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:58.387848 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-030bad44-8fb4-42dc-bec6-d69e03f4e392 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:58.388600 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-030bad44-8fb4-42dc-bec6-d69e03f4e392 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:58.389025 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-030bad44-8fb4-42dc-bec6-d69e03f4e392 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:58.508396 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-030bad44-8fb4-42dc-bec6-d69e03f4e392 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:58.515641 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-030bad44-8fb4-42dc-bec6-d69e03f4e392 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.139043 Aug 25 05:45:58.516191 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 798/1626] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:58 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:58.613961 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2cf6dba6-00da-4fed-9483-84c32740165b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:58.614909 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2cf6dba6-00da-4fed-9483-84c32740165b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:58.620752 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2cf6dba6-00da-4fed-9483-84c32740165b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:58.621194 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2cf6dba6-00da-4fed-9483-84c32740165b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:58.621991 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2cf6dba6-00da-4fed-9483-84c32740165b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:58.622421 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2cf6dba6-00da-4fed-9483-84c32740165b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:58.652361 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2cf6dba6-00da-4fed-9483-84c32740165b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042127 Aug 25 05:45:58.652907 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 829/1627] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:58 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:45:59.533159 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6c047157-fc76-4145-bb9b-d13f33420743 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:59.534318 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6c047157-fc76-4145-bb9b-d13f33420743 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:59.540400 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6c047157-fc76-4145-bb9b-d13f33420743 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:59.540845 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6c047157-fc76-4145-bb9b-d13f33420743 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:59.541649 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6c047157-fc76-4145-bb9b-d13f33420743 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:59.542081 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6c047157-fc76-4145-bb9b-d13f33420743 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:59.663958 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6c047157-fc76-4145-bb9b-d13f33420743 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:45:59.664127 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-111a9f8e-9d6b-46b2-83ed-585d9c34cd4b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:45:59.664946 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-111a9f8e-9d6b-46b2-83ed-585d9c34cd4b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:45:59.670681 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-111a9f8e-9d6b-46b2-83ed-585d9c34cd4b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:59.671118 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-111a9f8e-9d6b-46b2-83ed-585d9c34cd4b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:59.671428 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6c047157-fc76-4145-bb9b-d13f33420743 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.141991 Aug 25 05:45:59.671874 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-111a9f8e-9d6b-46b2-83ed-585d9c34cd4b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:45:59.674413 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 799/1628] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:45:59 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:45:59.675159 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-111a9f8e-9d6b-46b2-83ed-585d9c34cd4b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:45:59.702862 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-111a9f8e-9d6b-46b2-83ed-585d9c34cd4b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042599 Aug 25 05:45:59.703497 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 830/1629] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:45:59 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:46:00.688688 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-58f94909-a82f-4c98-8a50-a8b80cc61cbb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:00.689257 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-58f94909-a82f-4c98-8a50-a8b80cc61cbb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:00.695925 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-58f94909-a82f-4c98-8a50-a8b80cc61cbb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:00.696403 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-58f94909-a82f-4c98-8a50-a8b80cc61cbb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:00.697159 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-58f94909-a82f-4c98-8a50-a8b80cc61cbb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:00.697612 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-58f94909-a82f-4c98-8a50-a8b80cc61cbb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:00.714499 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9bc18afa-64cb-4762-a49d-9f5e2180bb89 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:00.715393 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9bc18afa-64cb-4762-a49d-9f5e2180bb89 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:00.720996 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9bc18afa-64cb-4762-a49d-9f5e2180bb89 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:00.721428 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9bc18afa-64cb-4762-a49d-9f5e2180bb89 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:00.722218 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9bc18afa-64cb-4762-a49d-9f5e2180bb89 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:00.722637 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9bc18afa-64cb-4762-a49d-9f5e2180bb89 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:00.753520 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9bc18afa-64cb-4762-a49d-9f5e2180bb89 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041923 Aug 25 05:46:00.754476 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 831/1630] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:00 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:46:00.822947 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-58f94909-a82f-4c98-8a50-a8b80cc61cbb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:00.830143 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-58f94909-a82f-4c98-8a50-a8b80cc61cbb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.145221 Aug 25 05:46:00.830936 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 800/1631] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:00 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:01.765030 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-059164eb-f828-4fb6-85e5-9e096a2af28a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:01.766050 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-059164eb-f828-4fb6-85e5-9e096a2af28a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:01.772563 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-059164eb-f828-4fb6-85e5-9e096a2af28a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:01.773004 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-059164eb-f828-4fb6-85e5-9e096a2af28a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:01.774059 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-059164eb-f828-4fb6-85e5-9e096a2af28a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:01.774488 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-059164eb-f828-4fb6-85e5-9e096a2af28a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:01.802703 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-059164eb-f828-4fb6-85e5-9e096a2af28a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041388 Aug 25 05:46:01.803264 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 832/1632] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:01 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:01.845672 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8c1c5e37-2f93-4aa8-8b22-d025fb4856a6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:01.846370 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8c1c5e37-2f93-4aa8-8b22-d025fb4856a6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:01.852032 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8c1c5e37-2f93-4aa8-8b22-d025fb4856a6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:01.852474 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8c1c5e37-2f93-4aa8-8b22-d025fb4856a6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:01.853244 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8c1c5e37-2f93-4aa8-8b22-d025fb4856a6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:01.853708 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8c1c5e37-2f93-4aa8-8b22-d025fb4856a6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:01.981391 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-8c1c5e37-2f93-4aa8-8b22-d025fb4856a6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:01.988938 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8c1c5e37-2f93-4aa8-8b22-d025fb4856a6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.146816 Aug 25 05:46:01.989494 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 801/1633] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:01 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:02.814406 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b956c859-f0b7-4d5e-bd7e-901fa0440acc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:02.815982 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b956c859-f0b7-4d5e-bd7e-901fa0440acc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:02.822198 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b956c859-f0b7-4d5e-bd7e-901fa0440acc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:02.825350 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b956c859-f0b7-4d5e-bd7e-901fa0440acc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:02.825350 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b956c859-f0b7-4d5e-bd7e-901fa0440acc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:02.825350 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b956c859-f0b7-4d5e-bd7e-901fa0440acc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:02.853338 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b956c859-f0b7-4d5e-bd7e-901fa0440acc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042955 Aug 25 05:46:02.854062 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 833/1634] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:02 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:03.005685 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-deb6d46b-5e23-4784-ab03-ad89b2c4c86b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:03.006284 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-deb6d46b-5e23-4784-ab03-ad89b2c4c86b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:03.011922 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-deb6d46b-5e23-4784-ab03-ad89b2c4c86b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:03.012373 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-deb6d46b-5e23-4784-ab03-ad89b2c4c86b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:03.013141 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-deb6d46b-5e23-4784-ab03-ad89b2c4c86b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:03.013712 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-deb6d46b-5e23-4784-ab03-ad89b2c4c86b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:03.134765 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-deb6d46b-5e23-4784-ab03-ad89b2c4c86b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:03.141909 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-deb6d46b-5e23-4784-ab03-ad89b2c4c86b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.140505 Aug 25 05:46:03.142456 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 802/1635] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:03 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:03.864766 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-eba0ab04-d801-4286-aed9-560323b717cc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:03.865601 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-eba0ab04-d801-4286-aed9-560323b717cc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:03.871421 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-eba0ab04-d801-4286-aed9-560323b717cc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:03.871943 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-eba0ab04-d801-4286-aed9-560323b717cc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:03.872706 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-eba0ab04-d801-4286-aed9-560323b717cc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:03.873136 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-eba0ab04-d801-4286-aed9-560323b717cc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:03.901958 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-eba0ab04-d801-4286-aed9-560323b717cc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041147 Aug 25 05:46:03.902500 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 834/1636] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:03 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:04.158767 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-792ac0de-eab2-49ae-8ac7-9d3ca2bb5019 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:04.159485 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-792ac0de-eab2-49ae-8ac7-9d3ca2bb5019 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:04.165267 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-792ac0de-eab2-49ae-8ac7-9d3ca2bb5019 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:04.165754 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-792ac0de-eab2-49ae-8ac7-9d3ca2bb5019 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:04.166511 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-792ac0de-eab2-49ae-8ac7-9d3ca2bb5019 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:04.166946 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-792ac0de-eab2-49ae-8ac7-9d3ca2bb5019 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:04.289208 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-792ac0de-eab2-49ae-8ac7-9d3ca2bb5019 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:04.296482 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-792ac0de-eab2-49ae-8ac7-9d3ca2bb5019 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1562 microversion: 2.1 time: 0.141418 Aug 25 05:46:04.297045 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 803/1637] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:04 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1562 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:46:04.914022 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e727f02c-9784-4ca4-aa5a-bbeb67baf11a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:04.915033 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e727f02c-9784-4ca4-aa5a-bbeb67baf11a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:04.920734 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e727f02c-9784-4ca4-aa5a-bbeb67baf11a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:04.921180 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e727f02c-9784-4ca4-aa5a-bbeb67baf11a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:04.921978 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e727f02c-9784-4ca4-aa5a-bbeb67baf11a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:04.922409 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e727f02c-9784-4ca4-aa5a-bbeb67baf11a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:04.952827 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e727f02c-9784-4ca4-aa5a-bbeb67baf11a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043211 Aug 25 05:46:04.953377 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 835/1638] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:04 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:05.302484 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b30f6760-8d02-4905-8196-d5209c84f5c7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:05.303004 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b30f6760-8d02-4905-8196-d5209c84f5c7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:05.309205 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b30f6760-8d02-4905-8196-d5209c84f5c7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:05.309683 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b30f6760-8d02-4905-8196-d5209c84f5c7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:05.310451 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b30f6760-8d02-4905-8196-d5209c84f5c7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:05.310881 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b30f6760-8d02-4905-8196-d5209c84f5c7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:05.337479 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b30f6760-8d02-4905-8196-d5209c84f5c7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Going to try to terminate instance {{(pid=108884) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 25 05:46:05.373292 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [req-96ea5d80-c01f-46cb-a1bb-27360f4d6392 req-dd243189-a72b-4870-90be-03a13a12b2cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30a141ef-390c-4d75-94ba-c3112c06bc39", "tag": "b5e81396-e117-425e-887b-37001fc73ed9"}]} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:46:05.376394 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:46:05.376394 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: warnings.warn(msg) Aug 25 05:46:05.385082 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-96ea5d80-c01f-46cb-a1bb-27360f4d6392 req-dd243189-a72b-4870-90be-03a13a12b2cc service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:05.385840 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-96ea5d80-c01f-46cb-a1bb-27360f4d6392 req-dd243189-a72b-4870-90be-03a13a12b2cc service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:05.403794 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.compute.server_external_events [req-96ea5d80-c01f-46cb-a1bb-27360f4d6392 req-dd243189-a72b-4870-90be-03a13a12b2cc service nova] Creating event network-changed:b5e81396-e117-425e-887b-37001fc73ed9 for instance 30a141ef-390c-4d75-94ba-c3112c06bc39 on hv-cinder-78662 Aug 25 05:46:05.403794 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [req-96ea5d80-c01f-46cb-a1bb-27360f4d6392 req-dd243189-a72b-4870-90be-03a13a12b2cc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102671 Aug 25 05:46:05.404362 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 836/1639] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:46:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:46:05.564473 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b30f6760-8d02-4905-8196-d5209c84f5c7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [7958d0e5-e618-4305-a46c-11538430253f] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 05:46:05.964902 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-30254181-1298-4933-b19e-93fccbc8074b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:05.965946 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-30254181-1298-4933-b19e-93fccbc8074b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:05.971898 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-30254181-1298-4933-b19e-93fccbc8074b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:05.972653 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-30254181-1298-4933-b19e-93fccbc8074b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:05.973423 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-30254181-1298-4933-b19e-93fccbc8074b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:05.973875 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-30254181-1298-4933-b19e-93fccbc8074b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:06.011256 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-30254181-1298-4933-b19e-93fccbc8074b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050562 Aug 25 05:46:06.012273 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 837/1640] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:05 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:46:06.581095 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [None req-b30f6760-8d02-4905-8196-d5209c84f5c7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [7958d0e5-e618-4305-a46c-11538430253f] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 37600. Aug 25 05:46:06.663785 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b30f6760-8d02-4905-8196-d5209c84f5c7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "DELETE /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 204 len: 0 microversion: 2.1 time: 1.365556 Aug 25 05:46:06.664366 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 804/1641] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 25 05:46:05 2021] DELETE /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 0 bytes in 1367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 05:46:06.672481 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1fc5417f-0ae8-4dc6-88b2-b4ef70191c21 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:06.673039 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1fc5417f-0ae8-4dc6-88b2-b4ef70191c21 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:06.679520 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1fc5417f-0ae8-4dc6-88b2-b4ef70191c21 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:06.679955 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1fc5417f-0ae8-4dc6-88b2-b4ef70191c21 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:06.681446 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1fc5417f-0ae8-4dc6-88b2-b4ef70191c21 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:06.681890 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1fc5417f-0ae8-4dc6-88b2-b4ef70191c21 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:06.809721 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-1fc5417f-0ae8-4dc6-88b2-b4ef70191c21 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:06.818209 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1fc5417f-0ae8-4dc6-88b2-b4ef70191c21 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1449 microversion: 2.1 time: 0.149344 Aug 25 05:46:06.818782 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 838/1642] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:06 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1449 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:07.026436 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c37e92b9-84d0-447b-ae54-07c3959ef4cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:07.028056 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c37e92b9-84d0-447b-ae54-07c3959ef4cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:07.033820 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c37e92b9-84d0-447b-ae54-07c3959ef4cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:07.034260 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c37e92b9-84d0-447b-ae54-07c3959ef4cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:07.035183 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c37e92b9-84d0-447b-ae54-07c3959ef4cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:07.035621 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c37e92b9-84d0-447b-ae54-07c3959ef4cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:07.066206 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c37e92b9-84d0-447b-ae54-07c3959ef4cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044243 Aug 25 05:46:07.066950 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 805/1643] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:07 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:07.496070 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [req-132ce88f-0c8b-4b9a-9a64-5fd568e28ac7 req-176fa74b-b10a-4180-b276-0529548d50ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30a141ef-390c-4d75-94ba-c3112c06bc39", "name": "network-vif-deleted", "tag": "b5e81396-e117-425e-887b-37001fc73ed9"}]} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:46:07.500810 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:46:07.500810 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: warnings.warn(msg) Aug 25 05:46:07.504719 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-132ce88f-0c8b-4b9a-9a64-5fd568e28ac7 req-176fa74b-b10a-4180-b276-0529548d50ca service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:07.505103 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-132ce88f-0c8b-4b9a-9a64-5fd568e28ac7 req-176fa74b-b10a-4180-b276-0529548d50ca service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:07.516760 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.compute.server_external_events [req-132ce88f-0c8b-4b9a-9a64-5fd568e28ac7 req-176fa74b-b10a-4180-b276-0529548d50ca service nova] Creating event network-vif-deleted:b5e81396-e117-425e-887b-37001fc73ed9 for instance 30a141ef-390c-4d75-94ba-c3112c06bc39 on hv-cinder-78662 Aug 25 05:46:07.523920 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [req-132ce88f-0c8b-4b9a-9a64-5fd568e28ac7 req-176fa74b-b10a-4180-b276-0529548d50ca service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088609 Aug 25 05:46:07.524587 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 839/1644] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:46:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:07.838305 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-0bdd3b07-2fbb-4daf-b4fd-0283e91b7c77 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:07.838943 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-0bdd3b07-2fbb-4daf-b4fd-0283e91b7c77 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:07.844682 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0bdd3b07-2fbb-4daf-b4fd-0283e91b7c77 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:07.845121 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0bdd3b07-2fbb-4daf-b4fd-0283e91b7c77 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:07.845908 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0bdd3b07-2fbb-4daf-b4fd-0283e91b7c77 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:07.846330 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0bdd3b07-2fbb-4daf-b4fd-0283e91b7c77 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:07.909582 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-0bdd3b07-2fbb-4daf-b4fd-0283e91b7c77 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:07.916946 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-0bdd3b07-2fbb-4daf-b4fd-0283e91b7c77 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.082209 Aug 25 05:46:07.917494 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 806/1645] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:07 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:08.078274 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-eb80c5ed-9943-4257-8b89-01ed7d3aaec7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:08.079273 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-eb80c5ed-9943-4257-8b89-01ed7d3aaec7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:08.086094 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-eb80c5ed-9943-4257-8b89-01ed7d3aaec7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:08.086542 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-eb80c5ed-9943-4257-8b89-01ed7d3aaec7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:08.087302 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-eb80c5ed-9943-4257-8b89-01ed7d3aaec7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:08.087733 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-eb80c5ed-9943-4257-8b89-01ed7d3aaec7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:08.116352 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-eb80c5ed-9943-4257-8b89-01ed7d3aaec7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042149 Aug 25 05:46:08.116902 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 840/1646] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:08 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:08.370495 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 05:46:08.370653 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: Wed Aug 25 05:46:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 05:46:08.933431 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6c408aa7-a3f4-498c-a8df-729ccdef0bfe tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:08.934115 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6c408aa7-a3f4-498c-a8df-729ccdef0bfe tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:08.940002 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6c408aa7-a3f4-498c-a8df-729ccdef0bfe tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:08.940446 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6c408aa7-a3f4-498c-a8df-729ccdef0bfe tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:08.941569 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6c408aa7-a3f4-498c-a8df-729ccdef0bfe tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:08.941997 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6c408aa7-a3f4-498c-a8df-729ccdef0bfe tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:09.000217 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6c408aa7-a3f4-498c-a8df-729ccdef0bfe tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:09.007540 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6c408aa7-a3f4-498c-a8df-729ccdef0bfe tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.077854 Aug 25 05:46:09.008092 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 807/1647] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:08 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:09.127774 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9e96235c-db67-42b2-9ffb-820f68b43b07 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:09.128613 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9e96235c-db67-42b2-9ffb-820f68b43b07 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:09.134356 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9e96235c-db67-42b2-9ffb-820f68b43b07 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:09.134791 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9e96235c-db67-42b2-9ffb-820f68b43b07 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:09.135544 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9e96235c-db67-42b2-9ffb-820f68b43b07 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:09.135970 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9e96235c-db67-42b2-9ffb-820f68b43b07 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:09.164789 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9e96235c-db67-42b2-9ffb-820f68b43b07 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040844 Aug 25 05:46:09.165326 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 841/1648] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:09 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:10.024427 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-37fb23ff-e3e8-4773-9766-d6400c642bef tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:10.025025 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-37fb23ff-e3e8-4773-9766-d6400c642bef tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:10.030807 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-37fb23ff-e3e8-4773-9766-d6400c642bef tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:10.031244 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-37fb23ff-e3e8-4773-9766-d6400c642bef tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:10.031990 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-37fb23ff-e3e8-4773-9766-d6400c642bef tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:10.032414 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-37fb23ff-e3e8-4773-9766-d6400c642bef tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:10.090084 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-37fb23ff-e3e8-4773-9766-d6400c642bef tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:10.097962 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-37fb23ff-e3e8-4773-9766-d6400c642bef tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.076771 Aug 25 05:46:10.098513 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 808/1649] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:10 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:10.176727 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f5976c7c-d08e-4132-b6b4-0e06d9a4ecfa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:10.177659 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f5976c7c-d08e-4132-b6b4-0e06d9a4ecfa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:10.183327 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f5976c7c-d08e-4132-b6b4-0e06d9a4ecfa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:10.183767 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f5976c7c-d08e-4132-b6b4-0e06d9a4ecfa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:10.184515 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f5976c7c-d08e-4132-b6b4-0e06d9a4ecfa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:10.184938 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f5976c7c-d08e-4132-b6b4-0e06d9a4ecfa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:10.212910 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f5976c7c-d08e-4132-b6b4-0e06d9a4ecfa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040596 Aug 25 05:46:10.213433 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 842/1650] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:10 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:46:11.114477 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3116920d-a6fa-4a39-aa14-d5014debfea6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:11.115072 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3116920d-a6fa-4a39-aa14-d5014debfea6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:11.120816 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3116920d-a6fa-4a39-aa14-d5014debfea6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:11.121249 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3116920d-a6fa-4a39-aa14-d5014debfea6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:11.122036 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3116920d-a6fa-4a39-aa14-d5014debfea6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:11.122460 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3116920d-a6fa-4a39-aa14-d5014debfea6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:11.180779 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-3116920d-a6fa-4a39-aa14-d5014debfea6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:11.187848 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3116920d-a6fa-4a39-aa14-d5014debfea6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.077327 Aug 25 05:46:11.188399 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 809/1651] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:11 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:46:11.224588 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6ddc4c1b-0b05-4907-8999-4cf2f4da1265 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:11.225488 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6ddc4c1b-0b05-4907-8999-4cf2f4da1265 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:11.231233 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6ddc4c1b-0b05-4907-8999-4cf2f4da1265 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:11.231675 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6ddc4c1b-0b05-4907-8999-4cf2f4da1265 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:11.232428 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6ddc4c1b-0b05-4907-8999-4cf2f4da1265 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:11.232870 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6ddc4c1b-0b05-4907-8999-4cf2f4da1265 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:11.261597 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6ddc4c1b-0b05-4907-8999-4cf2f4da1265 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041314 Aug 25 05:46:11.262136 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 843/1652] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:11 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:12.203969 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-bc909cbe-8741-40fe-a8b8-63629dfa7d6f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:12.204573 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-bc909cbe-8741-40fe-a8b8-63629dfa7d6f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:12.210623 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bc909cbe-8741-40fe-a8b8-63629dfa7d6f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:12.211069 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bc909cbe-8741-40fe-a8b8-63629dfa7d6f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:12.211825 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bc909cbe-8741-40fe-a8b8-63629dfa7d6f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:12.212252 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bc909cbe-8741-40fe-a8b8-63629dfa7d6f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:12.271403 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-bc909cbe-8741-40fe-a8b8-63629dfa7d6f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:12.272279 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6a79ee24-b87a-415f-8840-23dcbcd8db5b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:12.273209 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6a79ee24-b87a-415f-8840-23dcbcd8db5b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:12.279234 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-bc909cbe-8741-40fe-a8b8-63629dfa7d6f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.078878 Aug 25 05:46:12.279800 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 810/1653] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:12 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:12.280216 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6a79ee24-b87a-415f-8840-23dcbcd8db5b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:12.280740 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6a79ee24-b87a-415f-8840-23dcbcd8db5b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:12.281607 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6a79ee24-b87a-415f-8840-23dcbcd8db5b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:12.282043 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6a79ee24-b87a-415f-8840-23dcbcd8db5b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:12.311571 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6a79ee24-b87a-415f-8840-23dcbcd8db5b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043174 Aug 25 05:46:12.312230 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 844/1654] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:12 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:46:13.296013 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-57769a6d-f150-452e-8332-36de3a57f9d0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:13.296596 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-57769a6d-f150-452e-8332-36de3a57f9d0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:13.302420 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-57769a6d-f150-452e-8332-36de3a57f9d0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:13.302859 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-57769a6d-f150-452e-8332-36de3a57f9d0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:13.303602 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-57769a6d-f150-452e-8332-36de3a57f9d0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:13.304027 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-57769a6d-f150-452e-8332-36de3a57f9d0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:13.323336 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-541d4b87-38ac-4db6-8e41-a736fd45b646 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:13.324240 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-541d4b87-38ac-4db6-8e41-a736fd45b646 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:13.330041 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-541d4b87-38ac-4db6-8e41-a736fd45b646 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:13.330476 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-541d4b87-38ac-4db6-8e41-a736fd45b646 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:13.331312 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-541d4b87-38ac-4db6-8e41-a736fd45b646 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:13.332393 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-541d4b87-38ac-4db6-8e41-a736fd45b646 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:13.361044 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-541d4b87-38ac-4db6-8e41-a736fd45b646 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041369 Aug 25 05:46:13.361753 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 845/1655] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:13 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:46:13.370079 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-57769a6d-f150-452e-8332-36de3a57f9d0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:13.377224 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-57769a6d-f150-452e-8332-36de3a57f9d0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.084864 Aug 25 05:46:13.377795 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 811/1656] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:13 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:14.373780 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9881e04f-7906-4c6f-8cda-1dc35095ce20 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:14.374810 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9881e04f-7906-4c6f-8cda-1dc35095ce20 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:14.381276 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9881e04f-7906-4c6f-8cda-1dc35095ce20 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:14.381821 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9881e04f-7906-4c6f-8cda-1dc35095ce20 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:14.382595 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9881e04f-7906-4c6f-8cda-1dc35095ce20 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:14.383070 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9881e04f-7906-4c6f-8cda-1dc35095ce20 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:14.394482 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-151ec20e-b637-4128-a645-180122f57118 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:14.395433 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-151ec20e-b637-4128-a645-180122f57118 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:14.402105 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-151ec20e-b637-4128-a645-180122f57118 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:14.402610 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-151ec20e-b637-4128-a645-180122f57118 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:14.403372 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-151ec20e-b637-4128-a645-180122f57118 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:14.403793 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-151ec20e-b637-4128-a645-180122f57118 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:14.414928 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9881e04f-7906-4c6f-8cda-1dc35095ce20 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045112 Aug 25 05:46:14.415509 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 846/1657] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:14 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:14.465426 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-151ec20e-b637-4128-a645-180122f57118 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:14.472837 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-151ec20e-b637-4128-a645-180122f57118 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.082699 Aug 25 05:46:14.473390 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 812/1658] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:14 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:46:15.427247 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-fb906d0c-5b9d-496f-b593-0921a848171a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:15.428139 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-fb906d0c-5b9d-496f-b593-0921a848171a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:15.433869 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fb906d0c-5b9d-496f-b593-0921a848171a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:15.434308 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fb906d0c-5b9d-496f-b593-0921a848171a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:15.435056 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fb906d0c-5b9d-496f-b593-0921a848171a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:15.435478 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fb906d0c-5b9d-496f-b593-0921a848171a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:15.463959 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-fb906d0c-5b9d-496f-b593-0921a848171a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041022 Aug 25 05:46:15.464541 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 847/1659] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:15 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:15.489573 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-518db360-98a2-4b8a-a21c-d1a280d04802 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:15.490183 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-518db360-98a2-4b8a-a21c-d1a280d04802 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:15.495948 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-518db360-98a2-4b8a-a21c-d1a280d04802 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:15.496395 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-518db360-98a2-4b8a-a21c-d1a280d04802 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:15.497158 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-518db360-98a2-4b8a-a21c-d1a280d04802 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:15.497616 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-518db360-98a2-4b8a-a21c-d1a280d04802 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:15.556484 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-518db360-98a2-4b8a-a21c-d1a280d04802 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:15.564020 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-518db360-98a2-4b8a-a21c-d1a280d04802 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.078796 Aug 25 05:46:15.564585 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 813/1660] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:15 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:16.475279 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f2378884-365d-44a3-be91-af5f59ecf0cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:16.476178 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f2378884-365d-44a3-be91-af5f59ecf0cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:16.482021 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f2378884-365d-44a3-be91-af5f59ecf0cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:16.482463 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f2378884-365d-44a3-be91-af5f59ecf0cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:16.483220 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f2378884-365d-44a3-be91-af5f59ecf0cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:16.483647 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f2378884-365d-44a3-be91-af5f59ecf0cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:16.512513 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f2378884-365d-44a3-be91-af5f59ecf0cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040980 Aug 25 05:46:16.513049 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 848/1661] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:16 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:16.580295 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3064d021-b665-4c63-aed5-373c7664392f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:16.581033 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3064d021-b665-4c63-aed5-373c7664392f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:16.586909 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3064d021-b665-4c63-aed5-373c7664392f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:16.587352 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3064d021-b665-4c63-aed5-373c7664392f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:16.588109 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3064d021-b665-4c63-aed5-373c7664392f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:16.588537 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3064d021-b665-4c63-aed5-373c7664392f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:16.646888 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-3064d021-b665-4c63-aed5-373c7664392f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:16.654393 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3064d021-b665-4c63-aed5-373c7664392f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.077834 Aug 25 05:46:16.655184 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 814/1662] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:16 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:17.524148 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2331a08f-883a-4016-9211-c516bd4911e0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:17.525049 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2331a08f-883a-4016-9211-c516bd4911e0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:17.530880 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2331a08f-883a-4016-9211-c516bd4911e0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:17.531324 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2331a08f-883a-4016-9211-c516bd4911e0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:17.532083 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2331a08f-883a-4016-9211-c516bd4911e0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:17.532512 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2331a08f-883a-4016-9211-c516bd4911e0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:17.562215 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2331a08f-883a-4016-9211-c516bd4911e0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042129 Aug 25 05:46:17.562748 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 849/1663] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:17 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:17.670921 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-f3370db2-96a3-43bb-8bb5-ff24a50432ae tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:17.671556 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-f3370db2-96a3-43bb-8bb5-ff24a50432ae tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:17.679074 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f3370db2-96a3-43bb-8bb5-ff24a50432ae tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:17.679656 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f3370db2-96a3-43bb-8bb5-ff24a50432ae tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:17.680780 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f3370db2-96a3-43bb-8bb5-ff24a50432ae tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:17.681339 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f3370db2-96a3-43bb-8bb5-ff24a50432ae tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:17.744300 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-f3370db2-96a3-43bb-8bb5-ff24a50432ae tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:17.751434 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-f3370db2-96a3-43bb-8bb5-ff24a50432ae tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.084120 Aug 25 05:46:17.751989 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 815/1664] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:17 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:18.574000 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2684a5f5-3cea-4ba6-8db3-8cf5254b0b0a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:18.574905 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2684a5f5-3cea-4ba6-8db3-8cf5254b0b0a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:18.580730 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2684a5f5-3cea-4ba6-8db3-8cf5254b0b0a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:18.581769 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2684a5f5-3cea-4ba6-8db3-8cf5254b0b0a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:18.583019 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2684a5f5-3cea-4ba6-8db3-8cf5254b0b0a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:18.583019 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2684a5f5-3cea-4ba6-8db3-8cf5254b0b0a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:18.611546 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2684a5f5-3cea-4ba6-8db3-8cf5254b0b0a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041221 Aug 25 05:46:18.612076 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 850/1665] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:18 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:18.767031 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c5cfda43-bf1c-4701-8bd5-1d09a6091343 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:18.767720 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c5cfda43-bf1c-4701-8bd5-1d09a6091343 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:18.774534 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c5cfda43-bf1c-4701-8bd5-1d09a6091343 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:18.774982 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c5cfda43-bf1c-4701-8bd5-1d09a6091343 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:18.775745 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c5cfda43-bf1c-4701-8bd5-1d09a6091343 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:18.776176 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c5cfda43-bf1c-4701-8bd5-1d09a6091343 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:18.835276 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-c5cfda43-bf1c-4701-8bd5-1d09a6091343 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:18.842498 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c5cfda43-bf1c-4701-8bd5-1d09a6091343 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.079207 Aug 25 05:46:18.843039 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 816/1666] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:18 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:19.622808 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-3d21a446-ba8d-48a8-b6cd-c3bf80a46b91 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:19.623709 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-3d21a446-ba8d-48a8-b6cd-c3bf80a46b91 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:19.630820 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3d21a446-ba8d-48a8-b6cd-c3bf80a46b91 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:19.631265 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3d21a446-ba8d-48a8-b6cd-c3bf80a46b91 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:19.632023 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3d21a446-ba8d-48a8-b6cd-c3bf80a46b91 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:19.632454 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3d21a446-ba8d-48a8-b6cd-c3bf80a46b91 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:19.660879 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-3d21a446-ba8d-48a8-b6cd-c3bf80a46b91 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041814 Aug 25 05:46:19.661454 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 851/1667] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:19 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:19.858600 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-959e8c17-3d93-45f1-b8e6-539163ebf4a5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:19.859236 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-959e8c17-3d93-45f1-b8e6-539163ebf4a5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:19.865948 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-959e8c17-3d93-45f1-b8e6-539163ebf4a5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:19.866398 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-959e8c17-3d93-45f1-b8e6-539163ebf4a5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:19.867164 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-959e8c17-3d93-45f1-b8e6-539163ebf4a5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:19.867594 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-959e8c17-3d93-45f1-b8e6-539163ebf4a5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:19.926428 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-959e8c17-3d93-45f1-b8e6-539163ebf4a5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:19.933732 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-959e8c17-3d93-45f1-b8e6-539163ebf4a5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.078899 Aug 25 05:46:19.934309 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 817/1668] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:19 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:20.672156 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9031cccd-1b86-4b1d-bacc-0f7057eb2ab5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:20.673078 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9031cccd-1b86-4b1d-bacc-0f7057eb2ab5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:20.679361 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9031cccd-1b86-4b1d-bacc-0f7057eb2ab5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:20.679802 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9031cccd-1b86-4b1d-bacc-0f7057eb2ab5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:20.680559 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9031cccd-1b86-4b1d-bacc-0f7057eb2ab5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:20.680988 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9031cccd-1b86-4b1d-bacc-0f7057eb2ab5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:20.710666 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9031cccd-1b86-4b1d-bacc-0f7057eb2ab5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042260 Aug 25 05:46:20.711198 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 852/1669] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:20 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:20.950515 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-51945537-0cff-46a6-92ab-0a8b3f9ca335 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:20.951542 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-51945537-0cff-46a6-92ab-0a8b3f9ca335 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:20.957447 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-51945537-0cff-46a6-92ab-0a8b3f9ca335 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:20.957924 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-51945537-0cff-46a6-92ab-0a8b3f9ca335 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:20.958685 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-51945537-0cff-46a6-92ab-0a8b3f9ca335 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:20.959113 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-51945537-0cff-46a6-92ab-0a8b3f9ca335 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:21.021122 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-51945537-0cff-46a6-92ab-0a8b3f9ca335 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:21.028667 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-51945537-0cff-46a6-92ab-0a8b3f9ca335 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.081810 Aug 25 05:46:21.029235 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 818/1670] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:20 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:21.723759 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c7e255e9-f89c-4079-81c8-fe2a5d065eb7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:21.724825 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c7e255e9-f89c-4079-81c8-fe2a5d065eb7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:21.731883 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c7e255e9-f89c-4079-81c8-fe2a5d065eb7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:21.732319 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c7e255e9-f89c-4079-81c8-fe2a5d065eb7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:21.733081 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c7e255e9-f89c-4079-81c8-fe2a5d065eb7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:21.733505 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c7e255e9-f89c-4079-81c8-fe2a5d065eb7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:21.765999 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c7e255e9-f89c-4079-81c8-fe2a5d065eb7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047139 Aug 25 05:46:21.766559 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 853/1671] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:21 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:22.044873 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ff8804d9-3061-419e-92d4-4389c2282490 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:22.045489 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ff8804d9-3061-419e-92d4-4389c2282490 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:22.051777 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ff8804d9-3061-419e-92d4-4389c2282490 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:22.052282 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ff8804d9-3061-419e-92d4-4389c2282490 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:22.053056 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ff8804d9-3061-419e-92d4-4389c2282490 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:22.053487 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ff8804d9-3061-419e-92d4-4389c2282490 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:22.328451 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ff8804d9-3061-419e-92d4-4389c2282490 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:22.336498 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ff8804d9-3061-419e-92d4-4389c2282490 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.295347 Aug 25 05:46:22.337062 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 819/1672] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:22 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:22.779079 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d4006af4-2630-4c7f-a3c8-7d98e2483455 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:22.779892 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d4006af4-2630-4c7f-a3c8-7d98e2483455 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:22.786335 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d4006af4-2630-4c7f-a3c8-7d98e2483455 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:22.786781 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d4006af4-2630-4c7f-a3c8-7d98e2483455 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:22.787532 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d4006af4-2630-4c7f-a3c8-7d98e2483455 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:22.787955 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d4006af4-2630-4c7f-a3c8-7d98e2483455 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:22.816352 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d4006af4-2630-4c7f-a3c8-7d98e2483455 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041060 Aug 25 05:46:22.816892 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 854/1673] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:22 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:23.352646 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a11c8106-7a21-4c2b-b0d1-2950c33c7d27 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:23.353252 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a11c8106-7a21-4c2b-b0d1-2950c33c7d27 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:23.359179 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a11c8106-7a21-4c2b-b0d1-2950c33c7d27 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:23.359566 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a11c8106-7a21-4c2b-b0d1-2950c33c7d27 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:23.360319 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a11c8106-7a21-4c2b-b0d1-2950c33c7d27 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:23.360754 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a11c8106-7a21-4c2b-b0d1-2950c33c7d27 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:23.420079 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-a11c8106-7a21-4c2b-b0d1-2950c33c7d27 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:23.427488 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a11c8106-7a21-4c2b-b0d1-2950c33c7d27 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.078506 Aug 25 05:46:23.428038 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 820/1674] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:23 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:46:23.827899 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b32a862c-4993-4101-91e2-ea7493ef79bf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:23.828798 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b32a862c-4993-4101-91e2-ea7493ef79bf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:23.835796 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b32a862c-4993-4101-91e2-ea7493ef79bf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:23.836236 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b32a862c-4993-4101-91e2-ea7493ef79bf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:23.836989 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b32a862c-4993-4101-91e2-ea7493ef79bf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:23.837417 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b32a862c-4993-4101-91e2-ea7493ef79bf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:23.865872 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b32a862c-4993-4101-91e2-ea7493ef79bf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041736 Aug 25 05:46:23.866410 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 855/1675] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:23 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:24.443838 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c8e4c04f-7ce0-4af8-9017-4b8896c7f92d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:24.444372 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c8e4c04f-7ce0-4af8-9017-4b8896c7f92d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:24.450194 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c8e4c04f-7ce0-4af8-9017-4b8896c7f92d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:24.450633 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c8e4c04f-7ce0-4af8-9017-4b8896c7f92d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:24.451397 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c8e4c04f-7ce0-4af8-9017-4b8896c7f92d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:24.451826 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c8e4c04f-7ce0-4af8-9017-4b8896c7f92d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:24.509734 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-c8e4c04f-7ce0-4af8-9017-4b8896c7f92d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:24.516774 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c8e4c04f-7ce0-4af8-9017-4b8896c7f92d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.076720 Aug 25 05:46:24.517326 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 821/1676] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:24 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:24.877147 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-24497f45-7244-4664-8dce-14fb2c0d2f1e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:24.878482 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-24497f45-7244-4664-8dce-14fb2c0d2f1e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:24.884280 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-24497f45-7244-4664-8dce-14fb2c0d2f1e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:24.884714 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-24497f45-7244-4664-8dce-14fb2c0d2f1e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:24.885463 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-24497f45-7244-4664-8dce-14fb2c0d2f1e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:24.885911 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-24497f45-7244-4664-8dce-14fb2c0d2f1e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:24.916136 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-24497f45-7244-4664-8dce-14fb2c0d2f1e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042752 Aug 25 05:46:24.916678 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 856/1677] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:24 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:25.534598 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8d0c756b-bc8b-4328-9188-bf2142dfaeaf tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:25.535214 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8d0c756b-bc8b-4328-9188-bf2142dfaeaf tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:25.541030 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8d0c756b-bc8b-4328-9188-bf2142dfaeaf tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:25.541479 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8d0c756b-bc8b-4328-9188-bf2142dfaeaf tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:25.542274 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8d0c756b-bc8b-4328-9188-bf2142dfaeaf tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:25.542709 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8d0c756b-bc8b-4328-9188-bf2142dfaeaf tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:25.601603 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-8d0c756b-bc8b-4328-9188-bf2142dfaeaf tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:25.608846 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8d0c756b-bc8b-4328-9188-bf2142dfaeaf tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.078027 Aug 25 05:46:25.609412 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 822/1678] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:25 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:25.927699 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5fd12886-8f7a-4c2e-bb7a-250c8870b22e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:25.928541 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5fd12886-8f7a-4c2e-bb7a-250c8870b22e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:25.934383 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5fd12886-8f7a-4c2e-bb7a-250c8870b22e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:25.934816 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5fd12886-8f7a-4c2e-bb7a-250c8870b22e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:25.935564 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5fd12886-8f7a-4c2e-bb7a-250c8870b22e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:25.935987 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5fd12886-8f7a-4c2e-bb7a-250c8870b22e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:25.969289 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5fd12886-8f7a-4c2e-bb7a-250c8870b22e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045501 Aug 25 05:46:25.969860 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 857/1679] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:25 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:26.625292 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e752a8be-8d77-4a0f-a4a9-8e1b70837785 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:26.625939 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e752a8be-8d77-4a0f-a4a9-8e1b70837785 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:26.631965 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e752a8be-8d77-4a0f-a4a9-8e1b70837785 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:26.632401 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e752a8be-8d77-4a0f-a4a9-8e1b70837785 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:26.633146 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e752a8be-8d77-4a0f-a4a9-8e1b70837785 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:26.633595 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e752a8be-8d77-4a0f-a4a9-8e1b70837785 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:26.694415 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e752a8be-8d77-4a0f-a4a9-8e1b70837785 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:26.701699 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e752a8be-8d77-4a0f-a4a9-8e1b70837785 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.080063 Aug 25 05:46:26.702469 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 823/1680] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:26 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:26.980648 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-0b89c85d-d623-4714-89bb-998008688f01 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:26.981460 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-0b89c85d-d623-4714-89bb-998008688f01 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:26.987272 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0b89c85d-d623-4714-89bb-998008688f01 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:26.987769 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0b89c85d-d623-4714-89bb-998008688f01 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:26.988516 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0b89c85d-d623-4714-89bb-998008688f01 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:26.988939 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0b89c85d-d623-4714-89bb-998008688f01 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:27.017770 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-0b89c85d-d623-4714-89bb-998008688f01 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040835 Aug 25 05:46:27.018334 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 858/1681] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:26 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:27.719107 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b02dd50d-0623-4732-9681-dcf9feba7c0f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:27.719715 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b02dd50d-0623-4732-9681-dcf9feba7c0f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:27.725834 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b02dd50d-0623-4732-9681-dcf9feba7c0f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:27.726277 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b02dd50d-0623-4732-9681-dcf9feba7c0f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:27.727031 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b02dd50d-0623-4732-9681-dcf9feba7c0f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:27.727464 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b02dd50d-0623-4732-9681-dcf9feba7c0f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:27.785796 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-b02dd50d-0623-4732-9681-dcf9feba7c0f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:27.792885 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b02dd50d-0623-4732-9681-dcf9feba7c0f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.077478 Aug 25 05:46:27.793474 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 824/1682] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:27 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:28.030435 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-35732e37-1f57-40eb-adc9-992e258161d2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:28.031367 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-35732e37-1f57-40eb-adc9-992e258161d2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:28.038021 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-35732e37-1f57-40eb-adc9-992e258161d2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:28.038459 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-35732e37-1f57-40eb-adc9-992e258161d2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:28.039561 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-35732e37-1f57-40eb-adc9-992e258161d2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:28.040307 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-35732e37-1f57-40eb-adc9-992e258161d2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:28.071120 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-35732e37-1f57-40eb-adc9-992e258161d2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044463 Aug 25 05:46:28.071656 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 859/1683] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:28 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:28.809957 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c12fc4d9-999f-4745-9a91-1f054e5e5256 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:28.810602 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c12fc4d9-999f-4745-9a91-1f054e5e5256 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:28.817308 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c12fc4d9-999f-4745-9a91-1f054e5e5256 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:28.817774 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c12fc4d9-999f-4745-9a91-1f054e5e5256 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:28.818529 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c12fc4d9-999f-4745-9a91-1f054e5e5256 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:28.818952 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c12fc4d9-999f-4745-9a91-1f054e5e5256 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:28.876771 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-c12fc4d9-999f-4745-9a91-1f054e5e5256 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:28.884632 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c12fc4d9-999f-4745-9a91-1f054e5e5256 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.078285 Aug 25 05:46:28.885188 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 825/1684] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:28 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:29.082314 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a1cea5b5-58d8-4167-abd0-29890a7804a6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:29.083116 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a1cea5b5-58d8-4167-abd0-29890a7804a6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:29.088857 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a1cea5b5-58d8-4167-abd0-29890a7804a6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:29.089300 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a1cea5b5-58d8-4167-abd0-29890a7804a6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:29.090099 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a1cea5b5-58d8-4167-abd0-29890a7804a6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:29.090531 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a1cea5b5-58d8-4167-abd0-29890a7804a6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:29.118763 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a1cea5b5-58d8-4167-abd0-29890a7804a6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040900 Aug 25 05:46:29.119302 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 860/1685] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:29 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:29.908818 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-bc281380-d82a-42a0-b2f7-8ab1a0940b75 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:29.910039 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-bc281380-d82a-42a0-b2f7-8ab1a0940b75 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:29.915982 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bc281380-d82a-42a0-b2f7-8ab1a0940b75 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:29.916424 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bc281380-d82a-42a0-b2f7-8ab1a0940b75 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:29.917189 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bc281380-d82a-42a0-b2f7-8ab1a0940b75 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:29.917654 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bc281380-d82a-42a0-b2f7-8ab1a0940b75 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:29.976534 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-bc281380-d82a-42a0-b2f7-8ab1a0940b75 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:29.983845 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-bc281380-d82a-42a0-b2f7-8ab1a0940b75 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.078613 Aug 25 05:46:29.984409 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 826/1686] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:29 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:30.130046 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-18db096b-6442-49a6-a81c-bc22ba38d52b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:30.131003 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-18db096b-6442-49a6-a81c-bc22ba38d52b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:30.136901 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-18db096b-6442-49a6-a81c-bc22ba38d52b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:30.137337 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-18db096b-6442-49a6-a81c-bc22ba38d52b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:30.138133 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-18db096b-6442-49a6-a81c-bc22ba38d52b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:30.138557 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-18db096b-6442-49a6-a81c-bc22ba38d52b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:30.167585 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-18db096b-6442-49a6-a81c-bc22ba38d52b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041277 Aug 25 05:46:30.168046 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 861/1687] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:30 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:30.999964 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-167ffea3-8d74-45b0-8cea-889bae543a1b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:31.000567 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-167ffea3-8d74-45b0-8cea-889bae543a1b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:31.006948 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-167ffea3-8d74-45b0-8cea-889bae543a1b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:31.007389 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-167ffea3-8d74-45b0-8cea-889bae543a1b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:31.008140 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-167ffea3-8d74-45b0-8cea-889bae543a1b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:31.008567 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-167ffea3-8d74-45b0-8cea-889bae543a1b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:31.067308 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-167ffea3-8d74-45b0-8cea-889bae543a1b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:31.074871 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-167ffea3-8d74-45b0-8cea-889bae543a1b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.078402 Aug 25 05:46:31.075421 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 827/1688] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:30 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:31.179295 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-754ef4e9-78b2-445d-a41e-bab9aa75d39c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:31.180202 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-754ef4e9-78b2-445d-a41e-bab9aa75d39c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:31.185957 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-754ef4e9-78b2-445d-a41e-bab9aa75d39c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:31.186395 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-754ef4e9-78b2-445d-a41e-bab9aa75d39c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:31.187154 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-754ef4e9-78b2-445d-a41e-bab9aa75d39c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:31.187586 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-754ef4e9-78b2-445d-a41e-bab9aa75d39c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:31.215329 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-754ef4e9-78b2-445d-a41e-bab9aa75d39c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040432 Aug 25 05:46:31.215930 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 862/1689] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:31 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:32.091497 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-9dc77050-d4a8-49f0-aa38-88fb5cdb1329 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:32.092445 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-9dc77050-d4a8-49f0-aa38-88fb5cdb1329 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:32.098973 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9dc77050-d4a8-49f0-aa38-88fb5cdb1329 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:32.100016 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9dc77050-d4a8-49f0-aa38-88fb5cdb1329 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:32.100358 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9dc77050-d4a8-49f0-aa38-88fb5cdb1329 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:32.100790 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9dc77050-d4a8-49f0-aa38-88fb5cdb1329 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:32.160335 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-9dc77050-d4a8-49f0-aa38-88fb5cdb1329 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:32.167527 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-9dc77050-d4a8-49f0-aa38-88fb5cdb1329 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.079755 Aug 25 05:46:32.168079 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 828/1690] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:32 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:32.227430 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-3774844c-9171-4855-bd98-dabcf8aa2918 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:32.228302 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-3774844c-9171-4855-bd98-dabcf8aa2918 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:32.234034 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3774844c-9171-4855-bd98-dabcf8aa2918 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:32.234475 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3774844c-9171-4855-bd98-dabcf8aa2918 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:32.235237 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3774844c-9171-4855-bd98-dabcf8aa2918 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:32.235663 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3774844c-9171-4855-bd98-dabcf8aa2918 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:32.263929 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-3774844c-9171-4855-bd98-dabcf8aa2918 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040306 Aug 25 05:46:32.264462 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 863/1691] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:32 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:33.184017 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-67e34c37-445c-41a8-9813-601c163f6052 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:33.184551 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-67e34c37-445c-41a8-9813-601c163f6052 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:33.190256 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-67e34c37-445c-41a8-9813-601c163f6052 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:33.190695 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-67e34c37-445c-41a8-9813-601c163f6052 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:33.191602 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-67e34c37-445c-41a8-9813-601c163f6052 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:33.192019 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-67e34c37-445c-41a8-9813-601c163f6052 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:33.253658 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-67e34c37-445c-41a8-9813-601c163f6052 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:33.261049 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-67e34c37-445c-41a8-9813-601c163f6052 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.080812 Aug 25 05:46:33.261618 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 829/1692] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:33 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:33.275365 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a26ba03b-c36d-46c2-9bb2-83693980d81d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:33.276266 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a26ba03b-c36d-46c2-9bb2-83693980d81d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:33.282019 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a26ba03b-c36d-46c2-9bb2-83693980d81d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:33.282462 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a26ba03b-c36d-46c2-9bb2-83693980d81d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:33.283210 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a26ba03b-c36d-46c2-9bb2-83693980d81d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:33.283663 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a26ba03b-c36d-46c2-9bb2-83693980d81d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:33.312863 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a26ba03b-c36d-46c2-9bb2-83693980d81d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041480 Aug 25 05:46:33.313402 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 864/1693] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:33 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:34.277475 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-f50cbebe-25a8-4299-836b-800b7deb5033 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:34.278118 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-f50cbebe-25a8-4299-836b-800b7deb5033 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:34.283851 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f50cbebe-25a8-4299-836b-800b7deb5033 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:34.284287 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f50cbebe-25a8-4299-836b-800b7deb5033 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:34.286118 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f50cbebe-25a8-4299-836b-800b7deb5033 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:34.286558 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f50cbebe-25a8-4299-836b-800b7deb5033 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:34.323929 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-30d73fa1-787d-4f47-9d2d-28e0d607c4c3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:34.324964 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-30d73fa1-787d-4f47-9d2d-28e0d607c4c3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:34.331119 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-30d73fa1-787d-4f47-9d2d-28e0d607c4c3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:34.331554 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-30d73fa1-787d-4f47-9d2d-28e0d607c4c3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:34.332467 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-30d73fa1-787d-4f47-9d2d-28e0d607c4c3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:34.332890 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-30d73fa1-787d-4f47-9d2d-28e0d607c4c3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:34.346108 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-f50cbebe-25a8-4299-836b-800b7deb5033 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:34.353572 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-f50cbebe-25a8-4299-836b-800b7deb5033 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.079966 Aug 25 05:46:34.354142 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 830/1694] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:34 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:34.361963 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-30d73fa1-787d-4f47-9d2d-28e0d607c4c3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041578 Aug 25 05:46:34.362508 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 865/1695] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:34 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:46:35.369885 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e44347e2-ed6c-43e8-97e7-470789eb30cd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:35.370493 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e44347e2-ed6c-43e8-97e7-470789eb30cd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:35.372901 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-114c20ad-64a1-405b-92d3-683614681f01 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:35.373829 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-114c20ad-64a1-405b-92d3-683614681f01 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:35.376388 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e44347e2-ed6c-43e8-97e7-470789eb30cd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:35.376827 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e44347e2-ed6c-43e8-97e7-470789eb30cd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:35.377618 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e44347e2-ed6c-43e8-97e7-470789eb30cd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:35.378044 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e44347e2-ed6c-43e8-97e7-470789eb30cd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:35.379774 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-114c20ad-64a1-405b-92d3-683614681f01 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:35.380213 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-114c20ad-64a1-405b-92d3-683614681f01 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:35.380966 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-114c20ad-64a1-405b-92d3-683614681f01 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:35.381390 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-114c20ad-64a1-405b-92d3-683614681f01 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:35.419134 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-114c20ad-64a1-405b-92d3-683614681f01 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049814 Aug 25 05:46:35.420476 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 866/1696] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:35 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:46:35.447565 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e44347e2-ed6c-43e8-97e7-470789eb30cd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:35.454915 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e44347e2-ed6c-43e8-97e7-470789eb30cd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.088729 Aug 25 05:46:35.455477 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 831/1697] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:35 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:36.472241 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-bcc38e44-0627-436a-aacb-a6c9a4726271 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:36.473559 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-bcc38e44-0627-436a-aacb-a6c9a4726271 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:36.479262 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bcc38e44-0627-436a-aacb-a6c9a4726271 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:36.479705 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bcc38e44-0627-436a-aacb-a6c9a4726271 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:36.480460 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bcc38e44-0627-436a-aacb-a6c9a4726271 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:36.480885 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bcc38e44-0627-436a-aacb-a6c9a4726271 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:36.540751 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-bcc38e44-0627-436a-aacb-a6c9a4726271 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:36.542363 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c4e7d377-175c-4b93-87c7-e3c9015b44c4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:36.543260 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c4e7d377-175c-4b93-87c7-e3c9015b44c4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:36.548621 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-bcc38e44-0627-436a-aacb-a6c9a4726271 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.080071 Aug 25 05:46:36.549182 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 832/1698] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:36 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:46:36.549305 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c4e7d377-175c-4b93-87c7-e3c9015b44c4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:36.549729 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c4e7d377-175c-4b93-87c7-e3c9015b44c4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:36.550488 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c4e7d377-175c-4b93-87c7-e3c9015b44c4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:36.551657 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c4e7d377-175c-4b93-87c7-e3c9015b44c4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:36.579722 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c4e7d377-175c-4b93-87c7-e3c9015b44c4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.151597 Aug 25 05:46:36.580264 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 867/1699] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:36 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:37.566042 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-36c63b35-e01c-47ed-a637-d0d3a12dccd4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:37.567117 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-36c63b35-e01c-47ed-a637-d0d3a12dccd4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:37.573254 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-36c63b35-e01c-47ed-a637-d0d3a12dccd4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:37.573765 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-36c63b35-e01c-47ed-a637-d0d3a12dccd4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:37.574574 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-36c63b35-e01c-47ed-a637-d0d3a12dccd4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:37.575094 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-36c63b35-e01c-47ed-a637-d0d3a12dccd4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:37.593006 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e5b7994f-c691-42ff-821f-faaf4d0005b2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:37.593499 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e5b7994f-c691-42ff-821f-faaf4d0005b2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:37.599592 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e5b7994f-c691-42ff-821f-faaf4d0005b2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:37.600038 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e5b7994f-c691-42ff-821f-faaf4d0005b2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:37.600833 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e5b7994f-c691-42ff-821f-faaf4d0005b2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:37.601254 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e5b7994f-c691-42ff-821f-faaf4d0005b2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:37.632454 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e5b7994f-c691-42ff-821f-faaf4d0005b2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043987 Aug 25 05:46:37.633018 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 868/1700] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:37 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:46:37.635602 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-36c63b35-e01c-47ed-a637-d0d3a12dccd4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:37.643008 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-36c63b35-e01c-47ed-a637-d0d3a12dccd4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.080907 Aug 25 05:46:37.643558 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 833/1701] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:37 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:38.642891 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-422f5391-f9f8-40fb-ab04-f5d738970bab tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:38.643791 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-422f5391-f9f8-40fb-ab04-f5d738970bab tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:38.650543 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-422f5391-f9f8-40fb-ab04-f5d738970bab tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:38.650982 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-422f5391-f9f8-40fb-ab04-f5d738970bab tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:38.651741 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-422f5391-f9f8-40fb-ab04-f5d738970bab tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:38.652166 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-422f5391-f9f8-40fb-ab04-f5d738970bab tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:38.659386 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-40d2681b-33c4-4cb6-842b-906262c0ab01 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:38.660540 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-40d2681b-33c4-4cb6-842b-906262c0ab01 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:38.666700 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-40d2681b-33c4-4cb6-842b-906262c0ab01 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:38.667145 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-40d2681b-33c4-4cb6-842b-906262c0ab01 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:38.667912 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-40d2681b-33c4-4cb6-842b-906262c0ab01 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:38.668663 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-40d2681b-33c4-4cb6-842b-906262c0ab01 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:38.682971 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-422f5391-f9f8-40fb-ab04-f5d738970bab tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043762 Aug 25 05:46:38.683524 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 869/1702] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:38 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:38.727214 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-40d2681b-33c4-4cb6-842b-906262c0ab01 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:38.734421 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-40d2681b-33c4-4cb6-842b-906262c0ab01 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.078656 Aug 25 05:46:38.734978 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 834/1703] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:38 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:46:39.694903 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-020301c6-9cf0-44c7-88d8-2873440f61b5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:39.695796 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-020301c6-9cf0-44c7-88d8-2873440f61b5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:39.701628 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-020301c6-9cf0-44c7-88d8-2873440f61b5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:39.702068 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-020301c6-9cf0-44c7-88d8-2873440f61b5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:39.702814 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-020301c6-9cf0-44c7-88d8-2873440f61b5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:39.703237 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-020301c6-9cf0-44c7-88d8-2873440f61b5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:39.731466 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-020301c6-9cf0-44c7-88d8-2873440f61b5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040876 Aug 25 05:46:39.731996 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 870/1704] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:39 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:39.751050 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-9f0dfdaf-42dd-4876-9642-9d96ddae408d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:39.751658 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-9f0dfdaf-42dd-4876-9642-9d96ddae408d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:39.759728 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9f0dfdaf-42dd-4876-9642-9d96ddae408d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:39.760395 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9f0dfdaf-42dd-4876-9642-9d96ddae408d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:39.761228 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9f0dfdaf-42dd-4876-9642-9d96ddae408d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:39.761714 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9f0dfdaf-42dd-4876-9642-9d96ddae408d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:39.824700 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-9f0dfdaf-42dd-4876-9642-9d96ddae408d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:39.832001 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-9f0dfdaf-42dd-4876-9642-9d96ddae408d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.084543 Aug 25 05:46:39.832783 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 835/1705] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:39 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:40.742767 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-83754d43-8263-4839-9c4a-90f9a3b0d464 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:40.743662 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-83754d43-8263-4839-9c4a-90f9a3b0d464 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:40.749457 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-83754d43-8263-4839-9c4a-90f9a3b0d464 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:40.749921 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-83754d43-8263-4839-9c4a-90f9a3b0d464 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:40.750699 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-83754d43-8263-4839-9c4a-90f9a3b0d464 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:40.751124 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-83754d43-8263-4839-9c4a-90f9a3b0d464 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:40.780802 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-83754d43-8263-4839-9c4a-90f9a3b0d464 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041798 Aug 25 05:46:40.781335 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 871/1706] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:40 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:40.848987 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e7f28673-3c15-40f2-aca8-179194489b12 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:40.849585 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e7f28673-3c15-40f2-aca8-179194489b12 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:40.855295 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e7f28673-3c15-40f2-aca8-179194489b12 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:40.855740 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e7f28673-3c15-40f2-aca8-179194489b12 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:40.856500 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e7f28673-3c15-40f2-aca8-179194489b12 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:40.856928 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e7f28673-3c15-40f2-aca8-179194489b12 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:40.916134 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e7f28673-3c15-40f2-aca8-179194489b12 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:40.924000 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e7f28673-3c15-40f2-aca8-179194489b12 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.079238 Aug 25 05:46:40.924569 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 836/1707] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:40 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:41.792434 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ccf29a32-cead-4b22-ac5e-2761df12157f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:41.793256 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ccf29a32-cead-4b22-ac5e-2761df12157f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:41.799178 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ccf29a32-cead-4b22-ac5e-2761df12157f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:41.799617 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ccf29a32-cead-4b22-ac5e-2761df12157f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:41.800378 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ccf29a32-cead-4b22-ac5e-2761df12157f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:41.801835 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ccf29a32-cead-4b22-ac5e-2761df12157f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:41.831169 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ccf29a32-cead-4b22-ac5e-2761df12157f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042730 Aug 25 05:46:41.831728 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 872/1708] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:41 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:41.940403 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8e4dbb38-0f57-451b-9ae7-0ba8633b0d46 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:41.941006 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8e4dbb38-0f57-451b-9ae7-0ba8633b0d46 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:41.947643 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8e4dbb38-0f57-451b-9ae7-0ba8633b0d46 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:41.948086 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8e4dbb38-0f57-451b-9ae7-0ba8633b0d46 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:41.948849 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8e4dbb38-0f57-451b-9ae7-0ba8633b0d46 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:41.949279 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8e4dbb38-0f57-451b-9ae7-0ba8633b0d46 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:42.009182 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-8e4dbb38-0f57-451b-9ae7-0ba8633b0d46 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:42.016964 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8e4dbb38-0f57-451b-9ae7-0ba8633b0d46 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.080209 Aug 25 05:46:42.017597 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 837/1709] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:41 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:42.842815 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-251df430-6ff8-4052-a1bc-406509938d3b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:42.843628 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-251df430-6ff8-4052-a1bc-406509938d3b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:42.849681 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-251df430-6ff8-4052-a1bc-406509938d3b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:42.850121 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-251df430-6ff8-4052-a1bc-406509938d3b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:42.850870 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-251df430-6ff8-4052-a1bc-406509938d3b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:42.851332 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-251df430-6ff8-4052-a1bc-406509938d3b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:42.880779 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-251df430-6ff8-4052-a1bc-406509938d3b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041785 Aug 25 05:46:42.891420 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 873/1710] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:42 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:43.033657 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-2858b196-75d7-4114-b8b6-eb367fef18d4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:43.034320 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-2858b196-75d7-4114-b8b6-eb367fef18d4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:43.041603 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2858b196-75d7-4114-b8b6-eb367fef18d4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:43.042065 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2858b196-75d7-4114-b8b6-eb367fef18d4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:43.042845 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2858b196-75d7-4114-b8b6-eb367fef18d4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:43.043448 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2858b196-75d7-4114-b8b6-eb367fef18d4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:43.105121 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-2858b196-75d7-4114-b8b6-eb367fef18d4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:43.112376 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-2858b196-75d7-4114-b8b6-eb367fef18d4 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.082647 Aug 25 05:46:43.112932 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 838/1711] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:43 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:46:43.892680 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b9289dfd-5a0c-461d-b999-bcbf142ef898 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:43.893518 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b9289dfd-5a0c-461d-b999-bcbf142ef898 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:43.900527 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b9289dfd-5a0c-461d-b999-bcbf142ef898 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:43.900962 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b9289dfd-5a0c-461d-b999-bcbf142ef898 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:43.901755 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b9289dfd-5a0c-461d-b999-bcbf142ef898 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:43.902180 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b9289dfd-5a0c-461d-b999-bcbf142ef898 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:43.930763 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b9289dfd-5a0c-461d-b999-bcbf142ef898 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042191 Aug 25 05:46:43.931308 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 874/1712] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:43 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:44.131013 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3b7733bf-6463-4bde-9044-e4c92b9b8cdc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:44.131618 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3b7733bf-6463-4bde-9044-e4c92b9b8cdc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:44.137505 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3b7733bf-6463-4bde-9044-e4c92b9b8cdc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:44.137968 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3b7733bf-6463-4bde-9044-e4c92b9b8cdc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:44.138733 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3b7733bf-6463-4bde-9044-e4c92b9b8cdc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:44.139165 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3b7733bf-6463-4bde-9044-e4c92b9b8cdc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:44.199117 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-3b7733bf-6463-4bde-9044-e4c92b9b8cdc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:44.206681 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3b7733bf-6463-4bde-9044-e4c92b9b8cdc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.080089 Aug 25 05:46:44.207256 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 839/1713] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:44 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:44.942385 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-4d03e19a-0182-42c7-8da6-d513d8a4a0ba tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:44.943276 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-4d03e19a-0182-42c7-8da6-d513d8a4a0ba tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:44.949114 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4d03e19a-0182-42c7-8da6-d513d8a4a0ba tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:44.949572 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4d03e19a-0182-42c7-8da6-d513d8a4a0ba tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:44.950325 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4d03e19a-0182-42c7-8da6-d513d8a4a0ba tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:44.950750 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4d03e19a-0182-42c7-8da6-d513d8a4a0ba tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:44.984033 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-4d03e19a-0182-42c7-8da6-d513d8a4a0ba tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045561 Aug 25 05:46:44.984657 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 875/1714] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:44 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:45.223458 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d62b427b-e825-4bc9-800e-6d74a8bfb9cd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:45.224021 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-d62b427b-e825-4bc9-800e-6d74a8bfb9cd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:45.229796 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d62b427b-e825-4bc9-800e-6d74a8bfb9cd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:45.230236 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d62b427b-e825-4bc9-800e-6d74a8bfb9cd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:45.230989 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d62b427b-e825-4bc9-800e-6d74a8bfb9cd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:45.231413 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d62b427b-e825-4bc9-800e-6d74a8bfb9cd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:45.290250 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-d62b427b-e825-4bc9-800e-6d74a8bfb9cd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:45.297594 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d62b427b-e825-4bc9-800e-6d74a8bfb9cd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.078044 Aug 25 05:46:45.298159 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 840/1715] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:45 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:45.996638 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f386ba1c-672d-40e2-9e4d-b2a5ebb986ad tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:45.997481 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f386ba1c-672d-40e2-9e4d-b2a5ebb986ad tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:46.003300 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f386ba1c-672d-40e2-9e4d-b2a5ebb986ad tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:46.003740 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f386ba1c-672d-40e2-9e4d-b2a5ebb986ad tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:46.005111 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f386ba1c-672d-40e2-9e4d-b2a5ebb986ad tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:46.005551 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f386ba1c-672d-40e2-9e4d-b2a5ebb986ad tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:46.035931 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f386ba1c-672d-40e2-9e4d-b2a5ebb986ad tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043067 Aug 25 05:46:46.036479 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 876/1716] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:45 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:46.314859 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b470e4ff-19e6-4c78-9693-ac690a4c8fca tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:46.315464 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b470e4ff-19e6-4c78-9693-ac690a4c8fca tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:46.321910 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b470e4ff-19e6-4c78-9693-ac690a4c8fca tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:46.322377 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b470e4ff-19e6-4c78-9693-ac690a4c8fca tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:46.323126 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b470e4ff-19e6-4c78-9693-ac690a4c8fca tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:46.323549 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b470e4ff-19e6-4c78-9693-ac690a4c8fca tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:46.386613 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-b470e4ff-19e6-4c78-9693-ac690a4c8fca tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:46.393848 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b470e4ff-19e6-4c78-9693-ac690a4c8fca tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.083662 Aug 25 05:46:46.394409 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 841/1717] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:46 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:47.047536 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e14124f4-d163-4067-9eb5-068c92b44add tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:47.048434 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e14124f4-d163-4067-9eb5-068c92b44add tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:47.054668 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e14124f4-d163-4067-9eb5-068c92b44add tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:47.055135 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e14124f4-d163-4067-9eb5-068c92b44add tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:47.055907 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e14124f4-d163-4067-9eb5-068c92b44add tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:47.056340 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e14124f4-d163-4067-9eb5-068c92b44add tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:47.085351 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e14124f4-d163-4067-9eb5-068c92b44add tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041624 Aug 25 05:46:47.085924 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 877/1718] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:47 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:47.410279 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ae73c7c5-3535-4a83-9f4f-ab7150523bd7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:47.411479 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ae73c7c5-3535-4a83-9f4f-ab7150523bd7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:47.417238 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ae73c7c5-3535-4a83-9f4f-ab7150523bd7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:47.417722 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ae73c7c5-3535-4a83-9f4f-ab7150523bd7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:47.418485 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ae73c7c5-3535-4a83-9f4f-ab7150523bd7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:47.418908 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ae73c7c5-3535-4a83-9f4f-ab7150523bd7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:47.478374 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ae73c7c5-3535-4a83-9f4f-ab7150523bd7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:47.485601 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ae73c7c5-3535-4a83-9f4f-ab7150523bd7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.078857 Aug 25 05:46:47.486158 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 842/1719] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:47 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:48.096137 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-821cf4d2-0cd6-4a99-8a86-839fa4efaf5c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:48.097032 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-821cf4d2-0cd6-4a99-8a86-839fa4efaf5c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:48.102947 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-821cf4d2-0cd6-4a99-8a86-839fa4efaf5c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:48.103382 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-821cf4d2-0cd6-4a99-8a86-839fa4efaf5c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:48.104130 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-821cf4d2-0cd6-4a99-8a86-839fa4efaf5c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:48.104556 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-821cf4d2-0cd6-4a99-8a86-839fa4efaf5c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:48.133588 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-821cf4d2-0cd6-4a99-8a86-839fa4efaf5c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041130 Aug 25 05:46:48.134188 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 878/1720] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:48 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:48.501908 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a6c2fe70-1fe7-41a0-8520-f0430dd5feff tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:48.502630 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a6c2fe70-1fe7-41a0-8520-f0430dd5feff tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:48.508411 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a6c2fe70-1fe7-41a0-8520-f0430dd5feff tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:48.508851 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a6c2fe70-1fe7-41a0-8520-f0430dd5feff tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:48.509640 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a6c2fe70-1fe7-41a0-8520-f0430dd5feff tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:48.510096 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a6c2fe70-1fe7-41a0-8520-f0430dd5feff tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:48.570018 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-a6c2fe70-1fe7-41a0-8520-f0430dd5feff tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:48.577232 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a6c2fe70-1fe7-41a0-8520-f0430dd5feff tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.078946 Aug 25 05:46:48.577822 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 843/1721] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:48 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:49.144846 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f9ece052-4363-4367-8e1f-8b4bf2d70852 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:49.145804 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f9ece052-4363-4367-8e1f-8b4bf2d70852 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:49.152714 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f9ece052-4363-4367-8e1f-8b4bf2d70852 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:49.153192 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f9ece052-4363-4367-8e1f-8b4bf2d70852 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:49.154006 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f9ece052-4363-4367-8e1f-8b4bf2d70852 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:49.154435 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f9ece052-4363-4367-8e1f-8b4bf2d70852 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:49.183344 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f9ece052-4363-4367-8e1f-8b4bf2d70852 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042193 Aug 25 05:46:49.183916 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 879/1722] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:49 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:49.594127 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-2f1553e3-72a6-48a3-82a8-fffee516602a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:49.594728 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-2f1553e3-72a6-48a3-82a8-fffee516602a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:49.601148 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2f1553e3-72a6-48a3-82a8-fffee516602a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:49.601613 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2f1553e3-72a6-48a3-82a8-fffee516602a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:49.602379 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2f1553e3-72a6-48a3-82a8-fffee516602a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:49.602811 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2f1553e3-72a6-48a3-82a8-fffee516602a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:49.663577 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-2f1553e3-72a6-48a3-82a8-fffee516602a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:49.670777 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-2f1553e3-72a6-48a3-82a8-fffee516602a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.080375 Aug 25 05:46:49.671376 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 844/1723] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:49 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:50.194744 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-61cf0e74-d769-493a-8e0e-ae85adcc12aa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:50.195637 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-61cf0e74-d769-493a-8e0e-ae85adcc12aa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:50.201547 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-61cf0e74-d769-493a-8e0e-ae85adcc12aa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:50.201986 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-61cf0e74-d769-493a-8e0e-ae85adcc12aa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:50.202734 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-61cf0e74-d769-493a-8e0e-ae85adcc12aa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:50.203157 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-61cf0e74-d769-493a-8e0e-ae85adcc12aa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:50.232457 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-61cf0e74-d769-493a-8e0e-ae85adcc12aa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041544 Aug 25 05:46:50.232998 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 880/1724] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:50 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:50.688153 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-10cabf69-3756-443c-a41e-1b54debcac3b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:50.688762 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-10cabf69-3756-443c-a41e-1b54debcac3b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:50.695274 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-10cabf69-3756-443c-a41e-1b54debcac3b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:50.695719 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-10cabf69-3756-443c-a41e-1b54debcac3b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:50.696487 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-10cabf69-3756-443c-a41e-1b54debcac3b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:50.696970 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-10cabf69-3756-443c-a41e-1b54debcac3b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:50.766851 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-10cabf69-3756-443c-a41e-1b54debcac3b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:50.774361 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-10cabf69-3756-443c-a41e-1b54debcac3b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.089888 Aug 25 05:46:50.774911 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 845/1725] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:50 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:51.244748 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f0e4c398-3b58-47df-ae89-1c37b89618f2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:51.245684 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f0e4c398-3b58-47df-ae89-1c37b89618f2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:51.251495 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f0e4c398-3b58-47df-ae89-1c37b89618f2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:51.251938 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f0e4c398-3b58-47df-ae89-1c37b89618f2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:51.252702 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f0e4c398-3b58-47df-ae89-1c37b89618f2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:51.253132 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f0e4c398-3b58-47df-ae89-1c37b89618f2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:51.281361 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f0e4c398-3b58-47df-ae89-1c37b89618f2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041230 Aug 25 05:46:51.281949 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 881/1726] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:51 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:51.792315 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-f0368ddb-075d-41dd-9702-ebb69d3e047d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:51.793234 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-f0368ddb-075d-41dd-9702-ebb69d3e047d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:51.801034 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f0368ddb-075d-41dd-9702-ebb69d3e047d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:51.801474 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f0368ddb-075d-41dd-9702-ebb69d3e047d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:51.802402 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f0368ddb-075d-41dd-9702-ebb69d3e047d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:51.802786 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f0368ddb-075d-41dd-9702-ebb69d3e047d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:51.861688 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-f0368ddb-075d-41dd-9702-ebb69d3e047d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:51.868923 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-f0368ddb-075d-41dd-9702-ebb69d3e047d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.082493 Aug 25 05:46:51.869483 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 846/1727] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:51 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:52.292185 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-33f4c994-e399-4cd0-a0ca-b3954aa0ceb1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:52.293138 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-33f4c994-e399-4cd0-a0ca-b3954aa0ceb1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:52.298971 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-33f4c994-e399-4cd0-a0ca-b3954aa0ceb1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:52.299406 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-33f4c994-e399-4cd0-a0ca-b3954aa0ceb1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:52.300152 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-33f4c994-e399-4cd0-a0ca-b3954aa0ceb1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:52.300581 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-33f4c994-e399-4cd0-a0ca-b3954aa0ceb1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:52.329946 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-33f4c994-e399-4cd0-a0ca-b3954aa0ceb1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041506 Aug 25 05:46:52.330483 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 882/1728] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:52 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:52.885702 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-488c83c9-b412-4f8b-a836-8fc029f0bf62 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:52.886267 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-488c83c9-b412-4f8b-a836-8fc029f0bf62 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:52.891994 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-488c83c9-b412-4f8b-a836-8fc029f0bf62 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:52.892437 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-488c83c9-b412-4f8b-a836-8fc029f0bf62 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:52.893191 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-488c83c9-b412-4f8b-a836-8fc029f0bf62 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:52.893649 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-488c83c9-b412-4f8b-a836-8fc029f0bf62 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:52.957188 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-488c83c9-b412-4f8b-a836-8fc029f0bf62 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:52.964876 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-488c83c9-b412-4f8b-a836-8fc029f0bf62 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.083133 Aug 25 05:46:52.965461 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 847/1729] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:52 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:53.340924 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-415b8716-ad98-4e1f-9b63-2d53d2935935 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:53.341847 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-415b8716-ad98-4e1f-9b63-2d53d2935935 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:53.347777 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-415b8716-ad98-4e1f-9b63-2d53d2935935 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:53.348208 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-415b8716-ad98-4e1f-9b63-2d53d2935935 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:53.348986 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-415b8716-ad98-4e1f-9b63-2d53d2935935 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:53.350504 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-415b8716-ad98-4e1f-9b63-2d53d2935935 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:53.379043 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-415b8716-ad98-4e1f-9b63-2d53d2935935 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041813 Aug 25 05:46:53.379584 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 883/1730] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:53 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:53.982126 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-10762085-aaef-45b3-9719-831c7bc606bb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:53.982668 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-10762085-aaef-45b3-9719-831c7bc606bb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:53.988692 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-10762085-aaef-45b3-9719-831c7bc606bb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:53.989147 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-10762085-aaef-45b3-9719-831c7bc606bb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:53.990562 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-10762085-aaef-45b3-9719-831c7bc606bb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:53.991033 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-10762085-aaef-45b3-9719-831c7bc606bb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:54.054876 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-10762085-aaef-45b3-9719-831c7bc606bb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:54.062182 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-10762085-aaef-45b3-9719-831c7bc606bb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.083819 Aug 25 05:46:54.062751 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 848/1731] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:53 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:54.391422 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-102797ac-071f-48ee-ac22-853de7709b1a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:54.392307 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-102797ac-071f-48ee-ac22-853de7709b1a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:54.398979 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-102797ac-071f-48ee-ac22-853de7709b1a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:54.399414 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-102797ac-071f-48ee-ac22-853de7709b1a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:54.400161 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-102797ac-071f-48ee-ac22-853de7709b1a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:54.400584 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-102797ac-071f-48ee-ac22-853de7709b1a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:54.430439 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-102797ac-071f-48ee-ac22-853de7709b1a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042707 Aug 25 05:46:54.430993 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 884/1732] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:54 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:55.079518 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-219fc79b-01a0-43b6-82aa-4128694a4757 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:55.080112 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-219fc79b-01a0-43b6-82aa-4128694a4757 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:55.086333 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-219fc79b-01a0-43b6-82aa-4128694a4757 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:55.086778 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-219fc79b-01a0-43b6-82aa-4128694a4757 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:55.087578 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-219fc79b-01a0-43b6-82aa-4128694a4757 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:55.088010 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-219fc79b-01a0-43b6-82aa-4128694a4757 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:55.148079 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-219fc79b-01a0-43b6-82aa-4128694a4757 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:55.155628 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-219fc79b-01a0-43b6-82aa-4128694a4757 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.079778 Aug 25 05:46:55.156183 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 849/1733] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:55 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:55.441744 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-38b7af40-7d26-4fd4-9433-22bb9e986022 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:55.442576 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-38b7af40-7d26-4fd4-9433-22bb9e986022 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:55.448726 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-38b7af40-7d26-4fd4-9433-22bb9e986022 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:55.449163 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-38b7af40-7d26-4fd4-9433-22bb9e986022 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:55.449954 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-38b7af40-7d26-4fd4-9433-22bb9e986022 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:55.450386 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-38b7af40-7d26-4fd4-9433-22bb9e986022 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:55.480402 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-38b7af40-7d26-4fd4-9433-22bb9e986022 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042676 Aug 25 05:46:55.480951 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 885/1734] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:55 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:56.172127 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a913cfcc-4f6a-456b-9e74-21d82846648a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:56.172779 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a913cfcc-4f6a-456b-9e74-21d82846648a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:56.179302 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a913cfcc-4f6a-456b-9e74-21d82846648a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:56.180064 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a913cfcc-4f6a-456b-9e74-21d82846648a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:56.180848 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a913cfcc-4f6a-456b-9e74-21d82846648a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:56.181285 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a913cfcc-4f6a-456b-9e74-21d82846648a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:56.239803 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-a913cfcc-4f6a-456b-9e74-21d82846648a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:56.248221 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a913cfcc-4f6a-456b-9e74-21d82846648a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.079714 Aug 25 05:46:56.248832 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 850/1735] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:56 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:56.492175 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c0ff534e-ce74-40bb-894d-1f683697849e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:56.493757 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c0ff534e-ce74-40bb-894d-1f683697849e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:56.499769 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c0ff534e-ce74-40bb-894d-1f683697849e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:56.500217 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c0ff534e-ce74-40bb-894d-1f683697849e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:56.500992 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c0ff534e-ce74-40bb-894d-1f683697849e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:56.501426 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c0ff534e-ce74-40bb-894d-1f683697849e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:56.531353 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c0ff534e-ce74-40bb-894d-1f683697849e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043177 Aug 25 05:46:56.531902 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 886/1736] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:56 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:57.265797 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-9c75a192-0930-4fb4-b8fd-147119115b4b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:57.266392 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-9c75a192-0930-4fb4-b8fd-147119115b4b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:57.272297 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9c75a192-0930-4fb4-b8fd-147119115b4b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:57.272895 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9c75a192-0930-4fb4-b8fd-147119115b4b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:57.274058 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9c75a192-0930-4fb4-b8fd-147119115b4b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:57.274488 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9c75a192-0930-4fb4-b8fd-147119115b4b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:57.333792 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-9c75a192-0930-4fb4-b8fd-147119115b4b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:57.341200 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-9c75a192-0930-4fb4-b8fd-147119115b4b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.079044 Aug 25 05:46:57.341781 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 851/1737] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:57 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:57.543479 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e093e284-2dc2-4ce2-a755-cb1bdcd8c4c6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:57.544382 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e093e284-2dc2-4ce2-a755-cb1bdcd8c4c6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:57.550186 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e093e284-2dc2-4ce2-a755-cb1bdcd8c4c6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:57.550623 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e093e284-2dc2-4ce2-a755-cb1bdcd8c4c6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:57.551375 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e093e284-2dc2-4ce2-a755-cb1bdcd8c4c6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:57.551797 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e093e284-2dc2-4ce2-a755-cb1bdcd8c4c6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:57.579466 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e093e284-2dc2-4ce2-a755-cb1bdcd8c4c6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040507 Aug 25 05:46:57.579996 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 887/1738] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:57 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:58.357703 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d5050ce7-dcd9-4f4c-8e69-faa4c7024234 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:58.358313 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-d5050ce7-dcd9-4f4c-8e69-faa4c7024234 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:58.364142 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d5050ce7-dcd9-4f4c-8e69-faa4c7024234 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:58.364590 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d5050ce7-dcd9-4f4c-8e69-faa4c7024234 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:58.365353 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d5050ce7-dcd9-4f4c-8e69-faa4c7024234 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:58.365810 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d5050ce7-dcd9-4f4c-8e69-faa4c7024234 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:58.431853 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-d5050ce7-dcd9-4f4c-8e69-faa4c7024234 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:58.439336 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d5050ce7-dcd9-4f4c-8e69-faa4c7024234 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.085301 Aug 25 05:46:58.439896 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 852/1739] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:58 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:58.591001 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2c465a3a-da3c-4e02-8387-592724b32098 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:58.591904 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2c465a3a-da3c-4e02-8387-592724b32098 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:58.597951 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2c465a3a-da3c-4e02-8387-592724b32098 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:58.598399 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2c465a3a-da3c-4e02-8387-592724b32098 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:58.599264 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2c465a3a-da3c-4e02-8387-592724b32098 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:58.599695 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2c465a3a-da3c-4e02-8387-592724b32098 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:58.629061 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2c465a3a-da3c-4e02-8387-592724b32098 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041829 Aug 25 05:46:58.629624 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 888/1740] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:58 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:46:59.456041 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d6c7e7d4-3a1f-4e9b-98b5-b84f2541a0f9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:59.456649 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-d6c7e7d4-3a1f-4e9b-98b5-b84f2541a0f9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:59.463370 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d6c7e7d4-3a1f-4e9b-98b5-b84f2541a0f9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:59.463824 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d6c7e7d4-3a1f-4e9b-98b5-b84f2541a0f9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:59.464586 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d6c7e7d4-3a1f-4e9b-98b5-b84f2541a0f9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:59.465027 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d6c7e7d4-3a1f-4e9b-98b5-b84f2541a0f9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:59.527931 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-d6c7e7d4-3a1f-4e9b-98b5-b84f2541a0f9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:46:59.535307 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d6c7e7d4-3a1f-4e9b-98b5-b84f2541a0f9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.082963 Aug 25 05:46:59.536183 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 853/1741] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:46:59 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:46:59.640625 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-63fa6739-dd25-43d1-b2fb-bb7e5575b2b0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:46:59.641519 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-63fa6739-dd25-43d1-b2fb-bb7e5575b2b0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:46:59.647826 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-63fa6739-dd25-43d1-b2fb-bb7e5575b2b0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:59.648549 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-63fa6739-dd25-43d1-b2fb-bb7e5575b2b0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:59.649390 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-63fa6739-dd25-43d1-b2fb-bb7e5575b2b0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:46:59.649838 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-63fa6739-dd25-43d1-b2fb-bb7e5575b2b0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:46:59.677481 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-63fa6739-dd25-43d1-b2fb-bb7e5575b2b0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040633 Aug 25 05:46:59.678039 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 889/1742] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:46:59 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:00.551986 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1051b456-bea5-4158-9899-3d2d73ef34e9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:00.552596 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1051b456-bea5-4158-9899-3d2d73ef34e9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:00.558647 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1051b456-bea5-4158-9899-3d2d73ef34e9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:00.559093 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1051b456-bea5-4158-9899-3d2d73ef34e9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:00.559846 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1051b456-bea5-4158-9899-3d2d73ef34e9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:00.560275 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1051b456-bea5-4158-9899-3d2d73ef34e9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:00.618763 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-1051b456-bea5-4158-9899-3d2d73ef34e9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:00.625919 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1051b456-bea5-4158-9899-3d2d73ef34e9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.077638 Aug 25 05:47:00.626475 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 854/1743] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:00 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:00.688277 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6b6acddf-c257-4d1a-95f6-ad2a08b6c455 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:00.689172 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6b6acddf-c257-4d1a-95f6-ad2a08b6c455 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:00.694931 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6b6acddf-c257-4d1a-95f6-ad2a08b6c455 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:00.695366 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6b6acddf-c257-4d1a-95f6-ad2a08b6c455 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:00.696104 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6b6acddf-c257-4d1a-95f6-ad2a08b6c455 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:00.696528 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6b6acddf-c257-4d1a-95f6-ad2a08b6c455 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:00.724537 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6b6acddf-c257-4d1a-95f6-ad2a08b6c455 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039953 Aug 25 05:47:00.725066 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 890/1744] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:00 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:01.641940 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7713ef1b-2753-4935-bd22-32da80989c7d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:01.642554 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7713ef1b-2753-4935-bd22-32da80989c7d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:01.648687 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7713ef1b-2753-4935-bd22-32da80989c7d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:01.649129 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7713ef1b-2753-4935-bd22-32da80989c7d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:01.649924 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7713ef1b-2753-4935-bd22-32da80989c7d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:01.650355 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7713ef1b-2753-4935-bd22-32da80989c7d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:01.708620 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-7713ef1b-2753-4935-bd22-32da80989c7d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:01.716061 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7713ef1b-2753-4935-bd22-32da80989c7d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.077864 Aug 25 05:47:01.716623 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 855/1745] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:01 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:01.736155 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-fbe0372b-2b3f-429f-ac1b-4c72b1b0e627 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:01.737096 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-fbe0372b-2b3f-429f-ac1b-4c72b1b0e627 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:01.743471 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fbe0372b-2b3f-429f-ac1b-4c72b1b0e627 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:01.743912 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fbe0372b-2b3f-429f-ac1b-4c72b1b0e627 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:01.744673 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fbe0372b-2b3f-429f-ac1b-4c72b1b0e627 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:01.745107 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fbe0372b-2b3f-429f-ac1b-4c72b1b0e627 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:01.773735 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-fbe0372b-2b3f-429f-ac1b-4c72b1b0e627 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041124 Aug 25 05:47:01.774279 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 891/1746] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:01 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:02.733341 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6ae4c954-d444-443e-a21f-0d45fce5f1e7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:02.733974 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6ae4c954-d444-443e-a21f-0d45fce5f1e7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:02.739752 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6ae4c954-d444-443e-a21f-0d45fce5f1e7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:02.740195 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6ae4c954-d444-443e-a21f-0d45fce5f1e7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:02.740979 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6ae4c954-d444-443e-a21f-0d45fce5f1e7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:02.741415 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6ae4c954-d444-443e-a21f-0d45fce5f1e7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:02.784371 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1892bf30-6d0e-4488-874a-f3dcdab43c92 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:02.785321 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1892bf30-6d0e-4488-874a-f3dcdab43c92 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:02.791807 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1892bf30-6d0e-4488-874a-f3dcdab43c92 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:02.792246 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1892bf30-6d0e-4488-874a-f3dcdab43c92 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:02.793001 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1892bf30-6d0e-4488-874a-f3dcdab43c92 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:02.793438 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1892bf30-6d0e-4488-874a-f3dcdab43c92 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:02.801182 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6ae4c954-d444-443e-a21f-0d45fce5f1e7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:02.809379 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6ae4c954-d444-443e-a21f-0d45fce5f1e7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.079550 Aug 25 05:47:02.810091 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 856/1747] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:02 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:02.823915 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1892bf30-6d0e-4488-874a-f3dcdab43c92 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043441 Aug 25 05:47:02.824757 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 892/1748] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:02 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:47:03.826511 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5cd66a64-39a6-4210-9cb0-a797019f85f6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:03.827089 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5cd66a64-39a6-4210-9cb0-a797019f85f6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:03.832919 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5cd66a64-39a6-4210-9cb0-a797019f85f6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:03.833360 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5cd66a64-39a6-4210-9cb0-a797019f85f6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:03.834143 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5cd66a64-39a6-4210-9cb0-a797019f85f6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:03.834568 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5cd66a64-39a6-4210-9cb0-a797019f85f6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:03.835191 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a5d91992-9bd4-4a41-9d1f-981a9e0a326c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:03.836767 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a5d91992-9bd4-4a41-9d1f-981a9e0a326c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:03.842479 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a5d91992-9bd4-4a41-9d1f-981a9e0a326c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:03.842926 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a5d91992-9bd4-4a41-9d1f-981a9e0a326c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:03.843758 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a5d91992-9bd4-4a41-9d1f-981a9e0a326c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:03.844186 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a5d91992-9bd4-4a41-9d1f-981a9e0a326c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:03.873094 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a5d91992-9bd4-4a41-9d1f-981a9e0a326c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041549 Aug 25 05:47:03.873683 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 893/1749] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:03 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:47:03.894036 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-5cd66a64-39a6-4210-9cb0-a797019f85f6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:03.901596 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5cd66a64-39a6-4210-9cb0-a797019f85f6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.078823 Aug 25 05:47:03.902152 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 857/1750] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:03 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:04.885027 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7a51c376-8725-4a05-bf2a-678934120975 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:04.885959 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-7a51c376-8725-4a05-bf2a-678934120975 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:04.891718 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7a51c376-8725-4a05-bf2a-678934120975 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:04.892154 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7a51c376-8725-4a05-bf2a-678934120975 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:04.892939 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7a51c376-8725-4a05-bf2a-678934120975 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:04.893366 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7a51c376-8725-4a05-bf2a-678934120975 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:04.918084 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-2fbbeafd-e205-4dbb-a93a-89b23619ebdb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:04.918723 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-2fbbeafd-e205-4dbb-a93a-89b23619ebdb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:04.924512 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2fbbeafd-e205-4dbb-a93a-89b23619ebdb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:04.924962 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2fbbeafd-e205-4dbb-a93a-89b23619ebdb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:04.925770 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2fbbeafd-e205-4dbb-a93a-89b23619ebdb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:04.926208 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2fbbeafd-e205-4dbb-a93a-89b23619ebdb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:04.928014 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-7a51c376-8725-4a05-bf2a-678934120975 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047358 Aug 25 05:47:04.929648 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 894/1751] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:04 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:04.987843 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-2fbbeafd-e205-4dbb-a93a-89b23619ebdb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:04.995922 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-2fbbeafd-e205-4dbb-a93a-89b23619ebdb tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.081743 Aug 25 05:47:04.996483 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 858/1752] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:04 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:47:05.940486 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5776241f-81dc-4ac3-b07a-5648decd436f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:05.941328 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5776241f-81dc-4ac3-b07a-5648decd436f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:05.948150 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5776241f-81dc-4ac3-b07a-5648decd436f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:05.948589 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5776241f-81dc-4ac3-b07a-5648decd436f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:05.949358 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5776241f-81dc-4ac3-b07a-5648decd436f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:05.949811 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5776241f-81dc-4ac3-b07a-5648decd436f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:05.980096 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5776241f-81dc-4ac3-b07a-5648decd436f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043401 Aug 25 05:47:05.980651 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 895/1753] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:05 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:06.012742 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e5086080-a2dc-4d2e-bf7f-498e95af4a70 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:06.013348 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e5086080-a2dc-4d2e-bf7f-498e95af4a70 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:06.019496 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e5086080-a2dc-4d2e-bf7f-498e95af4a70 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:06.019937 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e5086080-a2dc-4d2e-bf7f-498e95af4a70 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:06.020699 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e5086080-a2dc-4d2e-bf7f-498e95af4a70 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:06.021124 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e5086080-a2dc-4d2e-bf7f-498e95af4a70 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:06.084599 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e5086080-a2dc-4d2e-bf7f-498e95af4a70 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:06.099804 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e5086080-a2dc-4d2e-bf7f-498e95af4a70 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.090212 Aug 25 05:47:06.100561 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 859/1754] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:06 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:47:06.992214 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b13dde18-0d07-4038-a9c1-f5d61a58dbaf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:06.993063 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b13dde18-0d07-4038-a9c1-f5d61a58dbaf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:06.999045 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b13dde18-0d07-4038-a9c1-f5d61a58dbaf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:06.999482 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b13dde18-0d07-4038-a9c1-f5d61a58dbaf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:07.000265 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b13dde18-0d07-4038-a9c1-f5d61a58dbaf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:07.000687 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b13dde18-0d07-4038-a9c1-f5d61a58dbaf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:07.030297 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b13dde18-0d07-4038-a9c1-f5d61a58dbaf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042389 Aug 25 05:47:07.030831 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 896/1755] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:06 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:07.119854 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6b986c50-2b2b-4231-89f4-069721238a07 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:07.120452 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6b986c50-2b2b-4231-89f4-069721238a07 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:07.126265 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6b986c50-2b2b-4231-89f4-069721238a07 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:07.126705 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6b986c50-2b2b-4231-89f4-069721238a07 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:07.127459 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6b986c50-2b2b-4231-89f4-069721238a07 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:07.127886 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6b986c50-2b2b-4231-89f4-069721238a07 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:07.186225 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6b986c50-2b2b-4231-89f4-069721238a07 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:07.193276 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6b986c50-2b2b-4231-89f4-069721238a07 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.077254 Aug 25 05:47:07.193860 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 860/1756] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:07 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:08.042176 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9d1f9c1d-531d-41ba-a9cc-b007b036c87e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:08.043140 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9d1f9c1d-531d-41ba-a9cc-b007b036c87e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:08.048900 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9d1f9c1d-531d-41ba-a9cc-b007b036c87e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:08.049339 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9d1f9c1d-531d-41ba-a9cc-b007b036c87e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:08.050129 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9d1f9c1d-531d-41ba-a9cc-b007b036c87e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:08.050558 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9d1f9c1d-531d-41ba-a9cc-b007b036c87e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:08.079299 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9d1f9c1d-531d-41ba-a9cc-b007b036c87e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041424 Aug 25 05:47:08.079841 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 897/1757] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:08 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:08.209539 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-80b8ca6c-cba3-416b-a71e-7f5e161641f0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:08.210170 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-80b8ca6c-cba3-416b-a71e-7f5e161641f0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:08.216341 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-80b8ca6c-cba3-416b-a71e-7f5e161641f0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:08.216783 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-80b8ca6c-cba3-416b-a71e-7f5e161641f0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:08.217554 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-80b8ca6c-cba3-416b-a71e-7f5e161641f0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:08.217994 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-80b8ca6c-cba3-416b-a71e-7f5e161641f0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:08.276712 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-80b8ca6c-cba3-416b-a71e-7f5e161641f0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:08.283945 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-80b8ca6c-cba3-416b-a71e-7f5e161641f0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.078045 Aug 25 05:47:08.284492 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 861/1758] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:08 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:09.090545 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-dcf6100b-0386-4e24-8328-6ad0ed0410f4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:09.091472 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-dcf6100b-0386-4e24-8328-6ad0ed0410f4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:09.097243 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-dcf6100b-0386-4e24-8328-6ad0ed0410f4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:09.097713 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-dcf6100b-0386-4e24-8328-6ad0ed0410f4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:09.098471 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-dcf6100b-0386-4e24-8328-6ad0ed0410f4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:09.098906 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-dcf6100b-0386-4e24-8328-6ad0ed0410f4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:09.127958 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-dcf6100b-0386-4e24-8328-6ad0ed0410f4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041143 Aug 25 05:47:09.128500 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 898/1759] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:09 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:09.301266 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c1016266-f75f-42ec-b02e-0f05bef8bb1d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:09.301905 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c1016266-f75f-42ec-b02e-0f05bef8bb1d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:09.308352 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c1016266-f75f-42ec-b02e-0f05bef8bb1d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:09.308796 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c1016266-f75f-42ec-b02e-0f05bef8bb1d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:09.309583 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c1016266-f75f-42ec-b02e-0f05bef8bb1d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:09.310021 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c1016266-f75f-42ec-b02e-0f05bef8bb1d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:09.369364 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-c1016266-f75f-42ec-b02e-0f05bef8bb1d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:09.376583 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c1016266-f75f-42ec-b02e-0f05bef8bb1d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.079019 Aug 25 05:47:09.377133 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 862/1760] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:09 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:10.139558 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-4eed7f0d-8688-405a-828d-192d494448e9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:10.140452 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-4eed7f0d-8688-405a-828d-192d494448e9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:10.146297 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4eed7f0d-8688-405a-828d-192d494448e9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:10.146731 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4eed7f0d-8688-405a-828d-192d494448e9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:10.147474 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4eed7f0d-8688-405a-828d-192d494448e9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:10.148707 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4eed7f0d-8688-405a-828d-192d494448e9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:10.177470 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-4eed7f0d-8688-405a-828d-192d494448e9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041617 Aug 25 05:47:10.178033 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 899/1761] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:10 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:10.393812 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8a670c50-7924-40b7-a675-9a76378e10b7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:10.394351 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8a670c50-7924-40b7-a675-9a76378e10b7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:10.400907 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8a670c50-7924-40b7-a675-9a76378e10b7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:10.401343 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8a670c50-7924-40b7-a675-9a76378e10b7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:10.402151 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8a670c50-7924-40b7-a675-9a76378e10b7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:10.402563 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8a670c50-7924-40b7-a675-9a76378e10b7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:10.461203 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-8a670c50-7924-40b7-a675-9a76378e10b7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:10.468517 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8a670c50-7924-40b7-a675-9a76378e10b7 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.078425 Aug 25 05:47:10.469070 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 863/1762] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:10 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:11.188809 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9243cac0-a2b7-4228-a0f6-74ae791033bd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:11.189735 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9243cac0-a2b7-4228-a0f6-74ae791033bd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:11.195491 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9243cac0-a2b7-4228-a0f6-74ae791033bd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:11.195924 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9243cac0-a2b7-4228-a0f6-74ae791033bd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:11.196680 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9243cac0-a2b7-4228-a0f6-74ae791033bd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:11.197107 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9243cac0-a2b7-4228-a0f6-74ae791033bd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:11.224658 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9243cac0-a2b7-4228-a0f6-74ae791033bd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039652 Aug 25 05:47:11.225201 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 900/1763] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:11 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:11.485416 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e110e4bd-df53-4409-b44f-6f166959cd33 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:11.486003 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e110e4bd-df53-4409-b44f-6f166959cd33 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:11.491932 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e110e4bd-df53-4409-b44f-6f166959cd33 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:11.492440 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e110e4bd-df53-4409-b44f-6f166959cd33 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:11.493198 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e110e4bd-df53-4409-b44f-6f166959cd33 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:11.493783 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e110e4bd-df53-4409-b44f-6f166959cd33 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:11.553995 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e110e4bd-df53-4409-b44f-6f166959cd33 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:11.561492 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e110e4bd-df53-4409-b44f-6f166959cd33 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.079808 Aug 25 05:47:11.562208 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 864/1764] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:11 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:12.236419 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-74b411be-db6f-4b53-8259-2d8cda56e58f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:12.237355 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-74b411be-db6f-4b53-8259-2d8cda56e58f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:12.243419 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-74b411be-db6f-4b53-8259-2d8cda56e58f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:12.243853 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-74b411be-db6f-4b53-8259-2d8cda56e58f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:12.244610 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-74b411be-db6f-4b53-8259-2d8cda56e58f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:12.245039 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-74b411be-db6f-4b53-8259-2d8cda56e58f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:12.273873 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-74b411be-db6f-4b53-8259-2d8cda56e58f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040298 Aug 25 05:47:12.274625 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 901/1765] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:12 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:47:12.578621 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-204fe485-a11d-47c4-bfc7-666b99b9198b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:12.579235 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-204fe485-a11d-47c4-bfc7-666b99b9198b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:12.585251 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-204fe485-a11d-47c4-bfc7-666b99b9198b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:12.586280 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-204fe485-a11d-47c4-bfc7-666b99b9198b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:12.587033 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-204fe485-a11d-47c4-bfc7-666b99b9198b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:12.587463 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-204fe485-a11d-47c4-bfc7-666b99b9198b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:12.650939 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-204fe485-a11d-47c4-bfc7-666b99b9198b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:12.658190 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-204fe485-a11d-47c4-bfc7-666b99b9198b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.083224 Aug 25 05:47:12.658751 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 865/1766] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:12 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:13.285599 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-bdeef0cd-f008-44a9-849c-1b925001ffc7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:13.286540 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-bdeef0cd-f008-44a9-849c-1b925001ffc7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:13.292825 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bdeef0cd-f008-44a9-849c-1b925001ffc7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:13.293265 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bdeef0cd-f008-44a9-849c-1b925001ffc7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:13.294060 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bdeef0cd-f008-44a9-849c-1b925001ffc7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:13.294485 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bdeef0cd-f008-44a9-849c-1b925001ffc7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:13.322875 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-bdeef0cd-f008-44a9-849c-1b925001ffc7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041115 Aug 25 05:47:13.323419 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 902/1767] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:13 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:13.674651 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e2eda7aa-f17c-4b31-bfe7-7f11d21a339d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:13.675259 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e2eda7aa-f17c-4b31-bfe7-7f11d21a339d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:13.681580 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e2eda7aa-f17c-4b31-bfe7-7f11d21a339d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:13.682029 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e2eda7aa-f17c-4b31-bfe7-7f11d21a339d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:13.682789 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e2eda7aa-f17c-4b31-bfe7-7f11d21a339d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:13.683213 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e2eda7aa-f17c-4b31-bfe7-7f11d21a339d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:13.752684 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e2eda7aa-f17c-4b31-bfe7-7f11d21a339d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:13.757949 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e2eda7aa-f17c-4b31-bfe7-7f11d21a339d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.086309 Aug 25 05:47:13.758500 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 866/1768] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:13 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:14.334179 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-3b172a84-a1e9-443f-a452-3b40974e1f22 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:14.335109 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-3b172a84-a1e9-443f-a452-3b40974e1f22 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:14.340975 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3b172a84-a1e9-443f-a452-3b40974e1f22 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:14.341418 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3b172a84-a1e9-443f-a452-3b40974e1f22 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:14.342206 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3b172a84-a1e9-443f-a452-3b40974e1f22 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:14.342635 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3b172a84-a1e9-443f-a452-3b40974e1f22 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:14.373084 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-3b172a84-a1e9-443f-a452-3b40974e1f22 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042617 Aug 25 05:47:14.373674 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 903/1769] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:14 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:14.774863 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-61c394c9-b73d-434e-9bef-2c39863948c0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:14.776030 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-61c394c9-b73d-434e-9bef-2c39863948c0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:14.782010 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-61c394c9-b73d-434e-9bef-2c39863948c0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:14.782459 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-61c394c9-b73d-434e-9bef-2c39863948c0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:14.783224 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-61c394c9-b73d-434e-9bef-2c39863948c0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:14.783647 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-61c394c9-b73d-434e-9bef-2c39863948c0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:14.843160 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-61c394c9-b73d-434e-9bef-2c39863948c0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:14.850382 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-61c394c9-b73d-434e-9bef-2c39863948c0 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.079824 Aug 25 05:47:14.850952 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 867/1770] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:14 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:15.388497 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b8978352-a16d-4a51-8de7-92445368432d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:15.389406 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b8978352-a16d-4a51-8de7-92445368432d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:15.395255 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b8978352-a16d-4a51-8de7-92445368432d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:15.395701 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b8978352-a16d-4a51-8de7-92445368432d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:15.396462 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b8978352-a16d-4a51-8de7-92445368432d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:15.396897 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b8978352-a16d-4a51-8de7-92445368432d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:15.425101 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b8978352-a16d-4a51-8de7-92445368432d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040378 Aug 25 05:47:15.425661 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 904/1771] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:15 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:15.867358 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5a0052d4-3769-4748-9d80-24996619f3be tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:15.868222 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5a0052d4-3769-4748-9d80-24996619f3be tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:15.874050 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5a0052d4-3769-4748-9d80-24996619f3be tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:15.874495 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5a0052d4-3769-4748-9d80-24996619f3be tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:15.875248 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5a0052d4-3769-4748-9d80-24996619f3be tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:15.875718 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5a0052d4-3769-4748-9d80-24996619f3be tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:15.934588 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-5a0052d4-3769-4748-9d80-24996619f3be tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:15.941777 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5a0052d4-3769-4748-9d80-24996619f3be tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.078627 Aug 25 05:47:15.942344 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 868/1772] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:15 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:16.436428 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-4b53e957-c531-4d45-8370-0053e0c97ea3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:16.437325 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-4b53e957-c531-4d45-8370-0053e0c97ea3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:16.443202 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4b53e957-c531-4d45-8370-0053e0c97ea3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:16.443653 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4b53e957-c531-4d45-8370-0053e0c97ea3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:16.444407 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4b53e957-c531-4d45-8370-0053e0c97ea3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:16.445824 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4b53e957-c531-4d45-8370-0053e0c97ea3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:16.475432 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-4b53e957-c531-4d45-8370-0053e0c97ea3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042816 Aug 25 05:47:16.476028 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 905/1773] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:16 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:16.957961 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-23990835-209b-44a7-8bb5-3fee854ec452 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:16.958561 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-23990835-209b-44a7-8bb5-3fee854ec452 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:16.964957 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-23990835-209b-44a7-8bb5-3fee854ec452 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:16.965396 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-23990835-209b-44a7-8bb5-3fee854ec452 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:16.966177 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-23990835-209b-44a7-8bb5-3fee854ec452 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:16.966605 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-23990835-209b-44a7-8bb5-3fee854ec452 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:17.026722 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-23990835-209b-44a7-8bb5-3fee854ec452 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:17.034085 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-23990835-209b-44a7-8bb5-3fee854ec452 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.079712 Aug 25 05:47:17.034828 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 869/1774] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:16 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:17.486795 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-0dc45e83-df07-4650-9ec6-88977ac524b6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:17.487701 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-0dc45e83-df07-4650-9ec6-88977ac524b6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:17.494554 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0dc45e83-df07-4650-9ec6-88977ac524b6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:17.494998 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0dc45e83-df07-4650-9ec6-88977ac524b6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:17.495757 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0dc45e83-df07-4650-9ec6-88977ac524b6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:17.496188 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0dc45e83-df07-4650-9ec6-88977ac524b6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:17.526515 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-0dc45e83-df07-4650-9ec6-88977ac524b6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043479 Aug 25 05:47:17.527072 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 906/1775] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:17 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:18.050072 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b69631df-98e0-4738-8d3a-facd27d63af3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:18.050683 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b69631df-98e0-4738-8d3a-facd27d63af3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:18.057463 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b69631df-98e0-4738-8d3a-facd27d63af3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:18.057934 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b69631df-98e0-4738-8d3a-facd27d63af3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:18.058699 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b69631df-98e0-4738-8d3a-facd27d63af3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:18.059134 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b69631df-98e0-4738-8d3a-facd27d63af3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:18.118884 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-b69631df-98e0-4738-8d3a-facd27d63af3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:18.126259 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b69631df-98e0-4738-8d3a-facd27d63af3 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.079858 Aug 25 05:47:18.126821 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 870/1776] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:18 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:18.537848 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6f66a73b-344d-4934-9316-c6b95f36bb05 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:18.538891 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6f66a73b-344d-4934-9316-c6b95f36bb05 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:18.544758 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6f66a73b-344d-4934-9316-c6b95f36bb05 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:18.545198 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6f66a73b-344d-4934-9316-c6b95f36bb05 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:18.545980 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6f66a73b-344d-4934-9316-c6b95f36bb05 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:18.546407 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6f66a73b-344d-4934-9316-c6b95f36bb05 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:18.576304 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6f66a73b-344d-4934-9316-c6b95f36bb05 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042208 Aug 25 05:47:18.576851 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 907/1777] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:18 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:19.142687 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-2bb8a51d-e2a1-4950-aeea-92ef13a0c1fa tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:19.143371 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-2bb8a51d-e2a1-4950-aeea-92ef13a0c1fa tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:19.150053 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2bb8a51d-e2a1-4950-aeea-92ef13a0c1fa tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:19.150506 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2bb8a51d-e2a1-4950-aeea-92ef13a0c1fa tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:19.151297 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2bb8a51d-e2a1-4950-aeea-92ef13a0c1fa tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:19.151729 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2bb8a51d-e2a1-4950-aeea-92ef13a0c1fa tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:19.213817 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-2bb8a51d-e2a1-4950-aeea-92ef13a0c1fa tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:19.221662 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-2bb8a51d-e2a1-4950-aeea-92ef13a0c1fa tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.082655 Aug 25 05:47:19.222224 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 871/1778] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:19 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:19.587937 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a11a9876-c23e-41aa-8c9c-c44f43a8347e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:19.588837 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a11a9876-c23e-41aa-8c9c-c44f43a8347e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:19.594745 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a11a9876-c23e-41aa-8c9c-c44f43a8347e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:19.595183 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a11a9876-c23e-41aa-8c9c-c44f43a8347e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:19.595935 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a11a9876-c23e-41aa-8c9c-c44f43a8347e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:19.596362 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a11a9876-c23e-41aa-8c9c-c44f43a8347e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:19.626326 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a11a9876-c23e-41aa-8c9c-c44f43a8347e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042282 Aug 25 05:47:19.626885 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 908/1779] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:19 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:20.237358 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e0c58370-a0e5-4c78-91e0-e54b0d247218 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:20.238012 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e0c58370-a0e5-4c78-91e0-e54b0d247218 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:20.243798 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e0c58370-a0e5-4c78-91e0-e54b0d247218 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:20.244234 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e0c58370-a0e5-4c78-91e0-e54b0d247218 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:20.244985 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e0c58370-a0e5-4c78-91e0-e54b0d247218 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:20.245406 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e0c58370-a0e5-4c78-91e0-e54b0d247218 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:20.303266 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e0c58370-a0e5-4c78-91e0-e54b0d247218 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:20.310451 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e0c58370-a0e5-4c78-91e0-e54b0d247218 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.076678 Aug 25 05:47:20.311012 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 872/1780] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:20 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:20.640367 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-951700ac-f1d4-4147-bfa9-6f995400609e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:20.641189 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-951700ac-f1d4-4147-bfa9-6f995400609e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:20.646968 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-951700ac-f1d4-4147-bfa9-6f995400609e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:20.647406 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-951700ac-f1d4-4147-bfa9-6f995400609e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:20.648838 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-951700ac-f1d4-4147-bfa9-6f995400609e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:20.649289 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-951700ac-f1d4-4147-bfa9-6f995400609e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:20.677649 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-951700ac-f1d4-4147-bfa9-6f995400609e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042658 Aug 25 05:47:20.678191 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 909/1781] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:20 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:21.327288 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-74cf4968-f51b-4255-9bf0-d1388299ad57 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:21.327897 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-74cf4968-f51b-4255-9bf0-d1388299ad57 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:21.333917 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-74cf4968-f51b-4255-9bf0-d1388299ad57 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:21.334469 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-74cf4968-f51b-4255-9bf0-d1388299ad57 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:21.335192 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-74cf4968-f51b-4255-9bf0-d1388299ad57 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:21.336342 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-74cf4968-f51b-4255-9bf0-d1388299ad57 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:21.395226 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-74cf4968-f51b-4255-9bf0-d1388299ad57 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:21.403346 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-74cf4968-f51b-4255-9bf0-d1388299ad57 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.079748 Aug 25 05:47:21.403907 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 873/1782] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:21 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:21.689917 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6924c8a4-232d-48af-8a65-82427318ba58 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:21.690804 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6924c8a4-232d-48af-8a65-82427318ba58 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:21.697044 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6924c8a4-232d-48af-8a65-82427318ba58 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:21.697475 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6924c8a4-232d-48af-8a65-82427318ba58 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:21.698249 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6924c8a4-232d-48af-8a65-82427318ba58 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:21.698671 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6924c8a4-232d-48af-8a65-82427318ba58 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:21.727735 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6924c8a4-232d-48af-8a65-82427318ba58 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041415 Aug 25 05:47:21.728458 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 910/1783] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:21 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:22.420366 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7815c4a4-009c-4794-8b04-ee6b78c3501b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:22.420900 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7815c4a4-009c-4794-8b04-ee6b78c3501b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:22.426747 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7815c4a4-009c-4794-8b04-ee6b78c3501b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:22.427194 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7815c4a4-009c-4794-8b04-ee6b78c3501b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:22.427948 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7815c4a4-009c-4794-8b04-ee6b78c3501b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:22.428380 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7815c4a4-009c-4794-8b04-ee6b78c3501b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:22.486347 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-7815c4a4-009c-4794-8b04-ee6b78c3501b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:22.494244 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7815c4a4-009c-4794-8b04-ee6b78c3501b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.077588 Aug 25 05:47:22.494812 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 874/1784] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:22 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:22.739366 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-38fb28a7-7eda-408a-a7ba-41a6fae34394 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:22.740188 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-38fb28a7-7eda-408a-a7ba-41a6fae34394 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:22.746576 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-38fb28a7-7eda-408a-a7ba-41a6fae34394 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:22.747973 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-38fb28a7-7eda-408a-a7ba-41a6fae34394 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:22.747973 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-38fb28a7-7eda-408a-a7ba-41a6fae34394 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:22.748254 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-38fb28a7-7eda-408a-a7ba-41a6fae34394 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:22.777460 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-38fb28a7-7eda-408a-a7ba-41a6fae34394 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041900 Aug 25 05:47:22.778042 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 911/1785] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:22 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:23.510573 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-06afb702-efcd-4d42-b199-73a01b95e77d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:23.511266 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-06afb702-efcd-4d42-b199-73a01b95e77d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:23.517210 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-06afb702-efcd-4d42-b199-73a01b95e77d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:23.523744 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-06afb702-efcd-4d42-b199-73a01b95e77d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:23.523744 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-06afb702-efcd-4d42-b199-73a01b95e77d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:23.523744 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-06afb702-efcd-4d42-b199-73a01b95e77d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:23.579016 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-06afb702-efcd-4d42-b199-73a01b95e77d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:23.587024 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-06afb702-efcd-4d42-b199-73a01b95e77d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.080166 Aug 25 05:47:23.588739 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 875/1786] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:23 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:23.789070 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b4bc3226-0d96-4b32-859b-1aede358cd13 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:23.790062 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b4bc3226-0d96-4b32-859b-1aede358cd13 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:23.795996 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b4bc3226-0d96-4b32-859b-1aede358cd13 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:23.796440 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b4bc3226-0d96-4b32-859b-1aede358cd13 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:23.797202 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b4bc3226-0d96-4b32-859b-1aede358cd13 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:23.797667 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b4bc3226-0d96-4b32-859b-1aede358cd13 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:23.826947 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b4bc3226-0d96-4b32-859b-1aede358cd13 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041883 Aug 25 05:47:23.827498 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 912/1787] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:23 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:24.603250 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-9d1f5f3b-3400-4d20-b31f-5f67b0f01094 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:24.603853 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-9d1f5f3b-3400-4d20-b31f-5f67b0f01094 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:24.609614 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9d1f5f3b-3400-4d20-b31f-5f67b0f01094 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:24.610055 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9d1f5f3b-3400-4d20-b31f-5f67b0f01094 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:24.610803 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9d1f5f3b-3400-4d20-b31f-5f67b0f01094 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:24.611227 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9d1f5f3b-3400-4d20-b31f-5f67b0f01094 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:24.670714 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-9d1f5f3b-3400-4d20-b31f-5f67b0f01094 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:24.677961 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-9d1f5f3b-3400-4d20-b31f-5f67b0f01094 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.078986 Aug 25 05:47:24.678517 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 876/1788] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:24 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:24.839345 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7d633943-9f9d-4bcb-9bd7-00b5ca4915c7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:24.840205 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-7d633943-9f9d-4bcb-9bd7-00b5ca4915c7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:24.846060 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7d633943-9f9d-4bcb-9bd7-00b5ca4915c7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:24.846498 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7d633943-9f9d-4bcb-9bd7-00b5ca4915c7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:24.847248 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7d633943-9f9d-4bcb-9bd7-00b5ca4915c7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:24.847676 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7d633943-9f9d-4bcb-9bd7-00b5ca4915c7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:24.876540 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-7d633943-9f9d-4bcb-9bd7-00b5ca4915c7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041826 Aug 25 05:47:24.877077 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 913/1789] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:24 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:25.694767 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5ff29bf7-e885-4bc0-a802-dda5ab0b172d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:25.695371 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5ff29bf7-e885-4bc0-a802-dda5ab0b172d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:25.702009 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5ff29bf7-e885-4bc0-a802-dda5ab0b172d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:25.702445 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5ff29bf7-e885-4bc0-a802-dda5ab0b172d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:25.703196 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5ff29bf7-e885-4bc0-a802-dda5ab0b172d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:25.703617 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5ff29bf7-e885-4bc0-a802-dda5ab0b172d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:25.765838 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-5ff29bf7-e885-4bc0-a802-dda5ab0b172d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:25.773064 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5ff29bf7-e885-4bc0-a802-dda5ab0b172d tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.081925 Aug 25 05:47:25.773900 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 877/1790] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:25 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:47:25.888994 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-199aaa1c-1904-4b6f-a8ab-685e9d777bf8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:25.889847 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-199aaa1c-1904-4b6f-a8ab-685e9d777bf8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:25.895654 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-199aaa1c-1904-4b6f-a8ab-685e9d777bf8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:25.896092 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-199aaa1c-1904-4b6f-a8ab-685e9d777bf8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:25.896849 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-199aaa1c-1904-4b6f-a8ab-685e9d777bf8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:25.897280 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-199aaa1c-1904-4b6f-a8ab-685e9d777bf8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:25.926624 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-199aaa1c-1904-4b6f-a8ab-685e9d777bf8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042408 Aug 25 05:47:25.927160 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 914/1791] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:25 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:26.789429 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-afdfdb2f-d279-41dc-8121-1a86d1fafbff tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:26.790074 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-afdfdb2f-d279-41dc-8121-1a86d1fafbff tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:26.796688 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-afdfdb2f-d279-41dc-8121-1a86d1fafbff tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:26.797135 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-afdfdb2f-d279-41dc-8121-1a86d1fafbff tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:26.797930 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-afdfdb2f-d279-41dc-8121-1a86d1fafbff tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:26.798360 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-afdfdb2f-d279-41dc-8121-1a86d1fafbff tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:26.856428 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-afdfdb2f-d279-41dc-8121-1a86d1fafbff tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:26.863595 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-afdfdb2f-d279-41dc-8121-1a86d1fafbff tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.077870 Aug 25 05:47:26.864275 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 878/1792] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:26 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:26.938557 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-97c81c4c-a81b-4a8c-bf95-6246d24d1617 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:26.939458 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-97c81c4c-a81b-4a8c-bf95-6246d24d1617 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:26.945170 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-97c81c4c-a81b-4a8c-bf95-6246d24d1617 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:26.945640 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-97c81c4c-a81b-4a8c-bf95-6246d24d1617 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:26.946401 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-97c81c4c-a81b-4a8c-bf95-6246d24d1617 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:26.946835 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-97c81c4c-a81b-4a8c-bf95-6246d24d1617 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:26.974837 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-97c81c4c-a81b-4a8c-bf95-6246d24d1617 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040049 Aug 25 05:47:26.975376 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 915/1793] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:26 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:27.880373 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ac217bb8-43d6-4567-b438-c2a9d56ca77b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:27.880978 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ac217bb8-43d6-4567-b438-c2a9d56ca77b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:27.888890 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ac217bb8-43d6-4567-b438-c2a9d56ca77b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:27.889472 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ac217bb8-43d6-4567-b438-c2a9d56ca77b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:27.890351 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ac217bb8-43d6-4567-b438-c2a9d56ca77b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:27.890817 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ac217bb8-43d6-4567-b438-c2a9d56ca77b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:27.950380 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ac217bb8-43d6-4567-b438-c2a9d56ca77b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:27.957579 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ac217bb8-43d6-4567-b438-c2a9d56ca77b tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.081154 Aug 25 05:47:27.958133 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 879/1794] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:27 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:27.986220 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f2cd95da-b573-478c-ad0b-73a469545b2f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:27.987117 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f2cd95da-b573-478c-ad0b-73a469545b2f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:27.992777 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f2cd95da-b573-478c-ad0b-73a469545b2f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:28.012259 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f2cd95da-b573-478c-ad0b-73a469545b2f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:28.012259 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f2cd95da-b573-478c-ad0b-73a469545b2f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:28.012259 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f2cd95da-b573-478c-ad0b-73a469545b2f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:28.023668 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f2cd95da-b573-478c-ad0b-73a469545b2f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040898 Aug 25 05:47:28.024206 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 916/1795] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:27 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:28.980195 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-2f562ea6-11e7-42dd-b1cb-a7781aebe59c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:28.980826 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-2f562ea6-11e7-42dd-b1cb-a7781aebe59c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:28.986698 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2f562ea6-11e7-42dd-b1cb-a7781aebe59c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:28.987147 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2f562ea6-11e7-42dd-b1cb-a7781aebe59c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:28.987911 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2f562ea6-11e7-42dd-b1cb-a7781aebe59c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:28.988345 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2f562ea6-11e7-42dd-b1cb-a7781aebe59c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:29.034164 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-101e4474-716c-47c1-8346-2baa395a8fdf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:29.035087 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-101e4474-716c-47c1-8346-2baa395a8fdf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:29.040705 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-101e4474-716c-47c1-8346-2baa395a8fdf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:29.041263 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-101e4474-716c-47c1-8346-2baa395a8fdf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:29.042232 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-101e4474-716c-47c1-8346-2baa395a8fdf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:29.042665 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-101e4474-716c-47c1-8346-2baa395a8fdf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:29.047457 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-2f562ea6-11e7-42dd-b1cb-a7781aebe59c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:29.054742 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-2f562ea6-11e7-42dd-b1cb-a7781aebe59c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.078460 Aug 25 05:47:29.055321 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 880/1796] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:28 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:29.071828 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-101e4474-716c-47c1-8346-2baa395a8fdf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041353 Aug 25 05:47:29.072975 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 917/1797] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:29 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:47:30.071393 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7a599edb-ea1e-425c-9687-386b138e4062 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:30.071946 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7a599edb-ea1e-425c-9687-386b138e4062 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:30.078349 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7a599edb-ea1e-425c-9687-386b138e4062 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:30.078799 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7a599edb-ea1e-425c-9687-386b138e4062 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:30.079571 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7a599edb-ea1e-425c-9687-386b138e4062 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:30.080002 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7a599edb-ea1e-425c-9687-386b138e4062 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:30.083555 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1f812661-14b7-4543-9acb-16cd819193ad tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:30.084457 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1f812661-14b7-4543-9acb-16cd819193ad tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:30.090986 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1f812661-14b7-4543-9acb-16cd819193ad tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:30.091423 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1f812661-14b7-4543-9acb-16cd819193ad tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:30.092192 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1f812661-14b7-4543-9acb-16cd819193ad tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:30.092620 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1f812661-14b7-4543-9acb-16cd819193ad tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:30.125806 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1f812661-14b7-4543-9acb-16cd819193ad tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045913 Aug 25 05:47:30.126386 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 918/1798] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:30 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:47:30.156578 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-7a599edb-ea1e-425c-9687-386b138e4062 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:30.163983 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7a599edb-ea1e-425c-9687-386b138e4062 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.096400 Aug 25 05:47:30.164535 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 881/1799] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:30 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:31.137716 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-3f13ba48-0daa-4145-a8e8-99f458e24db5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:31.138656 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-3f13ba48-0daa-4145-a8e8-99f458e24db5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:31.144493 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3f13ba48-0daa-4145-a8e8-99f458e24db5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:31.144945 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3f13ba48-0daa-4145-a8e8-99f458e24db5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:31.145739 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3f13ba48-0daa-4145-a8e8-99f458e24db5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:31.146172 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3f13ba48-0daa-4145-a8e8-99f458e24db5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:31.175158 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-3f13ba48-0daa-4145-a8e8-99f458e24db5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041888 Aug 25 05:47:31.175705 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 919/1800] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:31 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:31.180943 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6071638f-06cb-4de7-ab1d-43c319ad7382 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:31.181575 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6071638f-06cb-4de7-ab1d-43c319ad7382 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:31.187668 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6071638f-06cb-4de7-ab1d-43c319ad7382 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:31.188118 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6071638f-06cb-4de7-ab1d-43c319ad7382 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:31.188886 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6071638f-06cb-4de7-ab1d-43c319ad7382 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:31.189321 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6071638f-06cb-4de7-ab1d-43c319ad7382 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:31.247676 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6071638f-06cb-4de7-ab1d-43c319ad7382 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:31.254861 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6071638f-06cb-4de7-ab1d-43c319ad7382 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.077489 Aug 25 05:47:31.255428 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 882/1801] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:31 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:32.187435 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d0e05fb3-f36d-46a1-8394-046ac9627000 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:32.188338 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d0e05fb3-f36d-46a1-8394-046ac9627000 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:32.194185 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d0e05fb3-f36d-46a1-8394-046ac9627000 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:32.194630 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d0e05fb3-f36d-46a1-8394-046ac9627000 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:32.195392 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d0e05fb3-f36d-46a1-8394-046ac9627000 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:32.195825 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d0e05fb3-f36d-46a1-8394-046ac9627000 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:32.223891 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d0e05fb3-f36d-46a1-8394-046ac9627000 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040853 Aug 25 05:47:32.224346 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 920/1802] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:32 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:32.273851 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e615b9bc-5cbb-4efa-ab96-2063a79ebb84 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:32.274486 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e615b9bc-5cbb-4efa-ab96-2063a79ebb84 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:32.281711 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e615b9bc-5cbb-4efa-ab96-2063a79ebb84 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:32.282155 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e615b9bc-5cbb-4efa-ab96-2063a79ebb84 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:32.282916 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e615b9bc-5cbb-4efa-ab96-2063a79ebb84 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:32.283363 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e615b9bc-5cbb-4efa-ab96-2063a79ebb84 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:32.344762 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e615b9bc-5cbb-4efa-ab96-2063a79ebb84 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:32.352023 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e615b9bc-5cbb-4efa-ab96-2063a79ebb84 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.082172 Aug 25 05:47:32.352579 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 883/1803] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:32 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:33.235934 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ecd60cfd-c107-4ea2-9d57-f072b8a1dccd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:33.236823 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ecd60cfd-c107-4ea2-9d57-f072b8a1dccd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:33.242606 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ecd60cfd-c107-4ea2-9d57-f072b8a1dccd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:33.243045 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ecd60cfd-c107-4ea2-9d57-f072b8a1dccd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:33.243819 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ecd60cfd-c107-4ea2-9d57-f072b8a1dccd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:33.244247 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ecd60cfd-c107-4ea2-9d57-f072b8a1dccd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:33.271556 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ecd60cfd-c107-4ea2-9d57-f072b8a1dccd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039425 Aug 25 05:47:33.272092 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 921/1804] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:33 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:33.368861 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-fc9d7bf2-1679-4077-a82a-51f4214b8fae tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:33.369399 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-fc9d7bf2-1679-4077-a82a-51f4214b8fae tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:33.375871 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fc9d7bf2-1679-4077-a82a-51f4214b8fae tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:33.376310 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fc9d7bf2-1679-4077-a82a-51f4214b8fae tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:33.377065 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fc9d7bf2-1679-4077-a82a-51f4214b8fae tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:33.377494 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fc9d7bf2-1679-4077-a82a-51f4214b8fae tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:33.436457 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-fc9d7bf2-1679-4077-a82a-51f4214b8fae tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:33.443630 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-fc9d7bf2-1679-4077-a82a-51f4214b8fae tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.078523 Aug 25 05:47:33.444260 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 884/1805] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:33 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:34.284091 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-715ab74b-8054-4901-a162-111a557ed89b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:34.285022 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-715ab74b-8054-4901-a162-111a557ed89b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:34.291050 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-715ab74b-8054-4901-a162-111a557ed89b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:34.291491 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-715ab74b-8054-4901-a162-111a557ed89b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:34.292259 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-715ab74b-8054-4901-a162-111a557ed89b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:34.292945 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-715ab74b-8054-4901-a162-111a557ed89b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:34.321594 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-715ab74b-8054-4901-a162-111a557ed89b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041326 Aug 25 05:47:34.322135 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 922/1806] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:34 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:34.461025 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-62b9cd08-a4a4-4321-a2d9-afec3cee73f9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:34.461654 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-62b9cd08-a4a4-4321-a2d9-afec3cee73f9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:34.468169 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-62b9cd08-a4a4-4321-a2d9-afec3cee73f9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:34.468608 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-62b9cd08-a4a4-4321-a2d9-afec3cee73f9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:34.469360 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-62b9cd08-a4a4-4321-a2d9-afec3cee73f9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:34.469819 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-62b9cd08-a4a4-4321-a2d9-afec3cee73f9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:34.527774 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-62b9cd08-a4a4-4321-a2d9-afec3cee73f9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:34.535178 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-62b9cd08-a4a4-4321-a2d9-afec3cee73f9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.077813 Aug 25 05:47:34.535966 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 885/1807] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:34 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:35.333762 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1310a3be-ac51-4df8-908b-f2031305f62c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:35.334661 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1310a3be-ac51-4df8-908b-f2031305f62c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:35.342760 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1310a3be-ac51-4df8-908b-f2031305f62c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:35.343191 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1310a3be-ac51-4df8-908b-f2031305f62c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:35.343950 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1310a3be-ac51-4df8-908b-f2031305f62c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:35.344374 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1310a3be-ac51-4df8-908b-f2031305f62c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:35.373890 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1310a3be-ac51-4df8-908b-f2031305f62c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043883 Aug 25 05:47:35.374441 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 923/1808] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:35 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:35.551484 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e19fcd8e-e9c8-455f-9274-a3ad8719c565 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:35.552088 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e19fcd8e-e9c8-455f-9274-a3ad8719c565 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:35.557962 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e19fcd8e-e9c8-455f-9274-a3ad8719c565 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:35.558559 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e19fcd8e-e9c8-455f-9274-a3ad8719c565 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:35.559318 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e19fcd8e-e9c8-455f-9274-a3ad8719c565 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:35.559742 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e19fcd8e-e9c8-455f-9274-a3ad8719c565 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:35.618108 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e19fcd8e-e9c8-455f-9274-a3ad8719c565 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:35.626218 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e19fcd8e-e9c8-455f-9274-a3ad8719c565 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.078351 Aug 25 05:47:35.626780 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 886/1809] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:35 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:35.837800 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 05:47:35.838054 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: Wed Aug 25 05:47:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 05:47:36.385116 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e1249cbf-9b2d-4366-ab25-455a2ce7071b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:36.386043 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e1249cbf-9b2d-4366-ab25-455a2ce7071b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:36.392035 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e1249cbf-9b2d-4366-ab25-455a2ce7071b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:36.392479 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e1249cbf-9b2d-4366-ab25-455a2ce7071b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:36.393244 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e1249cbf-9b2d-4366-ab25-455a2ce7071b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:36.393721 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e1249cbf-9b2d-4366-ab25-455a2ce7071b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:36.422362 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e1249cbf-9b2d-4366-ab25-455a2ce7071b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041039 Aug 25 05:47:36.422917 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 924/1810] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:36 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:36.642818 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-fc55b676-09d6-4d3f-a4f1-938366a982bd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:36.643368 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-fc55b676-09d6-4d3f-a4f1-938366a982bd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:36.649485 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fc55b676-09d6-4d3f-a4f1-938366a982bd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:36.649972 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fc55b676-09d6-4d3f-a4f1-938366a982bd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:36.650725 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fc55b676-09d6-4d3f-a4f1-938366a982bd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:36.651156 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fc55b676-09d6-4d3f-a4f1-938366a982bd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:36.710089 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-fc55b676-09d6-4d3f-a4f1-938366a982bd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:36.717795 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-fc55b676-09d6-4d3f-a4f1-938366a982bd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.078727 Aug 25 05:47:36.718353 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 887/1811] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:36 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:37.433503 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-bacb0890-16eb-4f2f-9cc0-6a2a2b3a99f3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:37.434414 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-bacb0890-16eb-4f2f-9cc0-6a2a2b3a99f3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:37.440364 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bacb0890-16eb-4f2f-9cc0-6a2a2b3a99f3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:37.440798 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bacb0890-16eb-4f2f-9cc0-6a2a2b3a99f3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:37.441573 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bacb0890-16eb-4f2f-9cc0-6a2a2b3a99f3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:37.442000 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bacb0890-16eb-4f2f-9cc0-6a2a2b3a99f3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:37.470693 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-bacb0890-16eb-4f2f-9cc0-6a2a2b3a99f3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040926 Aug 25 05:47:37.471245 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 925/1812] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:37 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:37.734481 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-209a71df-14f7-40c6-b2d2-71650ad7922c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:37.735016 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-209a71df-14f7-40c6-b2d2-71650ad7922c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:37.740742 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-209a71df-14f7-40c6-b2d2-71650ad7922c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:37.741183 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-209a71df-14f7-40c6-b2d2-71650ad7922c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:37.741959 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-209a71df-14f7-40c6-b2d2-71650ad7922c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:37.742385 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-209a71df-14f7-40c6-b2d2-71650ad7922c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:37.801933 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-209a71df-14f7-40c6-b2d2-71650ad7922c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:37.809059 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-209a71df-14f7-40c6-b2d2-71650ad7922c tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.078615 Aug 25 05:47:37.810133 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 888/1813] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:37 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:38.481959 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-38773745-8b6a-419b-8e8b-142946ef6af9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:38.482867 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-38773745-8b6a-419b-8e8b-142946ef6af9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:38.489771 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-38773745-8b6a-419b-8e8b-142946ef6af9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:38.490217 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-38773745-8b6a-419b-8e8b-142946ef6af9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:38.490979 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-38773745-8b6a-419b-8e8b-142946ef6af9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:38.491408 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-38773745-8b6a-419b-8e8b-142946ef6af9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:38.520377 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-38773745-8b6a-419b-8e8b-142946ef6af9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042121 Aug 25 05:47:38.520946 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 926/1814] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:38 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:38.825570 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8f494667-ec14-45c1-aeba-4b813441f2de tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:38.826190 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8f494667-ec14-45c1-aeba-4b813441f2de tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:38.832223 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8f494667-ec14-45c1-aeba-4b813441f2de tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:38.832676 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8f494667-ec14-45c1-aeba-4b813441f2de tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:38.833458 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8f494667-ec14-45c1-aeba-4b813441f2de tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:38.833922 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8f494667-ec14-45c1-aeba-4b813441f2de tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:38.902744 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-8f494667-ec14-45c1-aeba-4b813441f2de tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:38.910970 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8f494667-ec14-45c1-aeba-4b813441f2de tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.089071 Aug 25 05:47:38.911557 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 889/1815] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:38 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:39.533510 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2f5ad9bf-47b8-4354-be67-0a1c978c3c10 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:39.534457 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2f5ad9bf-47b8-4354-be67-0a1c978c3c10 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:39.540322 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2f5ad9bf-47b8-4354-be67-0a1c978c3c10 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:39.540764 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2f5ad9bf-47b8-4354-be67-0a1c978c3c10 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:39.541544 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2f5ad9bf-47b8-4354-be67-0a1c978c3c10 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:39.541991 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2f5ad9bf-47b8-4354-be67-0a1c978c3c10 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:39.571046 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2f5ad9bf-47b8-4354-be67-0a1c978c3c10 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042593 Aug 25 05:47:39.571603 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 927/1816] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:39 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:39.928842 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c4c89d5a-00da-415c-9b5c-ccc21bd25405 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:39.929392 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c4c89d5a-00da-415c-9b5c-ccc21bd25405 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:39.935980 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c4c89d5a-00da-415c-9b5c-ccc21bd25405 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:39.936420 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c4c89d5a-00da-415c-9b5c-ccc21bd25405 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:39.937909 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c4c89d5a-00da-415c-9b5c-ccc21bd25405 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:39.937909 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c4c89d5a-00da-415c-9b5c-ccc21bd25405 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:39.999900 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-c4c89d5a-00da-415c-9b5c-ccc21bd25405 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:40.007227 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c4c89d5a-00da-415c-9b5c-ccc21bd25405 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.082136 Aug 25 05:47:40.007781 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 890/1817] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:39 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:40.583325 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-eb2f6a4b-01b4-4302-8cc7-b6c5791cfe61 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:40.584309 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-eb2f6a4b-01b4-4302-8cc7-b6c5791cfe61 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:40.590165 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-eb2f6a4b-01b4-4302-8cc7-b6c5791cfe61 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:40.590723 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-eb2f6a4b-01b4-4302-8cc7-b6c5791cfe61 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:40.592000 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-eb2f6a4b-01b4-4302-8cc7-b6c5791cfe61 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:40.592462 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-eb2f6a4b-01b4-4302-8cc7-b6c5791cfe61 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:40.622872 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-eb2f6a4b-01b4-4302-8cc7-b6c5791cfe61 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042586 Aug 25 05:47:40.623451 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 928/1818] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:40 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:41.024559 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b1d8aefc-9b7d-4086-83c4-8dc202fda259 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:41.025113 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b1d8aefc-9b7d-4086-83c4-8dc202fda259 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:41.030924 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b1d8aefc-9b7d-4086-83c4-8dc202fda259 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:41.031361 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b1d8aefc-9b7d-4086-83c4-8dc202fda259 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:41.032109 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b1d8aefc-9b7d-4086-83c4-8dc202fda259 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:41.032535 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b1d8aefc-9b7d-4086-83c4-8dc202fda259 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:41.090328 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-b1d8aefc-9b7d-4086-83c4-8dc202fda259 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:41.097594 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b1d8aefc-9b7d-4086-83c4-8dc202fda259 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.077077 Aug 25 05:47:41.098145 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 891/1819] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:41 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:41.634183 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d73bba62-e13f-44f9-9559-408e9e5fb93d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:41.635088 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d73bba62-e13f-44f9-9559-408e9e5fb93d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:41.641072 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d73bba62-e13f-44f9-9559-408e9e5fb93d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:41.641504 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d73bba62-e13f-44f9-9559-408e9e5fb93d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:41.642284 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d73bba62-e13f-44f9-9559-408e9e5fb93d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:41.642707 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d73bba62-e13f-44f9-9559-408e9e5fb93d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:41.671436 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d73bba62-e13f-44f9-9559-408e9e5fb93d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040980 Aug 25 05:47:41.671970 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 929/1820] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:41 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:42.114489 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7419ad29-453d-4f1b-8504-5423e3008b13 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:42.115103 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7419ad29-453d-4f1b-8504-5423e3008b13 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:42.121324 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7419ad29-453d-4f1b-8504-5423e3008b13 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:42.121793 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7419ad29-453d-4f1b-8504-5423e3008b13 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:42.122620 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7419ad29-453d-4f1b-8504-5423e3008b13 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:42.123011 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7419ad29-453d-4f1b-8504-5423e3008b13 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:42.183548 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-7419ad29-453d-4f1b-8504-5423e3008b13 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:42.191233 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7419ad29-453d-4f1b-8504-5423e3008b13 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.080378 Aug 25 05:47:42.191802 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 892/1821] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:42 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:42.682416 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d6a483a7-2279-4066-88b5-2f565336ef0b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:42.683334 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d6a483a7-2279-4066-88b5-2f565336ef0b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:42.689476 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d6a483a7-2279-4066-88b5-2f565336ef0b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:42.689850 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d6a483a7-2279-4066-88b5-2f565336ef0b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:42.690622 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d6a483a7-2279-4066-88b5-2f565336ef0b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:42.691043 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d6a483a7-2279-4066-88b5-2f565336ef0b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:42.722582 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d6a483a7-2279-4066-88b5-2f565336ef0b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043968 Aug 25 05:47:42.723178 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 930/1822] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:42 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:43.200139 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 05:47:43.200396 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: Wed Aug 25 05:47:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 05:47:43.207957 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c9822964-8d99-4af9-984e-3fc246969bcc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:43.208563 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c9822964-8d99-4af9-984e-3fc246969bcc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:43.215917 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c9822964-8d99-4af9-984e-3fc246969bcc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:43.216360 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c9822964-8d99-4af9-984e-3fc246969bcc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:43.217423 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c9822964-8d99-4af9-984e-3fc246969bcc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:43.218000 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c9822964-8d99-4af9-984e-3fc246969bcc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:43.282299 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-c9822964-8d99-4af9-984e-3fc246969bcc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:43.290020 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c9822964-8d99-4af9-984e-3fc246969bcc tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.085742 Aug 25 05:47:43.290600 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 893/1823] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:43 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:43.734178 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-aeae6ee6-98f2-4541-938f-265e4af268f8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:43.735080 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-aeae6ee6-98f2-4541-938f-265e4af268f8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:43.740925 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-aeae6ee6-98f2-4541-938f-265e4af268f8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:43.741360 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-aeae6ee6-98f2-4541-938f-265e4af268f8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:43.742143 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-aeae6ee6-98f2-4541-938f-265e4af268f8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:43.742570 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-aeae6ee6-98f2-4541-938f-265e4af268f8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:43.772577 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-aeae6ee6-98f2-4541-938f-265e4af268f8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042678 Aug 25 05:47:43.773369 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 931/1824] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:43 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:44.307442 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d34973d5-f360-45c7-9b8e-92668a350aea tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:44.308048 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-d34973d5-f360-45c7-9b8e-92668a350aea tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:44.314150 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d34973d5-f360-45c7-9b8e-92668a350aea tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:44.314610 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d34973d5-f360-45c7-9b8e-92668a350aea tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:44.315555 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d34973d5-f360-45c7-9b8e-92668a350aea tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:44.315813 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d34973d5-f360-45c7-9b8e-92668a350aea tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:44.377874 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-d34973d5-f360-45c7-9b8e-92668a350aea tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:44.385930 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d34973d5-f360-45c7-9b8e-92668a350aea tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.082197 Aug 25 05:47:44.386500 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 894/1825] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:44 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:44.784908 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-240ed5cb-403c-492a-9714-612536b74972 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:44.785879 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-240ed5cb-403c-492a-9714-612536b74972 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:44.791520 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-240ed5cb-403c-492a-9714-612536b74972 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:44.791957 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-240ed5cb-403c-492a-9714-612536b74972 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:44.792713 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-240ed5cb-403c-492a-9714-612536b74972 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:44.793140 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-240ed5cb-403c-492a-9714-612536b74972 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:44.832271 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-240ed5cb-403c-492a-9714-612536b74972 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051039 Aug 25 05:47:44.832846 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 932/1826] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:44 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:45.402611 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e94ae277-299d-4cf6-a384-44473cb7b3f5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:45.403223 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e94ae277-299d-4cf6-a384-44473cb7b3f5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:45.409475 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e94ae277-299d-4cf6-a384-44473cb7b3f5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:45.409949 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e94ae277-299d-4cf6-a384-44473cb7b3f5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:45.410876 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e94ae277-299d-4cf6-a384-44473cb7b3f5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:45.411127 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e94ae277-299d-4cf6-a384-44473cb7b3f5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:45.474665 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e94ae277-299d-4cf6-a384-44473cb7b3f5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:45.483075 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e94ae277-299d-4cf6-a384-44473cb7b3f5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.082976 Aug 25 05:47:45.483349 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 895/1827] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:45 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:45.844549 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b74a33aa-b534-4431-b028-7ff70798d44d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:45.845456 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b74a33aa-b534-4431-b028-7ff70798d44d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:45.851275 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b74a33aa-b534-4431-b028-7ff70798d44d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:45.851719 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b74a33aa-b534-4431-b028-7ff70798d44d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:45.852477 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b74a33aa-b534-4431-b028-7ff70798d44d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:45.852907 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b74a33aa-b534-4431-b028-7ff70798d44d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:45.881841 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b74a33aa-b534-4431-b028-7ff70798d44d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041815 Aug 25 05:47:45.882386 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 933/1828] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:45 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:46.500860 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d225e65d-0e26-4740-ad20-6c3b9a7ed746 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:46.501888 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-d225e65d-0e26-4740-ad20-6c3b9a7ed746 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:46.508745 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d225e65d-0e26-4740-ad20-6c3b9a7ed746 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:46.509440 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d225e65d-0e26-4740-ad20-6c3b9a7ed746 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:46.510211 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d225e65d-0e26-4740-ad20-6c3b9a7ed746 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:46.510641 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d225e65d-0e26-4740-ad20-6c3b9a7ed746 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:46.578056 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-d225e65d-0e26-4740-ad20-6c3b9a7ed746 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:46.586128 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d225e65d-0e26-4740-ad20-6c3b9a7ed746 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.089484 Aug 25 05:47:46.586912 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 896/1829] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:46 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:46.893073 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-20d60273-904a-4775-aebd-9415a60bda2e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:46.893995 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-20d60273-904a-4775-aebd-9415a60bda2e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:46.899996 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-20d60273-904a-4775-aebd-9415a60bda2e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:46.900433 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-20d60273-904a-4775-aebd-9415a60bda2e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:46.901176 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-20d60273-904a-4775-aebd-9415a60bda2e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:46.901624 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-20d60273-904a-4775-aebd-9415a60bda2e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:46.929955 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-20d60273-904a-4775-aebd-9415a60bda2e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040600 Aug 25 05:47:46.930491 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 934/1830] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:46 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:47.602630 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-cdcbc100-4af6-4928-aa18-e168e5aba6df tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:47.603238 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-cdcbc100-4af6-4928-aa18-e168e5aba6df tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:47.609118 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cdcbc100-4af6-4928-aa18-e168e5aba6df tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:47.609590 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cdcbc100-4af6-4928-aa18-e168e5aba6df tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:47.610354 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cdcbc100-4af6-4928-aa18-e168e5aba6df tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:47.610787 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cdcbc100-4af6-4928-aa18-e168e5aba6df tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:47.669748 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-cdcbc100-4af6-4928-aa18-e168e5aba6df tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:47.676751 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-cdcbc100-4af6-4928-aa18-e168e5aba6df tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.077805 Aug 25 05:47:47.677307 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 897/1831] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:47 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:47.941972 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e80cb61b-9a35-4ed6-a8af-6731181055c4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:47.942904 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e80cb61b-9a35-4ed6-a8af-6731181055c4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:47.948639 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e80cb61b-9a35-4ed6-a8af-6731181055c4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:47.949117 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e80cb61b-9a35-4ed6-a8af-6731181055c4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:47.949899 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e80cb61b-9a35-4ed6-a8af-6731181055c4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:47.950329 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e80cb61b-9a35-4ed6-a8af-6731181055c4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:47.980027 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e80cb61b-9a35-4ed6-a8af-6731181055c4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041726 Aug 25 05:47:47.980535 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 935/1832] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:47 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:48.692706 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-665cb6ca-5d38-40f7-a30e-d652e7a32c4a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:48.693319 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-665cb6ca-5d38-40f7-a30e-d652e7a32c4a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:48.699130 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-665cb6ca-5d38-40f7-a30e-d652e7a32c4a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:48.699579 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-665cb6ca-5d38-40f7-a30e-d652e7a32c4a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:48.700346 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-665cb6ca-5d38-40f7-a30e-d652e7a32c4a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:48.700783 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-665cb6ca-5d38-40f7-a30e-d652e7a32c4a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:48.759805 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-665cb6ca-5d38-40f7-a30e-d652e7a32c4a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:48.767951 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-665cb6ca-5d38-40f7-a30e-d652e7a32c4a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.078823 Aug 25 05:47:48.768520 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 898/1833] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:48 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:48.992228 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-fd096db0-c4b1-47cc-a343-c1779067e408 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:48.993031 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-fd096db0-c4b1-47cc-a343-c1779067e408 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:48.999732 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fd096db0-c4b1-47cc-a343-c1779067e408 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:49.000176 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fd096db0-c4b1-47cc-a343-c1779067e408 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:49.000931 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fd096db0-c4b1-47cc-a343-c1779067e408 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:49.001363 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fd096db0-c4b1-47cc-a343-c1779067e408 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:49.031138 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-fd096db0-c4b1-47cc-a343-c1779067e408 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042715 Aug 25 05:47:49.031678 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 936/1834] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:48 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:49.785073 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e2f122ca-5161-4a06-bcec-7d0edc79bdb8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:49.785762 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e2f122ca-5161-4a06-bcec-7d0edc79bdb8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:49.791642 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e2f122ca-5161-4a06-bcec-7d0edc79bdb8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:49.792117 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e2f122ca-5161-4a06-bcec-7d0edc79bdb8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:49.792878 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e2f122ca-5161-4a06-bcec-7d0edc79bdb8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:49.793305 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e2f122ca-5161-4a06-bcec-7d0edc79bdb8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:49.853888 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e2f122ca-5161-4a06-bcec-7d0edc79bdb8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:49.861310 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e2f122ca-5161-4a06-bcec-7d0edc79bdb8 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.079810 Aug 25 05:47:49.861900 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 899/1835] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:49 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:50.042488 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a9a0785f-c30c-4404-84e3-1eeff9667115 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:50.043303 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a9a0785f-c30c-4404-84e3-1eeff9667115 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:50.049022 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a9a0785f-c30c-4404-84e3-1eeff9667115 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:50.049460 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a9a0785f-c30c-4404-84e3-1eeff9667115 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:50.050238 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a9a0785f-c30c-4404-84e3-1eeff9667115 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:50.050657 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a9a0785f-c30c-4404-84e3-1eeff9667115 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:50.078932 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a9a0785f-c30c-4404-84e3-1eeff9667115 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040283 Aug 25 05:47:50.079465 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 937/1836] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:50 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:50.878751 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-646adfa8-ca51-4d54-ac97-74be0ecf57b5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:50.879373 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-646adfa8-ca51-4d54-ac97-74be0ecf57b5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:50.885169 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-646adfa8-ca51-4d54-ac97-74be0ecf57b5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:50.885649 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-646adfa8-ca51-4d54-ac97-74be0ecf57b5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:50.886412 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-646adfa8-ca51-4d54-ac97-74be0ecf57b5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:50.886842 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-646adfa8-ca51-4d54-ac97-74be0ecf57b5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:50.946341 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-646adfa8-ca51-4d54-ac97-74be0ecf57b5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:50.954084 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-646adfa8-ca51-4d54-ac97-74be0ecf57b5 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.078946 Aug 25 05:47:50.954644 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 900/1837] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:50 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:51.090235 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-826159c1-423e-48f9-a518-ff012e25ef06 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:51.091068 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-826159c1-423e-48f9-a518-ff012e25ef06 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:51.097393 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-826159c1-423e-48f9-a518-ff012e25ef06 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:51.097881 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-826159c1-423e-48f9-a518-ff012e25ef06 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:51.098643 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-826159c1-423e-48f9-a518-ff012e25ef06 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:51.099079 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-826159c1-423e-48f9-a518-ff012e25ef06 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:51.129161 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-826159c1-423e-48f9-a518-ff012e25ef06 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042723 Aug 25 05:47:51.129763 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 938/1838] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:51 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:51.969552 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-97894dc5-573e-45c0-ab5b-5de93b18242e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:51.970167 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-97894dc5-573e-45c0-ab5b-5de93b18242e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:51.976337 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-97894dc5-573e-45c0-ab5b-5de93b18242e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:51.976780 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-97894dc5-573e-45c0-ab5b-5de93b18242e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:51.978464 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-97894dc5-573e-45c0-ab5b-5de93b18242e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:51.978464 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-97894dc5-573e-45c0-ab5b-5de93b18242e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:52.040882 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-97894dc5-573e-45c0-ab5b-5de93b18242e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:52.048850 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-97894dc5-573e-45c0-ab5b-5de93b18242e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.082976 Aug 25 05:47:52.049410 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 901/1839] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:51 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:52.141373 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-932ed70e-52c0-4871-8120-167ea481cac7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:52.142221 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-932ed70e-52c0-4871-8120-167ea481cac7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:52.148001 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-932ed70e-52c0-4871-8120-167ea481cac7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:52.148696 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-932ed70e-52c0-4871-8120-167ea481cac7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:52.149454 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-932ed70e-52c0-4871-8120-167ea481cac7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:52.149911 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-932ed70e-52c0-4871-8120-167ea481cac7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:52.177833 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-932ed70e-52c0-4871-8120-167ea481cac7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041190 Aug 25 05:47:52.178376 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 939/1840] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:52 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:53.064890 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-adb5de87-e5d7-4f6e-8623-c69c0d5d22c6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:53.065558 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-adb5de87-e5d7-4f6e-8623-c69c0d5d22c6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:53.071394 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-adb5de87-e5d7-4f6e-8623-c69c0d5d22c6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:53.071839 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-adb5de87-e5d7-4f6e-8623-c69c0d5d22c6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:53.072597 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-adb5de87-e5d7-4f6e-8623-c69c0d5d22c6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:53.073026 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-adb5de87-e5d7-4f6e-8623-c69c0d5d22c6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:53.131154 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-adb5de87-e5d7-4f6e-8623-c69c0d5d22c6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:53.138354 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-adb5de87-e5d7-4f6e-8623-c69c0d5d22c6 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.077507 Aug 25 05:47:53.138980 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 902/1841] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:53 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:53.188976 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9e8627c5-eedf-40d1-b83a-07aaae836547 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:53.189916 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9e8627c5-eedf-40d1-b83a-07aaae836547 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:53.195632 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9e8627c5-eedf-40d1-b83a-07aaae836547 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:53.196070 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9e8627c5-eedf-40d1-b83a-07aaae836547 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:53.196817 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9e8627c5-eedf-40d1-b83a-07aaae836547 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:53.197244 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9e8627c5-eedf-40d1-b83a-07aaae836547 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:53.226292 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9e8627c5-eedf-40d1-b83a-07aaae836547 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041141 Aug 25 05:47:53.226821 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 940/1842] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:53 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:54.156739 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-31873ee8-a42e-495f-9188-392339cfc28a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:54.156739 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-31873ee8-a42e-495f-9188-392339cfc28a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:54.161334 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-31873ee8-a42e-495f-9188-392339cfc28a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:54.161798 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-31873ee8-a42e-495f-9188-392339cfc28a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:54.162551 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-31873ee8-a42e-495f-9188-392339cfc28a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:54.162976 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-31873ee8-a42e-495f-9188-392339cfc28a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:54.223573 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-31873ee8-a42e-495f-9188-392339cfc28a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:54.230968 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-31873ee8-a42e-495f-9188-392339cfc28a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.079835 Aug 25 05:47:54.231685 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 903/1843] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:54 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:54.238132 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6e8a70d0-fd91-4189-b73e-8b3422ff3151 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:54.239048 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6e8a70d0-fd91-4189-b73e-8b3422ff3151 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:54.244764 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6e8a70d0-fd91-4189-b73e-8b3422ff3151 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:54.245237 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6e8a70d0-fd91-4189-b73e-8b3422ff3151 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:54.246022 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6e8a70d0-fd91-4189-b73e-8b3422ff3151 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:54.246453 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6e8a70d0-fd91-4189-b73e-8b3422ff3151 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:54.276365 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6e8a70d0-fd91-4189-b73e-8b3422ff3151 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041888 Aug 25 05:47:54.276916 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 941/1844] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:54 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:55.249012 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-4e2b771e-e6c2-4fbe-8172-0c06db6ebd17 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:55.249586 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-4e2b771e-e6c2-4fbe-8172-0c06db6ebd17 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:55.255339 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4e2b771e-e6c2-4fbe-8172-0c06db6ebd17 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:55.255780 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4e2b771e-e6c2-4fbe-8172-0c06db6ebd17 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:55.256533 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4e2b771e-e6c2-4fbe-8172-0c06db6ebd17 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:55.256963 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4e2b771e-e6c2-4fbe-8172-0c06db6ebd17 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:55.287430 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7a951530-1ebb-495a-85b5-e9878d61c9b0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:55.288422 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-7a951530-1ebb-495a-85b5-e9878d61c9b0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:55.294408 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7a951530-1ebb-495a-85b5-e9878d61c9b0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:55.294991 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7a951530-1ebb-495a-85b5-e9878d61c9b0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:55.295946 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7a951530-1ebb-495a-85b5-e9878d61c9b0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:55.296358 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7a951530-1ebb-495a-85b5-e9878d61c9b0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:55.318024 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-4e2b771e-e6c2-4fbe-8172-0c06db6ebd17 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:55.325247 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-4e2b771e-e6c2-4fbe-8172-0c06db6ebd17 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.080852 Aug 25 05:47:55.326080 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 904/1845] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:55 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:55.327200 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-7a951530-1ebb-495a-85b5-e9878d61c9b0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042722 Aug 25 05:47:55.328259 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 942/1846] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:55 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:47:56.337543 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6cf489d9-0e3c-43d9-a464-3aa64f7b0b59 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:56.338550 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6cf489d9-0e3c-43d9-a464-3aa64f7b0b59 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:56.343042 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e76307bd-ece3-46d0-9b22-621b6df709ea tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:56.343750 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e76307bd-ece3-46d0-9b22-621b6df709ea tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:56.345507 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6cf489d9-0e3c-43d9-a464-3aa64f7b0b59 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:56.345976 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6cf489d9-0e3c-43d9-a464-3aa64f7b0b59 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:56.346753 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6cf489d9-0e3c-43d9-a464-3aa64f7b0b59 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:56.347188 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6cf489d9-0e3c-43d9-a464-3aa64f7b0b59 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:56.349310 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e76307bd-ece3-46d0-9b22-621b6df709ea tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:56.349782 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e76307bd-ece3-46d0-9b22-621b6df709ea tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:56.350536 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e76307bd-ece3-46d0-9b22-621b6df709ea tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:56.350962 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e76307bd-ece3-46d0-9b22-621b6df709ea tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:56.375656 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6cf489d9-0e3c-43d9-a464-3aa64f7b0b59 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041850 Aug 25 05:47:56.376209 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 905/1847] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:56 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:56.460070 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-e76307bd-ece3-46d0-9b22-621b6df709ea tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:56.468102 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e76307bd-ece3-46d0-9b22-621b6df709ea tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.128612 Aug 25 05:47:56.468656 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 943/1848] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:56 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:47:57.387229 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-622b24e1-6680-4aa6-ac7a-5b2f8fed24da tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:57.388147 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-622b24e1-6680-4aa6-ac7a-5b2f8fed24da tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:57.394095 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-622b24e1-6680-4aa6-ac7a-5b2f8fed24da tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:57.394537 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-622b24e1-6680-4aa6-ac7a-5b2f8fed24da tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:57.395294 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-622b24e1-6680-4aa6-ac7a-5b2f8fed24da tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:57.395724 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-622b24e1-6680-4aa6-ac7a-5b2f8fed24da tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:57.425001 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-622b24e1-6680-4aa6-ac7a-5b2f8fed24da tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041816 Aug 25 05:47:57.425558 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 906/1849] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:57 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:57.484755 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d9c76825-2e00-47d1-bd1c-d4d4187b15ae tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:57.485351 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d9c76825-2e00-47d1-bd1c-d4d4187b15ae tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:57.491276 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d9c76825-2e00-47d1-bd1c-d4d4187b15ae tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:57.491725 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d9c76825-2e00-47d1-bd1c-d4d4187b15ae tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:57.492490 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d9c76825-2e00-47d1-bd1c-d4d4187b15ae tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:57.492930 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d9c76825-2e00-47d1-bd1c-d4d4187b15ae tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:57.553007 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d9c76825-2e00-47d1-bd1c-d4d4187b15ae tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:57.560374 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d9c76825-2e00-47d1-bd1c-d4d4187b15ae tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.079922 Aug 25 05:47:57.560968 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 944/1850] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:57 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:58.436493 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-532de4bf-2995-49a7-b876-9efc492b9481 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:58.437553 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-532de4bf-2995-49a7-b876-9efc492b9481 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:58.443392 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-532de4bf-2995-49a7-b876-9efc492b9481 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:58.443842 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-532de4bf-2995-49a7-b876-9efc492b9481 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:58.444610 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-532de4bf-2995-49a7-b876-9efc492b9481 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:58.445043 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-532de4bf-2995-49a7-b876-9efc492b9481 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:58.474100 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-532de4bf-2995-49a7-b876-9efc492b9481 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042121 Aug 25 05:47:58.474646 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 907/1851] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:58 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:47:58.577235 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f5330e32-419f-4fcd-b22c-67fc2c4561b2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:58.577910 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f5330e32-419f-4fcd-b22c-67fc2c4561b2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:58.583784 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f5330e32-419f-4fcd-b22c-67fc2c4561b2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:58.584231 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f5330e32-419f-4fcd-b22c-67fc2c4561b2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:58.584988 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f5330e32-419f-4fcd-b22c-67fc2c4561b2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:58.585417 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f5330e32-419f-4fcd-b22c-67fc2c4561b2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:58.649517 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-f5330e32-419f-4fcd-b22c-67fc2c4561b2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:58.657380 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f5330e32-419f-4fcd-b22c-67fc2c4561b2 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.083837 Aug 25 05:47:58.657969 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 945/1852] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:58 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:47:59.485635 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6efeb586-2d91-4b8c-bcb7-2397e3aa50b2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:59.486553 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6efeb586-2d91-4b8c-bcb7-2397e3aa50b2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:59.492387 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6efeb586-2d91-4b8c-bcb7-2397e3aa50b2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:59.492832 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6efeb586-2d91-4b8c-bcb7-2397e3aa50b2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:59.493677 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6efeb586-2d91-4b8c-bcb7-2397e3aa50b2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:59.494063 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6efeb586-2d91-4b8c-bcb7-2397e3aa50b2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:59.525021 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6efeb586-2d91-4b8c-bcb7-2397e3aa50b2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043650 Aug 25 05:47:59.525685 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 908/1853] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:47:59 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:47:59.675229 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-fb2f3cdd-37aa-4d28-9a75-879088fdc64a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:47:59.675833 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-fb2f3cdd-37aa-4d28-9a75-879088fdc64a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:47:59.681797 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fb2f3cdd-37aa-4d28-9a75-879088fdc64a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:59.682234 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fb2f3cdd-37aa-4d28-9a75-879088fdc64a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:59.683063 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fb2f3cdd-37aa-4d28-9a75-879088fdc64a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:47:59.683488 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fb2f3cdd-37aa-4d28-9a75-879088fdc64a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:47:59.746262 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-fb2f3cdd-37aa-4d28-9a75-879088fdc64a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:47:59.753604 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-fb2f3cdd-37aa-4d28-9a75-879088fdc64a tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.082844 Aug 25 05:47:59.754160 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 946/1854] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:47:59 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:48:00.536735 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e3578904-257d-4e0c-a32f-873125aa91bc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:00.537347 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e3578904-257d-4e0c-a32f-873125aa91bc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:00.543030 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e3578904-257d-4e0c-a32f-873125aa91bc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:00.543485 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e3578904-257d-4e0c-a32f-873125aa91bc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:00.544264 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e3578904-257d-4e0c-a32f-873125aa91bc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:00.544701 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e3578904-257d-4e0c-a32f-873125aa91bc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:00.574947 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e3578904-257d-4e0c-a32f-873125aa91bc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042279 Aug 25 05:48:00.575501 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 909/1855] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:48:00 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:48:00.770094 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e6f7da72-214c-4b8c-802f-a596102a8181 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:00.770699 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e6f7da72-214c-4b8c-802f-a596102a8181 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:00.777028 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e6f7da72-214c-4b8c-802f-a596102a8181 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:00.777383 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e6f7da72-214c-4b8c-802f-a596102a8181 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:00.778199 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e6f7da72-214c-4b8c-802f-a596102a8181 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:00.778621 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e6f7da72-214c-4b8c-802f-a596102a8181 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:00.844953 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-e6f7da72-214c-4b8c-802f-a596102a8181 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:48:00.852509 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e6f7da72-214c-4b8c-802f-a596102a8181 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.086039 Aug 25 05:48:00.853089 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 947/1856] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:48:00 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:48:01.586953 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b9bd7307-d501-4e6d-ab5c-5fd133cac088 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:01.587856 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b9bd7307-d501-4e6d-ab5c-5fd133cac088 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:01.594722 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b9bd7307-d501-4e6d-ab5c-5fd133cac088 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:01.595216 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b9bd7307-d501-4e6d-ab5c-5fd133cac088 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:01.596001 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b9bd7307-d501-4e6d-ab5c-5fd133cac088 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:01.596429 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b9bd7307-d501-4e6d-ab5c-5fd133cac088 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:01.624781 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b9bd7307-d501-4e6d-ab5c-5fd133cac088 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041391 Aug 25 05:48:01.625204 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 910/1857] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:48:01 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:48:01.869672 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-4c245747-f4ff-4db1-878f-e7dbb10e6f0e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:01.870275 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-4c245747-f4ff-4db1-878f-e7dbb10e6f0e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:01.877642 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4c245747-f4ff-4db1-878f-e7dbb10e6f0e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:01.878025 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4c245747-f4ff-4db1-878f-e7dbb10e6f0e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:01.878801 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4c245747-f4ff-4db1-878f-e7dbb10e6f0e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:01.879234 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4c245747-f4ff-4db1-878f-e7dbb10e6f0e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:01.940371 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-4c245747-f4ff-4db1-878f-e7dbb10e6f0e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:48:01.947701 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-4c245747-f4ff-4db1-878f-e7dbb10e6f0e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.081707 Aug 25 05:48:01.948263 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 948/1858] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:48:01 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:48:02.636118 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-31205d71-da31-4297-b517-0ec4b9fae7a1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:02.637115 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-31205d71-da31-4297-b517-0ec4b9fae7a1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:02.643327 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-31205d71-da31-4297-b517-0ec4b9fae7a1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:02.645968 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-31205d71-da31-4297-b517-0ec4b9fae7a1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:02.645968 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-31205d71-da31-4297-b517-0ec4b9fae7a1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:02.645968 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-31205d71-da31-4297-b517-0ec4b9fae7a1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:02.675691 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-31205d71-da31-4297-b517-0ec4b9fae7a1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043340 Aug 25 05:48:02.676270 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 911/1859] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:48:02 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:48:02.964957 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-3d549e7b-17a3-4633-99ee-008b8edd736f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:02.965584 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-3d549e7b-17a3-4633-99ee-008b8edd736f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:02.972201 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3d549e7b-17a3-4633-99ee-008b8edd736f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:02.972647 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3d549e7b-17a3-4633-99ee-008b8edd736f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:02.974043 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3d549e7b-17a3-4633-99ee-008b8edd736f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:02.974043 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3d549e7b-17a3-4633-99ee-008b8edd736f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:03.036254 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-3d549e7b-17a3-4633-99ee-008b8edd736f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:48:03.043738 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-3d549e7b-17a3-4633-99ee-008b8edd736f tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.082475 Aug 25 05:48:03.044297 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 949/1860] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:48:02 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:48:03.689283 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-9aae25ea-e7ad-4299-a945-a625e0bf8f3b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:03.690960 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-9aae25ea-e7ad-4299-a945-a625e0bf8f3b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:03.696736 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9aae25ea-e7ad-4299-a945-a625e0bf8f3b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:03.697183 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9aae25ea-e7ad-4299-a945-a625e0bf8f3b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:03.697975 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9aae25ea-e7ad-4299-a945-a625e0bf8f3b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:03.698407 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9aae25ea-e7ad-4299-a945-a625e0bf8f3b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:03.726557 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-9aae25ea-e7ad-4299-a945-a625e0bf8f3b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041211 Aug 25 05:48:03.727102 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 912/1861] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:48:03 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:48:04.060701 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-308b0542-c4bc-41c8-9a50-1bce839e2540 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:04.061294 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-308b0542-c4bc-41c8-9a50-1bce839e2540 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:04.067421 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-308b0542-c4bc-41c8-9a50-1bce839e2540 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:04.067871 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-308b0542-c4bc-41c8-9a50-1bce839e2540 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:04.068633 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-308b0542-c4bc-41c8-9a50-1bce839e2540 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:04.069061 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-308b0542-c4bc-41c8-9a50-1bce839e2540 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:04.130488 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-308b0542-c4bc-41c8-9a50-1bce839e2540 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:48:04.137649 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-308b0542-c4bc-41c8-9a50-1bce839e2540 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.080858 Aug 25 05:48:04.138200 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 950/1862] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:48:04 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:48:04.738509 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7d5b2206-f6ff-4958-871e-661a24f6ebd4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:04.745411 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7d5b2206-f6ff-4958-871e-661a24f6ebd4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:04.745411 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7d5b2206-f6ff-4958-871e-661a24f6ebd4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:04.745869 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7d5b2206-f6ff-4958-871e-661a24f6ebd4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:04.746647 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7d5b2206-f6ff-4958-871e-661a24f6ebd4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:04.747085 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7d5b2206-f6ff-4958-871e-661a24f6ebd4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:04.776837 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7d5b2206-f6ff-4958-871e-661a24f6ebd4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042821 Aug 25 05:48:04.777392 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 913/1863] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:48:04 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:48:05.154339 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a55ea7be-2717-42e0-bbb0-0ca210f055a9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:05.154921 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a55ea7be-2717-42e0-bbb0-0ca210f055a9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:05.161979 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a55ea7be-2717-42e0-bbb0-0ca210f055a9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:05.162420 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a55ea7be-2717-42e0-bbb0-0ca210f055a9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:05.163208 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a55ea7be-2717-42e0-bbb0-0ca210f055a9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:05.163636 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a55ea7be-2717-42e0-bbb0-0ca210f055a9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:05.226213 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-a55ea7be-2717-42e0-bbb0-0ca210f055a9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:48:05.233465 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a55ea7be-2717-42e0-bbb0-0ca210f055a9 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.082795 Aug 25 05:48:05.234044 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 951/1864] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:48:05 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:48:05.788391 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-4442bf71-666d-4b6f-9b54-7d0517bc9be1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:05.789335 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-4442bf71-666d-4b6f-9b54-7d0517bc9be1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:05.795347 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4442bf71-666d-4b6f-9b54-7d0517bc9be1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:05.795799 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4442bf71-666d-4b6f-9b54-7d0517bc9be1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:05.796558 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4442bf71-666d-4b6f-9b54-7d0517bc9be1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:05.796994 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4442bf71-666d-4b6f-9b54-7d0517bc9be1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:05.826255 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-4442bf71-666d-4b6f-9b54-7d0517bc9be1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041561 Aug 25 05:48:05.826806 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 914/1865] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:48:05 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:48:06.250122 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-4a53ae76-dcca-4b65-a665-0f1055a674cd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:06.250668 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-4a53ae76-dcca-4b65-a665-0f1055a674cd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:06.257140 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4a53ae76-dcca-4b65-a665-0f1055a674cd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:06.257603 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4a53ae76-dcca-4b65-a665-0f1055a674cd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:06.258371 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4a53ae76-dcca-4b65-a665-0f1055a674cd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:06.258796 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4a53ae76-dcca-4b65-a665-0f1055a674cd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:06.319791 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-4a53ae76-dcca-4b65-a665-0f1055a674cd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:48:06.327160 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-4a53ae76-dcca-4b65-a665-0f1055a674cd tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.080801 Aug 25 05:48:06.327709 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 952/1866] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:48:06 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:48:06.837628 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-4be43f3c-43e7-4743-88dd-8d2a5a943593 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:06.838534 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-4be43f3c-43e7-4743-88dd-8d2a5a943593 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:06.844561 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4be43f3c-43e7-4743-88dd-8d2a5a943593 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:06.844989 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4be43f3c-43e7-4743-88dd-8d2a5a943593 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:06.846452 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4be43f3c-43e7-4743-88dd-8d2a5a943593 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:06.846889 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4be43f3c-43e7-4743-88dd-8d2a5a943593 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:06.875169 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-4be43f3c-43e7-4743-88dd-8d2a5a943593 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041293 Aug 25 05:48:06.875708 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 915/1867] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:48:06 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:48:07.343537 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f4281a72-e8ad-4e49-b527-cb0518b644db tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:07.344144 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f4281a72-e8ad-4e49-b527-cb0518b644db tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:07.350555 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f4281a72-e8ad-4e49-b527-cb0518b644db tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:07.350995 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f4281a72-e8ad-4e49-b527-cb0518b644db tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:07.351752 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f4281a72-e8ad-4e49-b527-cb0518b644db tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:07.352180 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f4281a72-e8ad-4e49-b527-cb0518b644db tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:07.411926 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-f4281a72-e8ad-4e49-b527-cb0518b644db tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9f0ff74ab430e8b718b7671242716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '918ce72498a1413285a0c33ca0325419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:48:07.419138 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f4281a72-e8ad-4e49-b527-cb0518b644db tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 200 len: 1219 microversion: 2.1 time: 0.079276 Aug 25 05:48:07.419693 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 953/1868] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:48:07 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:48:07.886603 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-80f579ce-f5b1-4f22-9d38-203095eeffc0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:07.887417 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-80f579ce-f5b1-4f22-9d38-203095eeffc0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:07.894226 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-80f579ce-f5b1-4f22-9d38-203095eeffc0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:07.894669 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-80f579ce-f5b1-4f22-9d38-203095eeffc0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:07.895424 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-80f579ce-f5b1-4f22-9d38-203095eeffc0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:07.895847 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-80f579ce-f5b1-4f22-9d38-203095eeffc0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:07.926002 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-80f579ce-f5b1-4f22-9d38-203095eeffc0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043241 Aug 25 05:48:07.926507 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 916/1869] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:48:07 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:48:08.435211 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9cfcee71-abfa-42de-a48b-4a36ab229391 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:08.435770 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9cfcee71-abfa-42de-a48b-4a36ab229391 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] [instance: 30a141ef-390c-4d75-94ba-c3112c06bc39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:08.442468 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9cfcee71-abfa-42de-a48b-4a36ab229391 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:08.442904 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9cfcee71-abfa-42de-a48b-4a36ab229391 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:08.443666 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9cfcee71-abfa-42de-a48b-4a36ab229391 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:08.444091 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9cfcee71-abfa-42de-a48b-4a36ab229391 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:08.457337 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.wsgi [None req-9cfcee71-abfa-42de-a48b-4a36ab229391 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] HTTP exception thrown: Instance 30a141ef-390c-4d75-94ba-c3112c06bc39 could not be found. Aug 25 05:48:08.459614 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9cfcee71-abfa-42de-a48b-4a36ab229391 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Returning 404 to user: Instance 30a141ef-390c-4d75-94ba-c3112c06bc39 could not be found. {{(pid=108885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 05:48:08.459614 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9cfcee71-abfa-42de-a48b-4a36ab229391 tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39" status: 404 len: 111 microversion: 2.1 time: 0.027351 Aug 25 05:48:08.459614 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 954/1870] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:48:08 2021] GET /compute/v2.1/servers/30a141ef-390c-4d75-94ba-c3112c06bc39 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:48:08.704839 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e9773fe8-02fb-4991-8b75-46ecbbd93e9e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] Calling method '.version_select at 0x7f9106bedc10>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:08.796594 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e9773fe8-02fb-4991-8b75-46ecbbd93e9e tempest-TestShelveInstance-84492568 tempest-TestShelveInstance-84492568-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-313165443" status: 202 len: 0 microversion: 2.1 time: 0.103515 Aug 25 05:48:08.797425 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 917/1871] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Aug 25 05:48:08 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-313165443 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 05:48:08.936736 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-8fa5e248-a06a-4053-ada9-0d02272f8aa1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:08.937683 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-8fa5e248-a06a-4053-ada9-0d02272f8aa1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:08.945237 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8fa5e248-a06a-4053-ada9-0d02272f8aa1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:08.945631 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8fa5e248-a06a-4053-ada9-0d02272f8aa1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:08.946410 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8fa5e248-a06a-4053-ada9-0d02272f8aa1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:08.946841 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8fa5e248-a06a-4053-ada9-0d02272f8aa1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:08.985041 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-8fa5e248-a06a-4053-ada9-0d02272f8aa1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052025 Aug 25 05:48:08.985641 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 955/1872] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:48:08 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:48:10.001846 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-23013b44-6e1f-4e8d-bbe4-6cb31592fa9d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:10.003627 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-23013b44-6e1f-4e8d-bbe4-6cb31592fa9d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:10.010172 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-23013b44-6e1f-4e8d-bbe4-6cb31592fa9d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:10.010621 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-23013b44-6e1f-4e8d-bbe4-6cb31592fa9d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:10.011595 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-23013b44-6e1f-4e8d-bbe4-6cb31592fa9d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:10.012292 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-23013b44-6e1f-4e8d-bbe4-6cb31592fa9d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:10.042527 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-23013b44-6e1f-4e8d-bbe4-6cb31592fa9d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044561 Aug 25 05:48:10.043090 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 918/1873] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:48:09 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:48:11.054077 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-bb1ceeef-4b73-4e24-9e14-abbb8d332392 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:11.054991 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-bb1ceeef-4b73-4e24-9e14-abbb8d332392 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:11.060762 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bb1ceeef-4b73-4e24-9e14-abbb8d332392 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:11.061210 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bb1ceeef-4b73-4e24-9e14-abbb8d332392 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:11.062009 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bb1ceeef-4b73-4e24-9e14-abbb8d332392 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:11.062446 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bb1ceeef-4b73-4e24-9e14-abbb8d332392 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:11.092971 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-bb1ceeef-4b73-4e24-9e14-abbb8d332392 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042782 Aug 25 05:48:11.093827 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 956/1874] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:48:11 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:48:12.104754 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-f62a1e9a-831f-4536-bf9a-658d98208d3d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:12.105776 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-f62a1e9a-831f-4536-bf9a-658d98208d3d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:12.112473 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f62a1e9a-831f-4536-bf9a-658d98208d3d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:12.113094 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f62a1e9a-831f-4536-bf9a-658d98208d3d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:12.114434 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f62a1e9a-831f-4536-bf9a-658d98208d3d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:12.114870 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f62a1e9a-831f-4536-bf9a-658d98208d3d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:12.147552 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-f62a1e9a-831f-4536-bf9a-658d98208d3d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046514 Aug 25 05:48:12.148376 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 919/1875] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:48:12 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:48:13.159744 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a7dfc274-8819-48aa-a283-1fc5fad41cfd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:13.160657 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a7dfc274-8819-48aa-a283-1fc5fad41cfd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:13.166483 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a7dfc274-8819-48aa-a283-1fc5fad41cfd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:13.166932 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a7dfc274-8819-48aa-a283-1fc5fad41cfd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:13.167708 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a7dfc274-8819-48aa-a283-1fc5fad41cfd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:13.168149 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a7dfc274-8819-48aa-a283-1fc5fad41cfd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:13.197075 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a7dfc274-8819-48aa-a283-1fc5fad41cfd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041551 Aug 25 05:48:13.197656 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 957/1876] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:48:13 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:48:14.209597 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-0da515ee-ed24-47c8-9e58-813d022b1d32 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:14.210460 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-0da515ee-ed24-47c8-9e58-813d022b1d32 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:14.216568 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0da515ee-ed24-47c8-9e58-813d022b1d32 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:14.217016 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0da515ee-ed24-47c8-9e58-813d022b1d32 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:14.217836 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0da515ee-ed24-47c8-9e58-813d022b1d32 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:14.218269 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0da515ee-ed24-47c8-9e58-813d022b1d32 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:14.248221 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-0da515ee-ed24-47c8-9e58-813d022b1d32 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043377 Aug 25 05:48:14.248787 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 920/1877] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:48:14 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:48:15.259734 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f4c1f1dc-6e5c-4c3c-92f0-d96988100c36 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:15.260798 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f4c1f1dc-6e5c-4c3c-92f0-d96988100c36 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:15.267261 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f4c1f1dc-6e5c-4c3c-92f0-d96988100c36 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:15.267708 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f4c1f1dc-6e5c-4c3c-92f0-d96988100c36 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:15.268499 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f4c1f1dc-6e5c-4c3c-92f0-d96988100c36 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:15.269796 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f4c1f1dc-6e5c-4c3c-92f0-d96988100c36 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:15.311407 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f4c1f1dc-6e5c-4c3c-92f0-d96988100c36 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055347 Aug 25 05:48:15.312312 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 958/1878] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:48:15 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:48:16.323696 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-867682e6-fdcc-4a06-b0f4-b30e50667e58 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:16.324827 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-867682e6-fdcc-4a06-b0f4-b30e50667e58 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:16.331644 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-867682e6-fdcc-4a06-b0f4-b30e50667e58 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:16.332695 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-867682e6-fdcc-4a06-b0f4-b30e50667e58 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:16.333475 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-867682e6-fdcc-4a06-b0f4-b30e50667e58 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:16.333996 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-867682e6-fdcc-4a06-b0f4-b30e50667e58 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:16.363207 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-867682e6-fdcc-4a06-b0f4-b30e50667e58 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043295 Aug 25 05:48:16.364069 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 921/1879] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:48:16 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:48:17.376078 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-567b0b17-8bf0-4ec6-af6b-50cfcc974f00 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:17.377006 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-567b0b17-8bf0-4ec6-af6b-50cfcc974f00 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:17.382797 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-567b0b17-8bf0-4ec6-af6b-50cfcc974f00 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:17.383238 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-567b0b17-8bf0-4ec6-af6b-50cfcc974f00 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:17.383998 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-567b0b17-8bf0-4ec6-af6b-50cfcc974f00 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:17.384424 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-567b0b17-8bf0-4ec6-af6b-50cfcc974f00 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:17.415275 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-567b0b17-8bf0-4ec6-af6b-50cfcc974f00 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043316 Aug 25 05:48:17.416199 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 959/1880] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:48:17 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:48:18.427235 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-552ad342-06db-4040-9fd0-1a37da47043d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:18.428141 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-552ad342-06db-4040-9fd0-1a37da47043d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:18.433896 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-552ad342-06db-4040-9fd0-1a37da47043d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:18.434342 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-552ad342-06db-4040-9fd0-1a37da47043d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:18.435110 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-552ad342-06db-4040-9fd0-1a37da47043d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:18.435546 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-552ad342-06db-4040-9fd0-1a37da47043d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:18.466735 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-552ad342-06db-4040-9fd0-1a37da47043d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042662 Aug 25 05:48:18.466735 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 922/1881] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:48:18 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:48:19.478251 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a433c5a5-7dc3-4cdf-9bc9-3df29fb814ad tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:19.479220 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a433c5a5-7dc3-4cdf-9bc9-3df29fb814ad tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:19.485659 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a433c5a5-7dc3-4cdf-9bc9-3df29fb814ad tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:19.486200 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a433c5a5-7dc3-4cdf-9bc9-3df29fb814ad tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:19.486952 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a433c5a5-7dc3-4cdf-9bc9-3df29fb814ad tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:19.487389 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a433c5a5-7dc3-4cdf-9bc9-3df29fb814ad tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:19.516073 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a433c5a5-7dc3-4cdf-9bc9-3df29fb814ad tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041514 Aug 25 05:48:19.516609 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 960/1882] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:48:19 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:48:20.528341 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-4b657a96-62da-40f0-bfea-4b95c6f239d0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:20.529237 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-4b657a96-62da-40f0-bfea-4b95c6f239d0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:20.535321 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4b657a96-62da-40f0-bfea-4b95c6f239d0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:20.536243 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4b657a96-62da-40f0-bfea-4b95c6f239d0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:20.536533 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4b657a96-62da-40f0-bfea-4b95c6f239d0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:20.536962 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4b657a96-62da-40f0-bfea-4b95c6f239d0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:20.566966 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-4b657a96-62da-40f0-bfea-4b95c6f239d0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042026 Aug 25 05:48:20.567504 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 923/1883] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:48:20 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:48:21.578359 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-822c4bc8-b2fe-4248-bf8c-8c700b8b174f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:21.579265 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-822c4bc8-b2fe-4248-bf8c-8c700b8b174f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:21.585806 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-822c4bc8-b2fe-4248-bf8c-8c700b8b174f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:21.586252 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-822c4bc8-b2fe-4248-bf8c-8c700b8b174f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:21.587024 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-822c4bc8-b2fe-4248-bf8c-8c700b8b174f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:21.587456 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-822c4bc8-b2fe-4248-bf8c-8c700b8b174f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:21.616961 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-822c4bc8-b2fe-4248-bf8c-8c700b8b174f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042303 Aug 25 05:48:21.617431 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 961/1884] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:48:21 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:48:22.628839 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-51a16741-f4fb-4725-a42e-317ce715a78b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:22.629758 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-51a16741-f4fb-4725-a42e-317ce715a78b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:22.635356 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-51a16741-f4fb-4725-a42e-317ce715a78b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:22.635799 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-51a16741-f4fb-4725-a42e-317ce715a78b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:22.636555 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-51a16741-f4fb-4725-a42e-317ce715a78b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:22.636979 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-51a16741-f4fb-4725-a42e-317ce715a78b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:22.667037 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-51a16741-f4fb-4725-a42e-317ce715a78b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042551 Aug 25 05:48:22.667502 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 924/1885] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:48:22 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:48:23.678494 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ac0a3d81-a733-4ead-8aaf-bd1d6c146785 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:23.679388 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ac0a3d81-a733-4ead-8aaf-bd1d6c146785 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:23.685032 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ac0a3d81-a733-4ead-8aaf-bd1d6c146785 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:23.685661 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ac0a3d81-a733-4ead-8aaf-bd1d6c146785 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:23.686563 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ac0a3d81-a733-4ead-8aaf-bd1d6c146785 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:23.687111 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ac0a3d81-a733-4ead-8aaf-bd1d6c146785 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:23.717797 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ac0a3d81-a733-4ead-8aaf-bd1d6c146785 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043024 Aug 25 05:48:23.718610 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 962/1886] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:48:23 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:48:24.732221 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-19e280ee-eae2-483a-90d7-3afce6ba275b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:24.733237 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-19e280ee-eae2-483a-90d7-3afce6ba275b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:24.740356 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-19e280ee-eae2-483a-90d7-3afce6ba275b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:24.740809 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-19e280ee-eae2-483a-90d7-3afce6ba275b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:24.742592 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-19e280ee-eae2-483a-90d7-3afce6ba275b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:24.742592 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-19e280ee-eae2-483a-90d7-3afce6ba275b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:24.777780 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-19e280ee-eae2-483a-90d7-3afce6ba275b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051541 Aug 25 05:48:24.778350 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 925/1887] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:48:24 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:48:25.790598 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2cb6a82d-823d-4a67-bd3d-44aae6e66ea9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:25.791509 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2cb6a82d-823d-4a67-bd3d-44aae6e66ea9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:25.800861 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2cb6a82d-823d-4a67-bd3d-44aae6e66ea9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:25.801613 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2cb6a82d-823d-4a67-bd3d-44aae6e66ea9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:25.802853 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2cb6a82d-823d-4a67-bd3d-44aae6e66ea9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:25.803569 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2cb6a82d-823d-4a67-bd3d-44aae6e66ea9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:25.852647 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2cb6a82d-823d-4a67-bd3d-44aae6e66ea9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065984 Aug 25 05:48:25.853233 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 963/1888] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:48:25 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:48:26.864570 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-07578b99-d94f-4827-9b9b-b3eade0b9c93 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:26.865474 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-07578b99-d94f-4827-9b9b-b3eade0b9c93 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:26.871291 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-07578b99-d94f-4827-9b9b-b3eade0b9c93 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:26.871816 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-07578b99-d94f-4827-9b9b-b3eade0b9c93 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:26.872584 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-07578b99-d94f-4827-9b9b-b3eade0b9c93 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:26.873012 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-07578b99-d94f-4827-9b9b-b3eade0b9c93 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:26.903164 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-07578b99-d94f-4827-9b9b-b3eade0b9c93 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042844 Aug 25 05:48:26.903716 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 926/1889] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:48:26 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:48:27.915769 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2f2bf272-b5d4-4928-b57b-2f6008462500 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:27.916664 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2f2bf272-b5d4-4928-b57b-2f6008462500 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:27.922457 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2f2bf272-b5d4-4928-b57b-2f6008462500 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:27.922969 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2f2bf272-b5d4-4928-b57b-2f6008462500 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:27.923742 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2f2bf272-b5d4-4928-b57b-2f6008462500 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:27.924152 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2f2bf272-b5d4-4928-b57b-2f6008462500 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:27.954313 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2f2bf272-b5d4-4928-b57b-2f6008462500 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042224 Aug 25 05:48:27.954888 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 964/1890] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:48:27 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:48:28.974440 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-aaa85372-ea6d-45fc-acae-3ec475cef12c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:28.975352 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-aaa85372-ea6d-45fc-acae-3ec475cef12c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:28.981165 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-aaa85372-ea6d-45fc-acae-3ec475cef12c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:28.981932 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-aaa85372-ea6d-45fc-acae-3ec475cef12c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:28.982718 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-aaa85372-ea6d-45fc-acae-3ec475cef12c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:28.983353 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-aaa85372-ea6d-45fc-acae-3ec475cef12c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:29.016713 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-aaa85372-ea6d-45fc-acae-3ec475cef12c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053481 Aug 25 05:48:29.017268 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 927/1891] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:48:28 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:48:30.028751 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2d69111d-6898-46b3-a58c-6b1af75166f6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:30.029709 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2d69111d-6898-46b3-a58c-6b1af75166f6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:30.037128 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2d69111d-6898-46b3-a58c-6b1af75166f6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:30.037940 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2d69111d-6898-46b3-a58c-6b1af75166f6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:30.039298 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2d69111d-6898-46b3-a58c-6b1af75166f6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:30.039849 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2d69111d-6898-46b3-a58c-6b1af75166f6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:30.074090 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2d69111d-6898-46b3-a58c-6b1af75166f6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049034 Aug 25 05:48:30.074654 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 965/1892] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:48:30 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:48:31.086283 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-019af4a6-eb26-4c09-a15e-f4352951277c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:31.087202 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-019af4a6-eb26-4c09-a15e-f4352951277c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:31.093400 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-019af4a6-eb26-4c09-a15e-f4352951277c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:31.093930 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-019af4a6-eb26-4c09-a15e-f4352951277c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:31.094715 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-019af4a6-eb26-4c09-a15e-f4352951277c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:31.095154 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-019af4a6-eb26-4c09-a15e-f4352951277c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:31.132904 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-019af4a6-eb26-4c09-a15e-f4352951277c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050463 Aug 25 05:48:31.133482 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 928/1893] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:48:31 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:48:32.145818 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-344872a0-f1cf-4440-8d81-ce72986ffacf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:32.146716 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-344872a0-f1cf-4440-8d81-ce72986ffacf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:32.153299 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-344872a0-f1cf-4440-8d81-ce72986ffacf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:32.153505 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-344872a0-f1cf-4440-8d81-ce72986ffacf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:32.154314 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-344872a0-f1cf-4440-8d81-ce72986ffacf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:32.154756 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-344872a0-f1cf-4440-8d81-ce72986ffacf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:32.184997 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-344872a0-f1cf-4440-8d81-ce72986ffacf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043509 Aug 25 05:48:32.185580 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 966/1894] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:48:32 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:48:33.197012 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-af36a8bd-9283-4705-b283-dc658e64a21c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:33.197853 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-af36a8bd-9283-4705-b283-dc658e64a21c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:33.203657 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-af36a8bd-9283-4705-b283-dc658e64a21c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:33.204106 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-af36a8bd-9283-4705-b283-dc658e64a21c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:33.204871 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-af36a8bd-9283-4705-b283-dc658e64a21c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:33.205315 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-af36a8bd-9283-4705-b283-dc658e64a21c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:33.234555 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-af36a8bd-9283-4705-b283-dc658e64a21c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041343 Aug 25 05:48:33.235219 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 929/1895] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:48:33 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:48:34.246401 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b1cb1be0-1274-4fb7-b36f-56a60ddcccdc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:34.247301 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b1cb1be0-1274-4fb7-b36f-56a60ddcccdc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:34.254019 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b1cb1be0-1274-4fb7-b36f-56a60ddcccdc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:34.254465 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b1cb1be0-1274-4fb7-b36f-56a60ddcccdc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:34.255223 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b1cb1be0-1274-4fb7-b36f-56a60ddcccdc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:34.255655 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b1cb1be0-1274-4fb7-b36f-56a60ddcccdc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:34.285246 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b1cb1be0-1274-4fb7-b36f-56a60ddcccdc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042527 Aug 25 05:48:34.285826 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 967/1896] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:48:34 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:48:35.296097 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-67b564c9-41c6-4e1d-a940-f54c0d6fc9a3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:35.296996 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-67b564c9-41c6-4e1d-a940-f54c0d6fc9a3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:35.303118 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-67b564c9-41c6-4e1d-a940-f54c0d6fc9a3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:35.303582 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-67b564c9-41c6-4e1d-a940-f54c0d6fc9a3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:35.304331 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-67b564c9-41c6-4e1d-a940-f54c0d6fc9a3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:35.304826 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-67b564c9-41c6-4e1d-a940-f54c0d6fc9a3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:35.333432 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-67b564c9-41c6-4e1d-a940-f54c0d6fc9a3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041141 Aug 25 05:48:35.334011 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 930/1897] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:48:35 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:48:36.344074 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-4dc5a8d2-2074-420b-bd20-a02939115445 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:36.345054 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-4dc5a8d2-2074-420b-bd20-a02939115445 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:36.352262 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4dc5a8d2-2074-420b-bd20-a02939115445 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:36.352710 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4dc5a8d2-2074-420b-bd20-a02939115445 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:36.353478 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4dc5a8d2-2074-420b-bd20-a02939115445 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:36.353949 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4dc5a8d2-2074-420b-bd20-a02939115445 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:36.385391 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-4dc5a8d2-2074-420b-bd20-a02939115445 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045033 Aug 25 05:48:36.385974 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 968/1898] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 05:48:36 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:48:37.396379 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-18f4ab41-58d7-4bb7-8fe3-4c7d5c8ef8ef tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:48:37.397300 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-18f4ab41-58d7-4bb7-8fe3-4c7d5c8ef8ef tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:37.400001 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4945947b-868a-4594-a167-64b475d876a3] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 25 05:48:37.404394 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-18f4ab41-58d7-4bb7-8fe3-4c7d5c8ef8ef tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:37.404818 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-18f4ab41-58d7-4bb7-8fe3-4c7d5c8ef8ef tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:37.405601 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-18f4ab41-58d7-4bb7-8fe3-4c7d5c8ef8ef tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:37.406029 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-18f4ab41-58d7-4bb7-8fe3-4c7d5c8ef8ef tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:38.419134 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [-] [4945947b-868a-4594-a167-64b475d876a3] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 38774. Aug 25 05:48:38.427753 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-18f4ab41-58d7-4bb7-8fe3-4c7d5c8ef8ef tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action" status: 200 len: 76467 microversion: 2.1 time: 1.033965 Aug 25 05:48:38.429065 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 931/1899] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:48:37 2021] POST /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27/action => generated 76467 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:48:38.594049 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d16ae51f-7047-457e-8e5a-0730e0c25bd4 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:38.594827 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d16ae51f-7047-457e-8e5a-0730e0c25bd4 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:38.601279 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d16ae51f-7047-457e-8e5a-0730e0c25bd4 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:38.601766 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d16ae51f-7047-457e-8e5a-0730e0c25bd4 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:38.602632 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d16ae51f-7047-457e-8e5a-0730e0c25bd4 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:38.603062 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d16ae51f-7047-457e-8e5a-0730e0c25bd4 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:38.628502 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d16ae51f-7047-457e-8e5a-0730e0c25bd4 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Going to try to terminate instance {{(pid=108885) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 25 05:48:38.960763 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d16ae51f-7047-457e-8e5a-0730e0c25bd4 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 204 len: 0 microversion: 2.1 time: 0.369985 Aug 25 05:48:38.961370 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 969/1900] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 25 05:48:38 2021] DELETE /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 05:48:38.970453 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-788ec4d4-5712-4a66-8003-7533494db116 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:38.971240 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-788ec4d4-5712-4a66-8003-7533494db116 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:38.980283 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-788ec4d4-5712-4a66-8003-7533494db116 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:38.980728 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-788ec4d4-5712-4a66-8003-7533494db116 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:38.981914 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-788ec4d4-5712-4a66-8003-7533494db116 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:38.982620 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-788ec4d4-5712-4a66-8003-7533494db116 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:39.119326 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-788ec4d4-5712-4a66-8003-7533494db116 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:48:39.131298 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-788ec4d4-5712-4a66-8003-7533494db116 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1560 microversion: 2.1 time: 0.165302 Aug 25 05:48:39.131865 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 932/1901] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:48:38 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:48:40.149847 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6d6b1324-5621-47d3-b730-b162692eb062 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:40.150448 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6d6b1324-5621-47d3-b730-b162692eb062 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:40.156558 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6d6b1324-5621-47d3-b730-b162692eb062 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:40.157091 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6d6b1324-5621-47d3-b730-b162692eb062 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:40.157960 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6d6b1324-5621-47d3-b730-b162692eb062 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:40.158389 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6d6b1324-5621-47d3-b730-b162692eb062 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:40.295805 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-6d6b1324-5621-47d3-b730-b162692eb062 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:48:40.307718 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6d6b1324-5621-47d3-b730-b162692eb062 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1560 microversion: 2.1 time: 0.163180 Aug 25 05:48:40.308316 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 970/1902] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:48:40 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:48:40.356971 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [req-27dc4035-e8a2-4a7a-b02b-4050f90e1b4e req-197b71c6-5692-435e-9db8-c7e98fdc1f20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e74fcd5-99b3-4716-b064-182c7db61275", "name": "network-vif-deleted", "tag": "595c1454-355d-4c8f-85d4-ca230e7a0a3c"}]} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:48:40.359849 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:48:40.359849 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: warnings.warn(msg) Aug 25 05:48:40.369387 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-27dc4035-e8a2-4a7a-b02b-4050f90e1b4e req-197b71c6-5692-435e-9db8-c7e98fdc1f20 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:40.369861 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-27dc4035-e8a2-4a7a-b02b-4050f90e1b4e req-197b71c6-5692-435e-9db8-c7e98fdc1f20 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:40.380844 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.compute.server_external_events [req-27dc4035-e8a2-4a7a-b02b-4050f90e1b4e req-197b71c6-5692-435e-9db8-c7e98fdc1f20 service nova] Creating event network-vif-deleted:595c1454-355d-4c8f-85d4-ca230e7a0a3c for instance 8e74fcd5-99b3-4716-b064-182c7db61275 on hv-cinder-78662 Aug 25 05:48:40.385861 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [req-27dc4035-e8a2-4a7a-b02b-4050f90e1b4e req-197b71c6-5692-435e-9db8-c7e98fdc1f20 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034539 Aug 25 05:48:40.386431 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 933/1903] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:48:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:48:41.324085 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f7665cc2-4370-41e6-9f73-c33e0ee27117 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:41.324685 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f7665cc2-4370-41e6-9f73-c33e0ee27117 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:41.330565 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f7665cc2-4370-41e6-9f73-c33e0ee27117 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:41.331084 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f7665cc2-4370-41e6-9f73-c33e0ee27117 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:41.331837 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f7665cc2-4370-41e6-9f73-c33e0ee27117 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:41.332257 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f7665cc2-4370-41e6-9f73-c33e0ee27117 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:41.394299 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-f7665cc2-4370-41e6-9f73-c33e0ee27117 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:48:41.402897 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f7665cc2-4370-41e6-9f73-c33e0ee27117 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.082529 Aug 25 05:48:41.403954 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 971/1904] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:48:41 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:48:42.420662 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6b9ab499-a415-49f0-9d0f-55357a9d0351 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:42.421345 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6b9ab499-a415-49f0-9d0f-55357a9d0351 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:42.427517 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6b9ab499-a415-49f0-9d0f-55357a9d0351 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:42.427956 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6b9ab499-a415-49f0-9d0f-55357a9d0351 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:42.428767 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6b9ab499-a415-49f0-9d0f-55357a9d0351 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:42.429204 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6b9ab499-a415-49f0-9d0f-55357a9d0351 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:42.490160 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6b9ab499-a415-49f0-9d0f-55357a9d0351 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:48:42.497791 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6b9ab499-a415-49f0-9d0f-55357a9d0351 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.081781 Aug 25 05:48:42.498340 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 934/1905] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:48:42 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:48:43.515276 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-144d333a-5715-49f3-b042-3420e720bc87 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:43.515872 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-144d333a-5715-49f3-b042-3420e720bc87 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:43.523893 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-144d333a-5715-49f3-b042-3420e720bc87 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:43.524639 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-144d333a-5715-49f3-b042-3420e720bc87 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:43.525994 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-144d333a-5715-49f3-b042-3420e720bc87 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:43.526712 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-144d333a-5715-49f3-b042-3420e720bc87 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:43.588814 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-144d333a-5715-49f3-b042-3420e720bc87 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:48:43.597548 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-144d333a-5715-49f3-b042-3420e720bc87 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.086093 Aug 25 05:48:43.598701 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 972/1906] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:48:43 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:48:44.617440 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6b60e09d-9d68-4a7d-bfc0-083d5b0a13c7 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:44.618102 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6b60e09d-9d68-4a7d-bfc0-083d5b0a13c7 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:44.623988 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6b60e09d-9d68-4a7d-bfc0-083d5b0a13c7 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:44.624440 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6b60e09d-9d68-4a7d-bfc0-083d5b0a13c7 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:44.625300 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6b60e09d-9d68-4a7d-bfc0-083d5b0a13c7 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:44.625760 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6b60e09d-9d68-4a7d-bfc0-083d5b0a13c7 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:44.685025 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6b60e09d-9d68-4a7d-bfc0-083d5b0a13c7 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:48:44.693110 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6b60e09d-9d68-4a7d-bfc0-083d5b0a13c7 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.080074 Aug 25 05:48:44.693635 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 935/1907] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:48:44 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:48:45.709577 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-8d8dd6f5-16e1-4606-bd6c-7360b52484cb tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:45.710189 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-8d8dd6f5-16e1-4606-bd6c-7360b52484cb tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:45.716408 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8d8dd6f5-16e1-4606-bd6c-7360b52484cb tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:45.716927 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8d8dd6f5-16e1-4606-bd6c-7360b52484cb tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:45.717757 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8d8dd6f5-16e1-4606-bd6c-7360b52484cb tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:45.718172 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8d8dd6f5-16e1-4606-bd6c-7360b52484cb tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:45.780074 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-8d8dd6f5-16e1-4606-bd6c-7360b52484cb tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:48:45.788799 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-8d8dd6f5-16e1-4606-bd6c-7360b52484cb tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.082804 Aug 25 05:48:45.789329 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 973/1908] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:48:45 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:48:46.808583 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-63275c99-8a84-4e22-b6d0-f29ca59dfaa9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:46.809247 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-63275c99-8a84-4e22-b6d0-f29ca59dfaa9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:46.815722 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-63275c99-8a84-4e22-b6d0-f29ca59dfaa9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:46.816169 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-63275c99-8a84-4e22-b6d0-f29ca59dfaa9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:46.816961 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-63275c99-8a84-4e22-b6d0-f29ca59dfaa9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:46.817389 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-63275c99-8a84-4e22-b6d0-f29ca59dfaa9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:46.886929 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-63275c99-8a84-4e22-b6d0-f29ca59dfaa9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:48:46.895438 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-63275c99-8a84-4e22-b6d0-f29ca59dfaa9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.090597 Aug 25 05:48:46.896023 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 936/1909] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:48:46 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:48:47.946391 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e38e5237-7c36-487b-b700-e6aa1bbb11f3 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:47.946391 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e38e5237-7c36-487b-b700-e6aa1bbb11f3 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:47.946391 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e38e5237-7c36-487b-b700-e6aa1bbb11f3 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:47.946391 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e38e5237-7c36-487b-b700-e6aa1bbb11f3 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:47.947999 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e38e5237-7c36-487b-b700-e6aa1bbb11f3 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:47.947999 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e38e5237-7c36-487b-b700-e6aa1bbb11f3 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:48.000517 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-e38e5237-7c36-487b-b700-e6aa1bbb11f3 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:48:48.000517 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e38e5237-7c36-487b-b700-e6aa1bbb11f3 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.089790 Aug 25 05:48:48.001121 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 974/1910] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:48:47 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:48:49.018094 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-f662338b-0eaa-412b-8add-c06d3d2f0d72 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:49.018704 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-f662338b-0eaa-412b-8add-c06d3d2f0d72 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:49.025885 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f662338b-0eaa-412b-8add-c06d3d2f0d72 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:49.026336 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f662338b-0eaa-412b-8add-c06d3d2f0d72 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:49.027117 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f662338b-0eaa-412b-8add-c06d3d2f0d72 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:49.027548 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f662338b-0eaa-412b-8add-c06d3d2f0d72 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:49.088652 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-f662338b-0eaa-412b-8add-c06d3d2f0d72 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:48:49.096430 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-f662338b-0eaa-412b-8add-c06d3d2f0d72 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.082010 Aug 25 05:48:49.096993 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 937/1911] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:48:49 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:48:50.111910 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d8c6f88d-0586-4ba8-af19-e4c9000a7b11 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:50.112478 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d8c6f88d-0586-4ba8-af19-e4c9000a7b11 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:50.118609 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d8c6f88d-0586-4ba8-af19-e4c9000a7b11 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:50.119044 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d8c6f88d-0586-4ba8-af19-e4c9000a7b11 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:50.119802 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d8c6f88d-0586-4ba8-af19-e4c9000a7b11 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:50.120223 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d8c6f88d-0586-4ba8-af19-e4c9000a7b11 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:50.184076 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d8c6f88d-0586-4ba8-af19-e4c9000a7b11 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:48:50.192062 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d8c6f88d-0586-4ba8-af19-e4c9000a7b11 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.083706 Aug 25 05:48:50.192628 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 975/1912] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:48:50 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:48:51.208627 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ef14d12e-a4dc-418c-8075-c26b11df22d6 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:51.209262 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ef14d12e-a4dc-418c-8075-c26b11df22d6 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:51.215255 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ef14d12e-a4dc-418c-8075-c26b11df22d6 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:51.215699 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ef14d12e-a4dc-418c-8075-c26b11df22d6 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:51.216469 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ef14d12e-a4dc-418c-8075-c26b11df22d6 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:51.216899 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ef14d12e-a4dc-418c-8075-c26b11df22d6 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:51.276550 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ef14d12e-a4dc-418c-8075-c26b11df22d6 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:48:51.284207 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ef14d12e-a4dc-418c-8075-c26b11df22d6 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.079235 Aug 25 05:48:51.284764 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 938/1913] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:48:51 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:48:52.302255 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-984eef2a-a3bc-4d80-b755-c7d56b8f5e62 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:52.303519 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-984eef2a-a3bc-4d80-b755-c7d56b8f5e62 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:52.309777 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-984eef2a-a3bc-4d80-b755-c7d56b8f5e62 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:52.310343 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-984eef2a-a3bc-4d80-b755-c7d56b8f5e62 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:52.311130 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-984eef2a-a3bc-4d80-b755-c7d56b8f5e62 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:52.311565 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-984eef2a-a3bc-4d80-b755-c7d56b8f5e62 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:52.384703 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-984eef2a-a3bc-4d80-b755-c7d56b8f5e62 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:48:52.392711 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-984eef2a-a3bc-4d80-b755-c7d56b8f5e62 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.094606 Aug 25 05:48:52.393277 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 976/1914] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:48:52 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:48:53.409939 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-95b4dc5d-47f5-498e-b61e-46f71df48951 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:53.410553 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-95b4dc5d-47f5-498e-b61e-46f71df48951 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:53.416741 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-95b4dc5d-47f5-498e-b61e-46f71df48951 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:53.417178 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-95b4dc5d-47f5-498e-b61e-46f71df48951 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:53.417967 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-95b4dc5d-47f5-498e-b61e-46f71df48951 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:53.418388 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-95b4dc5d-47f5-498e-b61e-46f71df48951 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:53.480975 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-95b4dc5d-47f5-498e-b61e-46f71df48951 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:48:53.492134 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-95b4dc5d-47f5-498e-b61e-46f71df48951 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.085825 Aug 25 05:48:53.492620 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 939/1915] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:48:53 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:48:54.506407 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: ERROR oslo.messaging._drivers.impl_rabbit [-] [024c7946-b47b-4a06-aa5e-7d5b6a13301d] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 25 05:48:54.509814 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9aa6f106-ef12-4596-8aec-0309e1db9f61 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:54.510449 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9aa6f106-ef12-4596-8aec-0309e1db9f61 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:54.516272 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9aa6f106-ef12-4596-8aec-0309e1db9f61 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:54.516747 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9aa6f106-ef12-4596-8aec-0309e1db9f61 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:54.517546 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9aa6f106-ef12-4596-8aec-0309e1db9f61 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:54.517917 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9aa6f106-ef12-4596-8aec-0309e1db9f61 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:54.578739 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-9aa6f106-ef12-4596-8aec-0309e1db9f61 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:48:54.587676 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9aa6f106-ef12-4596-8aec-0309e1db9f61 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.081987 Aug 25 05:48:54.588282 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 977/1916] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:48:54 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:48:55.605425 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-133dfb16-50c8-4803-a922-0c9649c02559 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:55.606023 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-133dfb16-50c8-4803-a922-0c9649c02559 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:55.612199 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-133dfb16-50c8-4803-a922-0c9649c02559 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:55.612638 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-133dfb16-50c8-4803-a922-0c9649c02559 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:55.613467 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-133dfb16-50c8-4803-a922-0c9649c02559 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:55.613954 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-133dfb16-50c8-4803-a922-0c9649c02559 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:55.675048 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-133dfb16-50c8-4803-a922-0c9649c02559 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:48:55.683567 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-133dfb16-50c8-4803-a922-0c9649c02559 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.082717 Aug 25 05:48:55.684123 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 940/1917] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:48:55 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:48:56.701452 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b05a1870-7ab4-4197-9981-e1bbae023b1e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:56.702040 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b05a1870-7ab4-4197-9981-e1bbae023b1e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:56.719310 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b05a1870-7ab4-4197-9981-e1bbae023b1e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:56.719750 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b05a1870-7ab4-4197-9981-e1bbae023b1e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:56.720516 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b05a1870-7ab4-4197-9981-e1bbae023b1e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:56.720943 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b05a1870-7ab4-4197-9981-e1bbae023b1e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:56.726793 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO oslo.messaging._drivers.impl_rabbit [-] [024c7946-b47b-4a06-aa5e-7d5b6a13301d] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 38888. Aug 25 05:48:56.783474 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-b05a1870-7ab4-4197-9981-e1bbae023b1e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:48:56.791799 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b05a1870-7ab4-4197-9981-e1bbae023b1e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.094488 Aug 25 05:48:56.792363 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 978/1918] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:48:56 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:48:57.809032 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7beaa401-b925-4c9c-ba2d-983c27145592 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:57.809682 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7beaa401-b925-4c9c-ba2d-983c27145592 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:57.815567 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7beaa401-b925-4c9c-ba2d-983c27145592 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:57.816004 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7beaa401-b925-4c9c-ba2d-983c27145592 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:57.816755 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7beaa401-b925-4c9c-ba2d-983c27145592 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:57.817178 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7beaa401-b925-4c9c-ba2d-983c27145592 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:57.878401 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-7beaa401-b925-4c9c-ba2d-983c27145592 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:48:57.886677 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7beaa401-b925-4c9c-ba2d-983c27145592 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.081767 Aug 25 05:48:57.887243 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 941/1919] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:48:57 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:48:58.905055 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-22e1738e-e030-4808-afea-30562f92ce90 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:48:58.905753 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-22e1738e-e030-4808-afea-30562f92ce90 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:48:58.911627 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-22e1738e-e030-4808-afea-30562f92ce90 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:58.912132 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-22e1738e-e030-4808-afea-30562f92ce90 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:58.912888 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-22e1738e-e030-4808-afea-30562f92ce90 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:48:58.913322 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-22e1738e-e030-4808-afea-30562f92ce90 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:48:58.974182 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-22e1738e-e030-4808-afea-30562f92ce90 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:48:58.982823 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-22e1738e-e030-4808-afea-30562f92ce90 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.082650 Aug 25 05:48:58.983379 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 979/1920] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:48:58 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:00.000451 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e8c72642-7a95-4a8a-b23c-958339147c02 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:00.000995 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e8c72642-7a95-4a8a-b23c-958339147c02 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:00.008592 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e8c72642-7a95-4a8a-b23c-958339147c02 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:00.009036 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e8c72642-7a95-4a8a-b23c-958339147c02 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:00.009833 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e8c72642-7a95-4a8a-b23c-958339147c02 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:00.011087 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e8c72642-7a95-4a8a-b23c-958339147c02 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:00.075941 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e8c72642-7a95-4a8a-b23c-958339147c02 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:00.083746 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e8c72642-7a95-4a8a-b23c-958339147c02 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.087134 Aug 25 05:49:00.084305 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 942/1921] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:48:59 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:01.100404 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f0f9d3e1-01cc-4fc1-b905-523ff4a2e916 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:01.101024 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f0f9d3e1-01cc-4fc1-b905-523ff4a2e916 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:01.107530 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f0f9d3e1-01cc-4fc1-b905-523ff4a2e916 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:01.107981 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f0f9d3e1-01cc-4fc1-b905-523ff4a2e916 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:01.108747 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f0f9d3e1-01cc-4fc1-b905-523ff4a2e916 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:01.109181 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f0f9d3e1-01cc-4fc1-b905-523ff4a2e916 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:01.169665 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-f0f9d3e1-01cc-4fc1-b905-523ff4a2e916 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:01.177459 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f0f9d3e1-01cc-4fc1-b905-523ff4a2e916 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.080819 Aug 25 05:49:01.178133 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 980/1922] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:01 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:02.194962 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a759f71b-af39-404a-9022-b0d87530de3a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:02.195767 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a759f71b-af39-404a-9022-b0d87530de3a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:02.206222 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a759f71b-af39-404a-9022-b0d87530de3a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:02.206666 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a759f71b-af39-404a-9022-b0d87530de3a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:02.207448 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a759f71b-af39-404a-9022-b0d87530de3a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:02.207876 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a759f71b-af39-404a-9022-b0d87530de3a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:02.268719 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-a759f71b-af39-404a-9022-b0d87530de3a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:02.277557 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a759f71b-af39-404a-9022-b0d87530de3a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.086203 Aug 25 05:49:02.278235 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 943/1923] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:02 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:03.294638 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-8d1d93d0-0671-4da1-b9e9-287008fae9fb tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:03.295245 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-8d1d93d0-0671-4da1-b9e9-287008fae9fb tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:03.301130 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8d1d93d0-0671-4da1-b9e9-287008fae9fb tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:03.301608 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8d1d93d0-0671-4da1-b9e9-287008fae9fb tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:03.302379 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8d1d93d0-0671-4da1-b9e9-287008fae9fb tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:03.302811 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8d1d93d0-0671-4da1-b9e9-287008fae9fb tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:03.362796 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-8d1d93d0-0671-4da1-b9e9-287008fae9fb tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:03.371684 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-8d1d93d0-0671-4da1-b9e9-287008fae9fb tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.081325 Aug 25 05:49:03.372256 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 981/1924] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:03 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:04.389345 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b5937609-a52b-4c4d-9d21-1659a563fe58 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:04.390049 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b5937609-a52b-4c4d-9d21-1659a563fe58 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:04.395875 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b5937609-a52b-4c4d-9d21-1659a563fe58 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:04.396315 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b5937609-a52b-4c4d-9d21-1659a563fe58 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:04.397075 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b5937609-a52b-4c4d-9d21-1659a563fe58 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:04.397499 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b5937609-a52b-4c4d-9d21-1659a563fe58 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:04.461326 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-b5937609-a52b-4c4d-9d21-1659a563fe58 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:04.469495 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b5937609-a52b-4c4d-9d21-1659a563fe58 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.084706 Aug 25 05:49:04.470088 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 944/1925] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:04 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:04.958622 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 05:49:04.958780 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: Wed Aug 25 05:49:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 05:49:05.486207 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-3f585a4f-6831-46b7-a40c-494fb0225f3c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:05.486831 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-3f585a4f-6831-46b7-a40c-494fb0225f3c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:05.492671 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3f585a4f-6831-46b7-a40c-494fb0225f3c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:05.493048 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3f585a4f-6831-46b7-a40c-494fb0225f3c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:05.493825 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3f585a4f-6831-46b7-a40c-494fb0225f3c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:05.494252 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3f585a4f-6831-46b7-a40c-494fb0225f3c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:05.554512 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-3f585a4f-6831-46b7-a40c-494fb0225f3c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:05.563825 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-3f585a4f-6831-46b7-a40c-494fb0225f3c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.080233 Aug 25 05:49:05.564420 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 982/1926] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:05 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:06.581429 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8ab761a2-9d17-4f13-b358-4d5c7d4c667a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:06.582170 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8ab761a2-9d17-4f13-b358-4d5c7d4c667a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:06.588088 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8ab761a2-9d17-4f13-b358-4d5c7d4c667a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:06.588532 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8ab761a2-9d17-4f13-b358-4d5c7d4c667a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:06.589299 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8ab761a2-9d17-4f13-b358-4d5c7d4c667a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:06.589769 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8ab761a2-9d17-4f13-b358-4d5c7d4c667a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:06.656879 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-8ab761a2-9d17-4f13-b358-4d5c7d4c667a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:06.664642 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8ab761a2-9d17-4f13-b358-4d5c7d4c667a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.086927 Aug 25 05:49:06.665201 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 945/1927] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:06 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:07.681107 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-761b7688-c721-4833-ab18-787aa1e0a255 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:07.681755 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-761b7688-c721-4833-ab18-787aa1e0a255 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:07.689378 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-761b7688-c721-4833-ab18-787aa1e0a255 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:07.689845 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-761b7688-c721-4833-ab18-787aa1e0a255 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:07.691073 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-761b7688-c721-4833-ab18-787aa1e0a255 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:07.691505 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-761b7688-c721-4833-ab18-787aa1e0a255 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:07.751754 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-761b7688-c721-4833-ab18-787aa1e0a255 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:07.759473 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-761b7688-c721-4833-ab18-787aa1e0a255 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.082007 Aug 25 05:49:07.760038 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 983/1928] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:07 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:08.777789 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c1fc4269-0386-4ada-b808-8f556b3e7599 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:08.778410 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c1fc4269-0386-4ada-b808-8f556b3e7599 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:08.784769 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c1fc4269-0386-4ada-b808-8f556b3e7599 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:08.785207 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c1fc4269-0386-4ada-b808-8f556b3e7599 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:08.786051 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c1fc4269-0386-4ada-b808-8f556b3e7599 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:08.786422 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c1fc4269-0386-4ada-b808-8f556b3e7599 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:08.847097 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-c1fc4269-0386-4ada-b808-8f556b3e7599 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:08.854853 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c1fc4269-0386-4ada-b808-8f556b3e7599 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.080976 Aug 25 05:49:08.855479 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 946/1929] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:08 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:09.872344 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6deb9f37-81fd-4e35-ada4-ee77a9d1ad4a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:09.873000 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6deb9f37-81fd-4e35-ada4-ee77a9d1ad4a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:09.879219 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6deb9f37-81fd-4e35-ada4-ee77a9d1ad4a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:09.879663 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6deb9f37-81fd-4e35-ada4-ee77a9d1ad4a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:09.880419 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6deb9f37-81fd-4e35-ada4-ee77a9d1ad4a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:09.880848 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6deb9f37-81fd-4e35-ada4-ee77a9d1ad4a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:09.941354 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-6deb9f37-81fd-4e35-ada4-ee77a9d1ad4a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:09.949179 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6deb9f37-81fd-4e35-ada4-ee77a9d1ad4a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.080718 Aug 25 05:49:09.949767 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 984/1930] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:09 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:10.965608 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-950778ad-255b-4d08-99da-be9d504f632e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:10.966253 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-950778ad-255b-4d08-99da-be9d504f632e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:10.972706 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-950778ad-255b-4d08-99da-be9d504f632e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:10.973151 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-950778ad-255b-4d08-99da-be9d504f632e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:10.973947 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-950778ad-255b-4d08-99da-be9d504f632e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:10.974382 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-950778ad-255b-4d08-99da-be9d504f632e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:11.036040 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-950778ad-255b-4d08-99da-be9d504f632e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:11.044358 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-950778ad-255b-4d08-99da-be9d504f632e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.082548 Aug 25 05:49:11.044920 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 947/1931] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:10 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:12.062160 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-8145f9c5-fc63-4af7-94b4-0fa741247781 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:12.062771 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-8145f9c5-fc63-4af7-94b4-0fa741247781 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:12.068575 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8145f9c5-fc63-4af7-94b4-0fa741247781 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:12.069018 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8145f9c5-fc63-4af7-94b4-0fa741247781 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:12.069910 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8145f9c5-fc63-4af7-94b4-0fa741247781 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:12.070355 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8145f9c5-fc63-4af7-94b4-0fa741247781 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:12.129892 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-8145f9c5-fc63-4af7-94b4-0fa741247781 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:12.137632 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-8145f9c5-fc63-4af7-94b4-0fa741247781 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.079370 Aug 25 05:49:12.138207 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 985/1932] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:12 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:13.154710 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-72c53a04-4543-480e-8ba7-a5fef5c6dfa9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:13.155311 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-72c53a04-4543-480e-8ba7-a5fef5c6dfa9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:13.161640 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-72c53a04-4543-480e-8ba7-a5fef5c6dfa9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:13.162083 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-72c53a04-4543-480e-8ba7-a5fef5c6dfa9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:13.162834 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-72c53a04-4543-480e-8ba7-a5fef5c6dfa9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:13.163301 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-72c53a04-4543-480e-8ba7-a5fef5c6dfa9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:13.225912 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-72c53a04-4543-480e-8ba7-a5fef5c6dfa9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:13.233587 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-72c53a04-4543-480e-8ba7-a5fef5c6dfa9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.082628 Aug 25 05:49:13.234144 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 948/1933] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:13 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:14.251731 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-33ee0ddb-d7b4-4287-9522-725cf43c28c2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:14.252344 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-33ee0ddb-d7b4-4287-9522-725cf43c28c2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:14.259018 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-33ee0ddb-d7b4-4287-9522-725cf43c28c2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:14.259462 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-33ee0ddb-d7b4-4287-9522-725cf43c28c2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:14.260223 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-33ee0ddb-d7b4-4287-9522-725cf43c28c2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:14.260653 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-33ee0ddb-d7b4-4287-9522-725cf43c28c2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:14.321158 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-33ee0ddb-d7b4-4287-9522-725cf43c28c2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:14.328876 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-33ee0ddb-d7b4-4287-9522-725cf43c28c2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.080865 Aug 25 05:49:14.329425 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 986/1934] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:14 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:15.346996 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6aa83fe7-a074-4836-9950-bb75dcdd63a3 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:15.347622 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6aa83fe7-a074-4836-9950-bb75dcdd63a3 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:15.354340 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6aa83fe7-a074-4836-9950-bb75dcdd63a3 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:15.354788 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6aa83fe7-a074-4836-9950-bb75dcdd63a3 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:15.355615 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6aa83fe7-a074-4836-9950-bb75dcdd63a3 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:15.356042 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6aa83fe7-a074-4836-9950-bb75dcdd63a3 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:15.416867 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6aa83fe7-a074-4836-9950-bb75dcdd63a3 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:15.425891 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6aa83fe7-a074-4836-9950-bb75dcdd63a3 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.082747 Aug 25 05:49:15.426523 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 949/1935] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:15 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:15.488121 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-3dc36309-96c7-49bb-9ab0-39e8ab82a8cc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:15.488782 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-3dc36309-96c7-49bb-9ab0-39e8ab82a8cc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:15.494849 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3dc36309-96c7-49bb-9ab0-39e8ab82a8cc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:15.495296 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3dc36309-96c7-49bb-9ab0-39e8ab82a8cc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:15.496069 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3dc36309-96c7-49bb-9ab0-39e8ab82a8cc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:15.496498 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3dc36309-96c7-49bb-9ab0-39e8ab82a8cc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:15.521603 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-3dc36309-96c7-49bb-9ab0-39e8ab82a8cc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Going to try to terminate instance {{(pid=108885) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 25 05:49:15.897716 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-3dc36309-96c7-49bb-9ab0-39e8ab82a8cc tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 204 len: 0 microversion: 2.20 time: 0.413028 Aug 25 05:49:15.898550 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 987/1936] 10.222.0.42 () {60 vars in 1280 bytes} [Wed Aug 25 05:49:15 2021] DELETE /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 05:49:15.906848 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8c3f9d60-b538-4f09-82a5-c78dd4510e72 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:15.907378 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8c3f9d60-b538-4f09-82a5-c78dd4510e72 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:15.913621 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8c3f9d60-b538-4f09-82a5-c78dd4510e72 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:15.917923 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8c3f9d60-b538-4f09-82a5-c78dd4510e72 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:15.917923 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8c3f9d60-b538-4f09-82a5-c78dd4510e72 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:15.917923 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8c3f9d60-b538-4f09-82a5-c78dd4510e72 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:16.036602 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-8c3f9d60-b538-4f09-82a5-c78dd4510e72 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:16.044792 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-8c3f9d60-b538-4f09-82a5-c78dd4510e72 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:16.046299 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-8c3f9d60-b538-4f09-82a5-c78dd4510e72 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:16.047430 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8c3f9d60-b538-4f09-82a5-c78dd4510e72 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1802 microversion: 2.20 time: 0.144551 Aug 25 05:49:16.047980 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 950/1937] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:49:15 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1802 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:49:16.444718 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-4e539d6f-8c0d-4336-91ce-ff5b89ea703a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:16.445435 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-4e539d6f-8c0d-4336-91ce-ff5b89ea703a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:16.451288 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4e539d6f-8c0d-4336-91ce-ff5b89ea703a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:16.451729 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4e539d6f-8c0d-4336-91ce-ff5b89ea703a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:16.452491 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4e539d6f-8c0d-4336-91ce-ff5b89ea703a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:16.452926 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4e539d6f-8c0d-4336-91ce-ff5b89ea703a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:16.519346 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-4e539d6f-8c0d-4336-91ce-ff5b89ea703a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:16.529063 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-4e539d6f-8c0d-4336-91ce-ff5b89ea703a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.089243 Aug 25 05:49:16.529724 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 988/1938] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:16 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:17.066564 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e0294b95-141e-436d-9a0d-c8cd4e3f28c0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:17.068000 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e0294b95-141e-436d-9a0d-c8cd4e3f28c0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:17.073948 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e0294b95-141e-436d-9a0d-c8cd4e3f28c0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:17.074396 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e0294b95-141e-436d-9a0d-c8cd4e3f28c0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:17.075173 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e0294b95-141e-436d-9a0d-c8cd4e3f28c0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:17.075609 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e0294b95-141e-436d-9a0d-c8cd4e3f28c0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:17.205972 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e0294b95-141e-436d-9a0d-c8cd4e3f28c0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:17.214736 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e0294b95-141e-436d-9a0d-c8cd4e3f28c0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:17.216222 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e0294b95-141e-436d-9a0d-c8cd4e3f28c0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:17.217375 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e0294b95-141e-436d-9a0d-c8cd4e3f28c0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1802 microversion: 2.20 time: 0.154722 Aug 25 05:49:17.217969 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 951/1939] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:49:17 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:49:17.547254 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a14acd31-f176-4595-9059-c3aa8afcdb1d tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:17.547968 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a14acd31-f176-4595-9059-c3aa8afcdb1d tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:17.554206 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a14acd31-f176-4595-9059-c3aa8afcdb1d tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:17.554745 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a14acd31-f176-4595-9059-c3aa8afcdb1d tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:17.555581 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a14acd31-f176-4595-9059-c3aa8afcdb1d tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:17.556078 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a14acd31-f176-4595-9059-c3aa8afcdb1d tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:17.618564 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-a14acd31-f176-4595-9059-c3aa8afcdb1d tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:17.626750 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a14acd31-f176-4595-9059-c3aa8afcdb1d tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.083846 Aug 25 05:49:17.627317 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 989/1940] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:17 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:18.006867 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [req-e23be026-62dc-4d32-a42b-72087d5ce420 req-4f52b078-4d17-4eec-bfdb-9a54679c8b71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cb635d4-76ba-4143-8f4d-a64c720966da", "name": "network-vif-deleted", "tag": "605f6633-54d1-4fa5-b498-9157fffe1b41"}]} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:49:18.009848 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:49:18.009848 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: warnings.warn(msg) Aug 25 05:49:18.015440 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-e23be026-62dc-4d32-a42b-72087d5ce420 req-4f52b078-4d17-4eec-bfdb-9a54679c8b71 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:18.015884 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-e23be026-62dc-4d32-a42b-72087d5ce420 req-4f52b078-4d17-4eec-bfdb-9a54679c8b71 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:18.027695 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.compute.server_external_events [req-e23be026-62dc-4d32-a42b-72087d5ce420 req-4f52b078-4d17-4eec-bfdb-9a54679c8b71 service nova] Creating event network-vif-deleted:605f6633-54d1-4fa5-b498-9157fffe1b41 for instance 4cb635d4-76ba-4143-8f4d-a64c720966da on hv-cinder-78662 Aug 25 05:49:18.032865 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [req-e23be026-62dc-4d32-a42b-72087d5ce420 req-4f52b078-4d17-4eec-bfdb-9a54679c8b71 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030002 Aug 25 05:49:18.033663 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 952/1941] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:49:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:49:18.236302 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-80dd47e1-4664-4a48-b792-ea77124b9d8a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:18.236913 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-80dd47e1-4664-4a48-b792-ea77124b9d8a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:18.243017 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-80dd47e1-4664-4a48-b792-ea77124b9d8a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:18.243463 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-80dd47e1-4664-4a48-b792-ea77124b9d8a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:18.244231 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-80dd47e1-4664-4a48-b792-ea77124b9d8a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:18.244661 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-80dd47e1-4664-4a48-b792-ea77124b9d8a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:18.308662 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-80dd47e1-4664-4a48-b792-ea77124b9d8a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:18.318183 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-80dd47e1-4664-4a48-b792-ea77124b9d8a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:18.319690 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-80dd47e1-4664-4a48-b792-ea77124b9d8a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:18.320829 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-80dd47e1-4664-4a48-b792-ea77124b9d8a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.088465 Aug 25 05:49:18.321380 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 990/1942] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:49:18 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:49:18.644518 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1a3a8761-1878-4e0c-a6fa-f03b36ebe5d4 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:18.647106 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1a3a8761-1878-4e0c-a6fa-f03b36ebe5d4 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:18.654877 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1a3a8761-1878-4e0c-a6fa-f03b36ebe5d4 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:18.655383 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1a3a8761-1878-4e0c-a6fa-f03b36ebe5d4 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:18.656247 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1a3a8761-1878-4e0c-a6fa-f03b36ebe5d4 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:18.656699 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1a3a8761-1878-4e0c-a6fa-f03b36ebe5d4 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:18.740563 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-1a3a8761-1878-4e0c-a6fa-f03b36ebe5d4 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:18.748724 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1a3a8761-1878-4e0c-a6fa-f03b36ebe5d4 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.108482 Aug 25 05:49:18.756532 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 953/1943] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:18 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:19.338555 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f4fd6f41-f1cb-4e7f-8c2e-2caeebc6bafd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:19.339100 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f4fd6f41-f1cb-4e7f-8c2e-2caeebc6bafd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:19.345138 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f4fd6f41-f1cb-4e7f-8c2e-2caeebc6bafd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:19.345579 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f4fd6f41-f1cb-4e7f-8c2e-2caeebc6bafd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:19.346331 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f4fd6f41-f1cb-4e7f-8c2e-2caeebc6bafd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:19.346750 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f4fd6f41-f1cb-4e7f-8c2e-2caeebc6bafd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:19.412197 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-f4fd6f41-f1cb-4e7f-8c2e-2caeebc6bafd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:19.420570 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-f4fd6f41-f1cb-4e7f-8c2e-2caeebc6bafd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:19.422083 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-f4fd6f41-f1cb-4e7f-8c2e-2caeebc6bafd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:19.423196 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f4fd6f41-f1cb-4e7f-8c2e-2caeebc6bafd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.088531 Aug 25 05:49:19.423744 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 991/1944] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:49:19 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:49:19.765739 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ae979773-348c-422d-887c-129383b20939 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:19.766449 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ae979773-348c-422d-887c-129383b20939 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:19.772703 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ae979773-348c-422d-887c-129383b20939 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:19.773409 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ae979773-348c-422d-887c-129383b20939 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:19.774263 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ae979773-348c-422d-887c-129383b20939 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:19.774697 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ae979773-348c-422d-887c-129383b20939 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:19.839670 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ae979773-348c-422d-887c-129383b20939 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:19.847639 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ae979773-348c-422d-887c-129383b20939 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.085564 Aug 25 05:49:19.848235 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 954/1945] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:19 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:20.441479 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-14c56f51-b410-4467-8616-90f182bf83de tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:20.442543 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-14c56f51-b410-4467-8616-90f182bf83de tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:20.448160 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-14c56f51-b410-4467-8616-90f182bf83de tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:20.448664 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-14c56f51-b410-4467-8616-90f182bf83de tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:20.449422 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-14c56f51-b410-4467-8616-90f182bf83de tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:20.449886 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-14c56f51-b410-4467-8616-90f182bf83de tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:20.512595 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-14c56f51-b410-4467-8616-90f182bf83de tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:20.521846 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-14c56f51-b410-4467-8616-90f182bf83de tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:20.523569 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-14c56f51-b410-4467-8616-90f182bf83de tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:20.524714 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-14c56f51-b410-4467-8616-90f182bf83de tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.087010 Aug 25 05:49:20.525270 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 992/1946] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:49:20 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:49:20.865103 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-eeee372b-5df7-4c1d-a035-a0902baa138c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:20.865951 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-eeee372b-5df7-4c1d-a035-a0902baa138c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:20.873042 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-eeee372b-5df7-4c1d-a035-a0902baa138c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:20.873042 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-eeee372b-5df7-4c1d-a035-a0902baa138c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:20.873909 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-eeee372b-5df7-4c1d-a035-a0902baa138c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:20.874682 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-eeee372b-5df7-4c1d-a035-a0902baa138c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:20.939785 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-eeee372b-5df7-4c1d-a035-a0902baa138c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:20.947975 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-eeee372b-5df7-4c1d-a035-a0902baa138c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.087135 Aug 25 05:49:20.948538 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 955/1947] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:20 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:21.543191 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1f24cb15-75e9-4209-8c90-dc9b7008567e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:21.543796 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1f24cb15-75e9-4209-8c90-dc9b7008567e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:21.549756 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1f24cb15-75e9-4209-8c90-dc9b7008567e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:21.550202 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1f24cb15-75e9-4209-8c90-dc9b7008567e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:21.550973 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1f24cb15-75e9-4209-8c90-dc9b7008567e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:21.551609 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1f24cb15-75e9-4209-8c90-dc9b7008567e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:21.613303 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-1f24cb15-75e9-4209-8c90-dc9b7008567e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:21.624367 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-1f24cb15-75e9-4209-8c90-dc9b7008567e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:21.625911 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-1f24cb15-75e9-4209-8c90-dc9b7008567e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:21.627038 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1f24cb15-75e9-4209-8c90-dc9b7008567e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.087608 Aug 25 05:49:21.627595 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 993/1948] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:49:21 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:49:21.964550 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1a841d02-18c6-406f-b58a-ced6fc7c2d95 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:21.965104 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1a841d02-18c6-406f-b58a-ced6fc7c2d95 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:21.970914 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1a841d02-18c6-406f-b58a-ced6fc7c2d95 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:21.971350 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1a841d02-18c6-406f-b58a-ced6fc7c2d95 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:21.972138 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1a841d02-18c6-406f-b58a-ced6fc7c2d95 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:21.972559 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1a841d02-18c6-406f-b58a-ced6fc7c2d95 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:22.032986 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-1a841d02-18c6-406f-b58a-ced6fc7c2d95 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:22.041416 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1a841d02-18c6-406f-b58a-ced6fc7c2d95 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.080563 Aug 25 05:49:22.042056 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 956/1949] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:21 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:22.645748 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-213ffd3e-0b74-44f4-8c2f-8d51a4ba6d3d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:22.646951 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-213ffd3e-0b74-44f4-8c2f-8d51a4ba6d3d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:22.652683 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-213ffd3e-0b74-44f4-8c2f-8d51a4ba6d3d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:22.653120 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-213ffd3e-0b74-44f4-8c2f-8d51a4ba6d3d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:22.653914 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-213ffd3e-0b74-44f4-8c2f-8d51a4ba6d3d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:22.654342 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-213ffd3e-0b74-44f4-8c2f-8d51a4ba6d3d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:22.719702 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-213ffd3e-0b74-44f4-8c2f-8d51a4ba6d3d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:22.729146 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-213ffd3e-0b74-44f4-8c2f-8d51a4ba6d3d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:22.730707 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-213ffd3e-0b74-44f4-8c2f-8d51a4ba6d3d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:22.735871 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-213ffd3e-0b74-44f4-8c2f-8d51a4ba6d3d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.090015 Aug 25 05:49:22.735871 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 994/1950] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:49:22 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:49:23.058276 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b60a68ae-8f5e-4032-9ede-30cd306c6712 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:23.058893 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b60a68ae-8f5e-4032-9ede-30cd306c6712 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:23.064938 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b60a68ae-8f5e-4032-9ede-30cd306c6712 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:23.065382 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b60a68ae-8f5e-4032-9ede-30cd306c6712 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:23.066191 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b60a68ae-8f5e-4032-9ede-30cd306c6712 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:23.066626 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b60a68ae-8f5e-4032-9ede-30cd306c6712 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:23.128078 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-b60a68ae-8f5e-4032-9ede-30cd306c6712 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:23.137114 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b60a68ae-8f5e-4032-9ede-30cd306c6712 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.082535 Aug 25 05:49:23.138668 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 957/1951] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:23 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:23.748846 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6a7b4224-0c1e-45dc-bc6d-cfb628660b5b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:23.749434 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6a7b4224-0c1e-45dc-bc6d-cfb628660b5b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:23.756175 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6a7b4224-0c1e-45dc-bc6d-cfb628660b5b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:23.756635 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6a7b4224-0c1e-45dc-bc6d-cfb628660b5b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:23.757404 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6a7b4224-0c1e-45dc-bc6d-cfb628660b5b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:23.757874 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6a7b4224-0c1e-45dc-bc6d-cfb628660b5b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:23.819338 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-6a7b4224-0c1e-45dc-bc6d-cfb628660b5b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:23.827535 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-6a7b4224-0c1e-45dc-bc6d-cfb628660b5b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:23.828992 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-6a7b4224-0c1e-45dc-bc6d-cfb628660b5b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:23.830161 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6a7b4224-0c1e-45dc-bc6d-cfb628660b5b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.085116 Aug 25 05:49:23.830714 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 995/1952] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:49:23 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:49:24.154260 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6d0fbded-9dcd-43b2-ab97-ceceb6549a7d tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:24.154818 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6d0fbded-9dcd-43b2-ab97-ceceb6549a7d tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:24.161193 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6d0fbded-9dcd-43b2-ab97-ceceb6549a7d tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:24.161762 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6d0fbded-9dcd-43b2-ab97-ceceb6549a7d tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:24.162597 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6d0fbded-9dcd-43b2-ab97-ceceb6549a7d tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:24.163024 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6d0fbded-9dcd-43b2-ab97-ceceb6549a7d tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:24.222616 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6d0fbded-9dcd-43b2-ab97-ceceb6549a7d tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:24.230780 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6d0fbded-9dcd-43b2-ab97-ceceb6549a7d tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.080314 Aug 25 05:49:24.231341 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 958/1953] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:24 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:24.848731 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6d2a80a6-9ccb-41c2-bb37-18874b68d5c3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:24.849292 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6d2a80a6-9ccb-41c2-bb37-18874b68d5c3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:24.855190 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6d2a80a6-9ccb-41c2-bb37-18874b68d5c3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:24.855618 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6d2a80a6-9ccb-41c2-bb37-18874b68d5c3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:24.856396 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6d2a80a6-9ccb-41c2-bb37-18874b68d5c3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:24.856809 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6d2a80a6-9ccb-41c2-bb37-18874b68d5c3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:24.926980 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-6d2a80a6-9ccb-41c2-bb37-18874b68d5c3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:24.935595 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-6d2a80a6-9ccb-41c2-bb37-18874b68d5c3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:24.937081 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-6d2a80a6-9ccb-41c2-bb37-18874b68d5c3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:24.938229 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6d2a80a6-9ccb-41c2-bb37-18874b68d5c3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.093968 Aug 25 05:49:24.938781 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 996/1954] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:49:24 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:49:25.247448 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-42362276-b987-40a6-a7bf-3d8011b31601 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:25.248003 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-42362276-b987-40a6-a7bf-3d8011b31601 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:25.257017 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-42362276-b987-40a6-a7bf-3d8011b31601 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:25.257487 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-42362276-b987-40a6-a7bf-3d8011b31601 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:25.258295 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-42362276-b987-40a6-a7bf-3d8011b31601 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:25.258736 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-42362276-b987-40a6-a7bf-3d8011b31601 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:25.320869 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-42362276-b987-40a6-a7bf-3d8011b31601 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:25.328889 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-42362276-b987-40a6-a7bf-3d8011b31601 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.085194 Aug 25 05:49:25.329453 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 959/1955] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:25 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:25.956551 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-bb0f45c3-bc08-4e5d-9a59-0cf880e7d1ed tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:25.957084 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-bb0f45c3-bc08-4e5d-9a59-0cf880e7d1ed tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:25.963121 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bb0f45c3-bc08-4e5d-9a59-0cf880e7d1ed tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:25.963563 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bb0f45c3-bc08-4e5d-9a59-0cf880e7d1ed tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:25.964328 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bb0f45c3-bc08-4e5d-9a59-0cf880e7d1ed tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:25.964763 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bb0f45c3-bc08-4e5d-9a59-0cf880e7d1ed tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:26.028801 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-bb0f45c3-bc08-4e5d-9a59-0cf880e7d1ed tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:26.037609 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-bb0f45c3-bc08-4e5d-9a59-0cf880e7d1ed tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:26.039154 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-bb0f45c3-bc08-4e5d-9a59-0cf880e7d1ed tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:26.040272 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-bb0f45c3-bc08-4e5d-9a59-0cf880e7d1ed tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.087518 Aug 25 05:49:26.040842 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 997/1956] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:49:25 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:49:26.345569 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1a77d6f5-9c9d-4481-9967-2214adcaf0b9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:26.346164 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1a77d6f5-9c9d-4481-9967-2214adcaf0b9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:26.352990 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1a77d6f5-9c9d-4481-9967-2214adcaf0b9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:26.353488 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1a77d6f5-9c9d-4481-9967-2214adcaf0b9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:26.354269 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1a77d6f5-9c9d-4481-9967-2214adcaf0b9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:26.354701 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1a77d6f5-9c9d-4481-9967-2214adcaf0b9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:26.415711 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-1a77d6f5-9c9d-4481-9967-2214adcaf0b9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:26.423477 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1a77d6f5-9c9d-4481-9967-2214adcaf0b9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.081630 Aug 25 05:49:26.424029 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 960/1957] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:26 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:27.058316 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-92007f00-fe7c-4630-81f2-99735bd9e950 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:27.058999 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-92007f00-fe7c-4630-81f2-99735bd9e950 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:27.064732 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-92007f00-fe7c-4630-81f2-99735bd9e950 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:27.065171 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-92007f00-fe7c-4630-81f2-99735bd9e950 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:27.065965 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-92007f00-fe7c-4630-81f2-99735bd9e950 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:27.066393 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-92007f00-fe7c-4630-81f2-99735bd9e950 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:27.127590 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-92007f00-fe7c-4630-81f2-99735bd9e950 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:27.136286 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-92007f00-fe7c-4630-81f2-99735bd9e950 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:27.137786 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-92007f00-fe7c-4630-81f2-99735bd9e950 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:27.138902 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-92007f00-fe7c-4630-81f2-99735bd9e950 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.084453 Aug 25 05:49:27.139467 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 998/1958] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:49:27 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:49:27.440889 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-88ff14d6-c56d-447c-a4c6-1e20c13cc627 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:27.441453 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-88ff14d6-c56d-447c-a4c6-1e20c13cc627 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:27.448077 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-88ff14d6-c56d-447c-a4c6-1e20c13cc627 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:27.448515 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-88ff14d6-c56d-447c-a4c6-1e20c13cc627 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:27.449268 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-88ff14d6-c56d-447c-a4c6-1e20c13cc627 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:27.449727 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-88ff14d6-c56d-447c-a4c6-1e20c13cc627 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:27.510137 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-88ff14d6-c56d-447c-a4c6-1e20c13cc627 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:27.517904 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-88ff14d6-c56d-447c-a4c6-1e20c13cc627 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.080843 Aug 25 05:49:27.518477 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 961/1959] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:27 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:28.156776 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-be79af72-c45c-484e-ace7-757b6fd20751 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:28.157406 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-be79af72-c45c-484e-ace7-757b6fd20751 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:28.163688 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-be79af72-c45c-484e-ace7-757b6fd20751 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:28.164133 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-be79af72-c45c-484e-ace7-757b6fd20751 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:28.165024 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-be79af72-c45c-484e-ace7-757b6fd20751 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:28.165462 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-be79af72-c45c-484e-ace7-757b6fd20751 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:28.226810 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-be79af72-c45c-484e-ace7-757b6fd20751 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:28.235099 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-be79af72-c45c-484e-ace7-757b6fd20751 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:28.236563 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-be79af72-c45c-484e-ace7-757b6fd20751 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:28.237705 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-be79af72-c45c-484e-ace7-757b6fd20751 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.084637 Aug 25 05:49:28.238263 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 999/1960] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:49:28 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:49:28.387856 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 05:49:28.388112 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: Wed Aug 25 05:49:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 05:49:28.535354 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-56cb437b-2baf-495b-abcf-a06b69427ec1 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:28.536930 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-56cb437b-2baf-495b-abcf-a06b69427ec1 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:28.542679 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-56cb437b-2baf-495b-abcf-a06b69427ec1 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:28.543131 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-56cb437b-2baf-495b-abcf-a06b69427ec1 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:28.543951 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-56cb437b-2baf-495b-abcf-a06b69427ec1 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:28.544399 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-56cb437b-2baf-495b-abcf-a06b69427ec1 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:28.607903 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-56cb437b-2baf-495b-abcf-a06b69427ec1 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:28.616275 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-56cb437b-2baf-495b-abcf-a06b69427ec1 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.084561 Aug 25 05:49:28.616836 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 962/1961] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:28 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:29.256796 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2dcf5a46-8648-4b1f-95ea-223479c90707 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:29.257411 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2dcf5a46-8648-4b1f-95ea-223479c90707 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:29.263292 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2dcf5a46-8648-4b1f-95ea-223479c90707 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:29.263732 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2dcf5a46-8648-4b1f-95ea-223479c90707 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:29.264494 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2dcf5a46-8648-4b1f-95ea-223479c90707 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:29.264919 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2dcf5a46-8648-4b1f-95ea-223479c90707 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:29.329229 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-2dcf5a46-8648-4b1f-95ea-223479c90707 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:29.337861 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-2dcf5a46-8648-4b1f-95ea-223479c90707 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:29.339637 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-2dcf5a46-8648-4b1f-95ea-223479c90707 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:29.340488 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2dcf5a46-8648-4b1f-95ea-223479c90707 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.087841 Aug 25 05:49:29.341027 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1000/1962] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:49:29 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:49:29.632842 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-2ad2663e-5b42-45ee-b461-8e9dad804e74 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:29.633490 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-2ad2663e-5b42-45ee-b461-8e9dad804e74 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:29.639788 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2ad2663e-5b42-45ee-b461-8e9dad804e74 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:29.640223 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2ad2663e-5b42-45ee-b461-8e9dad804e74 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:29.640975 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2ad2663e-5b42-45ee-b461-8e9dad804e74 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:29.641399 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2ad2663e-5b42-45ee-b461-8e9dad804e74 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:29.701605 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-2ad2663e-5b42-45ee-b461-8e9dad804e74 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:29.709331 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-2ad2663e-5b42-45ee-b461-8e9dad804e74 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.080840 Aug 25 05:49:29.709966 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 963/1963] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:29 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:30.359276 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-65396ee6-59e1-4ee5-9a87-1f061d76798e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:30.359966 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-65396ee6-59e1-4ee5-9a87-1f061d76798e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:30.365693 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-65396ee6-59e1-4ee5-9a87-1f061d76798e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:30.366303 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-65396ee6-59e1-4ee5-9a87-1f061d76798e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:30.367236 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-65396ee6-59e1-4ee5-9a87-1f061d76798e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:30.367665 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-65396ee6-59e1-4ee5-9a87-1f061d76798e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:30.430055 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-65396ee6-59e1-4ee5-9a87-1f061d76798e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:30.438362 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-65396ee6-59e1-4ee5-9a87-1f061d76798e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:30.439853 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-65396ee6-59e1-4ee5-9a87-1f061d76798e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:30.441020 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-65396ee6-59e1-4ee5-9a87-1f061d76798e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.085448 Aug 25 05:49:30.441581 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1001/1964] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:49:30 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:49:30.726751 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3d237e8a-9d25-4023-992a-167b48739201 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:30.727294 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3d237e8a-9d25-4023-992a-167b48739201 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:30.733201 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3d237e8a-9d25-4023-992a-167b48739201 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:30.733681 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3d237e8a-9d25-4023-992a-167b48739201 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:30.734440 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3d237e8a-9d25-4023-992a-167b48739201 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:30.734872 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3d237e8a-9d25-4023-992a-167b48739201 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:30.795888 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-3d237e8a-9d25-4023-992a-167b48739201 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:30.804004 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3d237e8a-9d25-4023-992a-167b48739201 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.081325 Aug 25 05:49:30.804588 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 964/1965] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:30 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:31.458160 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b630be90-a632-4f7c-9a9c-3189f3c20c61 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:31.458779 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b630be90-a632-4f7c-9a9c-3189f3c20c61 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:31.464769 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b630be90-a632-4f7c-9a9c-3189f3c20c61 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:31.465764 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b630be90-a632-4f7c-9a9c-3189f3c20c61 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:31.466638 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b630be90-a632-4f7c-9a9c-3189f3c20c61 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:31.466990 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b630be90-a632-4f7c-9a9c-3189f3c20c61 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:31.527216 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-b630be90-a632-4f7c-9a9c-3189f3c20c61 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:31.536527 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-b630be90-a632-4f7c-9a9c-3189f3c20c61 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:31.537693 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-b630be90-a632-4f7c-9a9c-3189f3c20c61 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:31.539484 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b630be90-a632-4f7c-9a9c-3189f3c20c61 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.084980 Aug 25 05:49:31.540035 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1002/1966] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:49:31 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:49:31.821048 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-534e01f3-566c-4e76-b16d-4cf2ee45d19d tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:31.821692 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-534e01f3-566c-4e76-b16d-4cf2ee45d19d tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:31.827594 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-534e01f3-566c-4e76-b16d-4cf2ee45d19d tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:31.828041 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-534e01f3-566c-4e76-b16d-4cf2ee45d19d tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:31.828802 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-534e01f3-566c-4e76-b16d-4cf2ee45d19d tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:31.829237 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-534e01f3-566c-4e76-b16d-4cf2ee45d19d tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:31.889070 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-534e01f3-566c-4e76-b16d-4cf2ee45d19d tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:31.896726 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-534e01f3-566c-4e76-b16d-4cf2ee45d19d tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.080045 Aug 25 05:49:31.897369 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 965/1967] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:31 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:32.557041 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2d78371d-5d8b-49c7-ab8a-923644524559 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:32.557668 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2d78371d-5d8b-49c7-ab8a-923644524559 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:32.563721 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2d78371d-5d8b-49c7-ab8a-923644524559 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:32.564166 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2d78371d-5d8b-49c7-ab8a-923644524559 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:32.564930 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2d78371d-5d8b-49c7-ab8a-923644524559 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:32.565360 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2d78371d-5d8b-49c7-ab8a-923644524559 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:32.636340 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-2d78371d-5d8b-49c7-ab8a-923644524559 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:32.646450 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-2d78371d-5d8b-49c7-ab8a-923644524559 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:32.648864 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-2d78371d-5d8b-49c7-ab8a-923644524559 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:32.650034 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2d78371d-5d8b-49c7-ab8a-923644524559 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.096871 Aug 25 05:49:32.650586 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1003/1968] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:49:32 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:49:32.914144 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-631ddac9-f86e-4c83-b6f6-329624c9a3ea tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:32.914676 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-631ddac9-f86e-4c83-b6f6-329624c9a3ea tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:32.923862 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-631ddac9-f86e-4c83-b6f6-329624c9a3ea tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:32.923862 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-631ddac9-f86e-4c83-b6f6-329624c9a3ea tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:32.923862 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-631ddac9-f86e-4c83-b6f6-329624c9a3ea tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:32.923862 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-631ddac9-f86e-4c83-b6f6-329624c9a3ea tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:32.987372 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-631ddac9-f86e-4c83-b6f6-329624c9a3ea tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:32.998080 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-631ddac9-f86e-4c83-b6f6-329624c9a3ea tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.087829 Aug 25 05:49:33.009158 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 966/1969] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:32 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:33.668936 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-dead01bf-b709-4147-a264-6a3d43f90b16 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:33.669550 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-dead01bf-b709-4147-a264-6a3d43f90b16 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:33.675370 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-dead01bf-b709-4147-a264-6a3d43f90b16 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:33.675817 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-dead01bf-b709-4147-a264-6a3d43f90b16 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:33.676603 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-dead01bf-b709-4147-a264-6a3d43f90b16 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:33.677133 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-dead01bf-b709-4147-a264-6a3d43f90b16 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:33.737745 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-dead01bf-b709-4147-a264-6a3d43f90b16 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:33.746976 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-dead01bf-b709-4147-a264-6a3d43f90b16 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:33.748454 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-dead01bf-b709-4147-a264-6a3d43f90b16 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:33.749597 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-dead01bf-b709-4147-a264-6a3d43f90b16 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.084398 Aug 25 05:49:33.750148 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1004/1970] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:49:33 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:49:34.015823 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3fdfddad-5940-469f-9811-5b87e3cd1dfb tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:34.016375 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3fdfddad-5940-469f-9811-5b87e3cd1dfb tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:34.023019 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3fdfddad-5940-469f-9811-5b87e3cd1dfb tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:34.023741 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3fdfddad-5940-469f-9811-5b87e3cd1dfb tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:34.024561 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3fdfddad-5940-469f-9811-5b87e3cd1dfb tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:34.025138 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3fdfddad-5940-469f-9811-5b87e3cd1dfb tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:34.085169 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-3fdfddad-5940-469f-9811-5b87e3cd1dfb tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:34.093134 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3fdfddad-5940-469f-9811-5b87e3cd1dfb tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.081218 Aug 25 05:49:34.093759 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 967/1971] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:34 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:49:34.768115 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a88e6369-3055-40ee-8c39-cd18ff1ac8f3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:34.769103 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a88e6369-3055-40ee-8c39-cd18ff1ac8f3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:34.776783 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a88e6369-3055-40ee-8c39-cd18ff1ac8f3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:34.777237 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a88e6369-3055-40ee-8c39-cd18ff1ac8f3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:34.778066 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a88e6369-3055-40ee-8c39-cd18ff1ac8f3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:34.778653 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a88e6369-3055-40ee-8c39-cd18ff1ac8f3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:34.841514 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-a88e6369-3055-40ee-8c39-cd18ff1ac8f3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:34.849740 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-a88e6369-3055-40ee-8c39-cd18ff1ac8f3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:34.853220 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-a88e6369-3055-40ee-8c39-cd18ff1ac8f3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:34.853388 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a88e6369-3055-40ee-8c39-cd18ff1ac8f3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.089130 Aug 25 05:49:34.853832 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1005/1972] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:49:34 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:49:35.110700 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-42dcbbcc-dd02-40c8-970c-0885c8bf1fd4 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:35.111272 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-42dcbbcc-dd02-40c8-970c-0885c8bf1fd4 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:35.117784 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-42dcbbcc-dd02-40c8-970c-0885c8bf1fd4 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:35.118222 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-42dcbbcc-dd02-40c8-970c-0885c8bf1fd4 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:35.118987 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-42dcbbcc-dd02-40c8-970c-0885c8bf1fd4 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:35.119415 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-42dcbbcc-dd02-40c8-970c-0885c8bf1fd4 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:35.179271 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-42dcbbcc-dd02-40c8-970c-0885c8bf1fd4 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:35.187022 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-42dcbbcc-dd02-40c8-970c-0885c8bf1fd4 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.080205 Aug 25 05:49:35.187593 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 968/1973] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:35 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:35.871341 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1089106c-f21a-4f43-aaba-bf2421c82660 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:35.871998 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1089106c-f21a-4f43-aaba-bf2421c82660 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:35.877957 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1089106c-f21a-4f43-aaba-bf2421c82660 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:35.878404 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1089106c-f21a-4f43-aaba-bf2421c82660 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:35.879170 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1089106c-f21a-4f43-aaba-bf2421c82660 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:35.879604 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1089106c-f21a-4f43-aaba-bf2421c82660 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:35.944449 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-1089106c-f21a-4f43-aaba-bf2421c82660 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:35.953227 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-1089106c-f21a-4f43-aaba-bf2421c82660 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:35.954743 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-1089106c-f21a-4f43-aaba-bf2421c82660 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:35.955855 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1089106c-f21a-4f43-aaba-bf2421c82660 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.088391 Aug 25 05:49:35.956411 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1006/1974] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:49:35 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:49:36.204384 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7d49edfa-5884-42ec-87d8-d76dde2f7bff tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:36.204993 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7d49edfa-5884-42ec-87d8-d76dde2f7bff tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:36.211375 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7d49edfa-5884-42ec-87d8-d76dde2f7bff tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:36.211828 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7d49edfa-5884-42ec-87d8-d76dde2f7bff tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:36.212600 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7d49edfa-5884-42ec-87d8-d76dde2f7bff tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:36.213031 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7d49edfa-5884-42ec-87d8-d76dde2f7bff tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:36.272578 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-7d49edfa-5884-42ec-87d8-d76dde2f7bff tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:36.281105 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7d49edfa-5884-42ec-87d8-d76dde2f7bff tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.080624 Aug 25 05:49:36.281692 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 969/1975] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:36 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:36.974962 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2d34f5eb-2b50-4342-9ba7-50c190dcc961 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:36.976666 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2d34f5eb-2b50-4342-9ba7-50c190dcc961 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:36.982497 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2d34f5eb-2b50-4342-9ba7-50c190dcc961 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:36.982935 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2d34f5eb-2b50-4342-9ba7-50c190dcc961 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:36.983689 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2d34f5eb-2b50-4342-9ba7-50c190dcc961 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:36.984113 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2d34f5eb-2b50-4342-9ba7-50c190dcc961 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:37.044795 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-2d34f5eb-2b50-4342-9ba7-50c190dcc961 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:37.052949 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-2d34f5eb-2b50-4342-9ba7-50c190dcc961 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:37.054654 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-2d34f5eb-2b50-4342-9ba7-50c190dcc961 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:37.055788 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2d34f5eb-2b50-4342-9ba7-50c190dcc961 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.084728 Aug 25 05:49:37.056311 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1007/1976] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:49:36 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:49:37.299097 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e28df1e2-4ca5-4e59-97f0-fd63b05fec18 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:37.299708 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e28df1e2-4ca5-4e59-97f0-fd63b05fec18 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:37.305765 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e28df1e2-4ca5-4e59-97f0-fd63b05fec18 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:37.306207 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e28df1e2-4ca5-4e59-97f0-fd63b05fec18 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:37.306961 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e28df1e2-4ca5-4e59-97f0-fd63b05fec18 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:37.307393 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e28df1e2-4ca5-4e59-97f0-fd63b05fec18 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:37.367480 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e28df1e2-4ca5-4e59-97f0-fd63b05fec18 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:37.375545 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e28df1e2-4ca5-4e59-97f0-fd63b05fec18 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.080141 Aug 25 05:49:37.376100 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 970/1977] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:37 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:38.074152 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a21b073f-9267-41bc-8304-1e8108605f0b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:38.074845 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a21b073f-9267-41bc-8304-1e8108605f0b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:38.080535 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a21b073f-9267-41bc-8304-1e8108605f0b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:38.081000 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a21b073f-9267-41bc-8304-1e8108605f0b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:38.081789 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a21b073f-9267-41bc-8304-1e8108605f0b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:38.082221 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a21b073f-9267-41bc-8304-1e8108605f0b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:38.142433 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-a21b073f-9267-41bc-8304-1e8108605f0b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:38.151082 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-a21b073f-9267-41bc-8304-1e8108605f0b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:38.152569 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-a21b073f-9267-41bc-8304-1e8108605f0b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:38.153783 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a21b073f-9267-41bc-8304-1e8108605f0b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.083908 Aug 25 05:49:38.154338 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1008/1978] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:49:38 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:49:38.392756 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1fa091c4-80c3-4bb5-bd91-57217b591c4a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:38.393285 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1fa091c4-80c3-4bb5-bd91-57217b591c4a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:38.400393 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1fa091c4-80c3-4bb5-bd91-57217b591c4a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:38.400870 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1fa091c4-80c3-4bb5-bd91-57217b591c4a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:38.401673 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1fa091c4-80c3-4bb5-bd91-57217b591c4a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:38.402101 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1fa091c4-80c3-4bb5-bd91-57217b591c4a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:38.465473 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-1fa091c4-80c3-4bb5-bd91-57217b591c4a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:38.473312 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1fa091c4-80c3-4bb5-bd91-57217b591c4a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.084345 Aug 25 05:49:38.473905 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 971/1979] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:38 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:39.172827 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7915abc3-8b88-4f62-aef4-1be624cefd78 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:39.173429 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-7915abc3-8b88-4f62-aef4-1be624cefd78 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:39.181116 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7915abc3-8b88-4f62-aef4-1be624cefd78 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:39.181626 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7915abc3-8b88-4f62-aef4-1be624cefd78 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:39.183005 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7915abc3-8b88-4f62-aef4-1be624cefd78 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:39.183729 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7915abc3-8b88-4f62-aef4-1be624cefd78 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:39.257190 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-7915abc3-8b88-4f62-aef4-1be624cefd78 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:39.275253 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-7915abc3-8b88-4f62-aef4-1be624cefd78 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:39.276743 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-7915abc3-8b88-4f62-aef4-1be624cefd78 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:39.277926 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-7915abc3-8b88-4f62-aef4-1be624cefd78 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.109416 Aug 25 05:49:39.278484 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1009/1980] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:49:39 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:49:39.490794 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-0dcb7195-031a-4393-9978-8df349922dc7 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:39.491640 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-0dcb7195-031a-4393-9978-8df349922dc7 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:39.498732 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0dcb7195-031a-4393-9978-8df349922dc7 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:39.499170 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0dcb7195-031a-4393-9978-8df349922dc7 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:39.499930 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0dcb7195-031a-4393-9978-8df349922dc7 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:39.500351 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0dcb7195-031a-4393-9978-8df349922dc7 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:39.567158 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-0dcb7195-031a-4393-9978-8df349922dc7 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:39.574914 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-0dcb7195-031a-4393-9978-8df349922dc7 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.088023 Aug 25 05:49:39.575472 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 972/1981] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:39 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:49:40.296952 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e1b561dd-6f00-4ca6-bb9d-b46c84b1d273 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:40.297624 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e1b561dd-6f00-4ca6-bb9d-b46c84b1d273 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:40.303400 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e1b561dd-6f00-4ca6-bb9d-b46c84b1d273 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:40.303844 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e1b561dd-6f00-4ca6-bb9d-b46c84b1d273 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:40.304945 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e1b561dd-6f00-4ca6-bb9d-b46c84b1d273 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:40.305538 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e1b561dd-6f00-4ca6-bb9d-b46c84b1d273 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:40.371384 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-e1b561dd-6f00-4ca6-bb9d-b46c84b1d273 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:40.379730 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-e1b561dd-6f00-4ca6-bb9d-b46c84b1d273 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:40.381219 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-e1b561dd-6f00-4ca6-bb9d-b46c84b1d273 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:40.382377 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e1b561dd-6f00-4ca6-bb9d-b46c84b1d273 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.089168 Aug 25 05:49:40.383422 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1010/1982] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:49:40 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:49:40.592217 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6b75c992-54fb-4e1b-ae47-efd357266727 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:40.592870 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6b75c992-54fb-4e1b-ae47-efd357266727 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:40.598698 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6b75c992-54fb-4e1b-ae47-efd357266727 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:40.599134 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6b75c992-54fb-4e1b-ae47-efd357266727 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:40.599885 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6b75c992-54fb-4e1b-ae47-efd357266727 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:40.600324 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6b75c992-54fb-4e1b-ae47-efd357266727 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:40.660021 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6b75c992-54fb-4e1b-ae47-efd357266727 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:40.668059 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6b75c992-54fb-4e1b-ae47-efd357266727 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.079529 Aug 25 05:49:40.668643 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 973/1983] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:40 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:41.401357 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e35384f6-a9b9-410e-8243-e68700ba420d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:41.401993 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e35384f6-a9b9-410e-8243-e68700ba420d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:41.408733 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e35384f6-a9b9-410e-8243-e68700ba420d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:41.409172 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e35384f6-a9b9-410e-8243-e68700ba420d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:41.409987 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e35384f6-a9b9-410e-8243-e68700ba420d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:41.410413 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e35384f6-a9b9-410e-8243-e68700ba420d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:41.469515 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-e35384f6-a9b9-410e-8243-e68700ba420d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:41.479112 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-e35384f6-a9b9-410e-8243-e68700ba420d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:41.480631 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-e35384f6-a9b9-410e-8243-e68700ba420d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:41.481840 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e35384f6-a9b9-410e-8243-e68700ba420d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.084912 Aug 25 05:49:41.482383 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1011/1984] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:49:41 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:49:41.684381 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-786c8aaa-d554-44a8-8ab3-30945863d623 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:41.684948 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-786c8aaa-d554-44a8-8ab3-30945863d623 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:41.691405 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-786c8aaa-d554-44a8-8ab3-30945863d623 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:41.691405 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-786c8aaa-d554-44a8-8ab3-30945863d623 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:41.692194 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-786c8aaa-d554-44a8-8ab3-30945863d623 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:41.692601 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-786c8aaa-d554-44a8-8ab3-30945863d623 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:41.753081 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-786c8aaa-d554-44a8-8ab3-30945863d623 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:41.761705 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-786c8aaa-d554-44a8-8ab3-30945863d623 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.081016 Aug 25 05:49:41.762271 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 974/1985] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:41 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:42.499589 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6244653e-12b3-4c7a-9da0-933cdcdfb5e6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:42.500216 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6244653e-12b3-4c7a-9da0-933cdcdfb5e6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:42.506121 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6244653e-12b3-4c7a-9da0-933cdcdfb5e6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:42.506556 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6244653e-12b3-4c7a-9da0-933cdcdfb5e6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:42.507302 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6244653e-12b3-4c7a-9da0-933cdcdfb5e6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:42.508337 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6244653e-12b3-4c7a-9da0-933cdcdfb5e6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:42.571822 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-6244653e-12b3-4c7a-9da0-933cdcdfb5e6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:42.579976 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-6244653e-12b3-4c7a-9da0-933cdcdfb5e6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:42.581439 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-6244653e-12b3-4c7a-9da0-933cdcdfb5e6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:42.582580 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6244653e-12b3-4c7a-9da0-933cdcdfb5e6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.086732 Aug 25 05:49:42.583115 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1012/1986] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:49:42 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:49:42.778972 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c1d71b65-4aaf-4067-b3e9-31de02b477db tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:42.779533 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c1d71b65-4aaf-4067-b3e9-31de02b477db tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:42.785436 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c1d71b65-4aaf-4067-b3e9-31de02b477db tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:42.785919 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c1d71b65-4aaf-4067-b3e9-31de02b477db tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:42.786682 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c1d71b65-4aaf-4067-b3e9-31de02b477db tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:42.787117 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c1d71b65-4aaf-4067-b3e9-31de02b477db tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:42.847403 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-c1d71b65-4aaf-4067-b3e9-31de02b477db tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:42.855795 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c1d71b65-4aaf-4067-b3e9-31de02b477db tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.080619 Aug 25 05:49:42.856347 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 975/1987] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:42 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:43.600733 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7989aad1-53e0-476a-93f9-f703b4655a79 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:43.601364 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-7989aad1-53e0-476a-93f9-f703b4655a79 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:43.607821 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7989aad1-53e0-476a-93f9-f703b4655a79 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:43.608263 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7989aad1-53e0-476a-93f9-f703b4655a79 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:43.609043 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7989aad1-53e0-476a-93f9-f703b4655a79 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:43.609470 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7989aad1-53e0-476a-93f9-f703b4655a79 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:43.672645 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-7989aad1-53e0-476a-93f9-f703b4655a79 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:43.681637 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-7989aad1-53e0-476a-93f9-f703b4655a79 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:43.683323 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-7989aad1-53e0-476a-93f9-f703b4655a79 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:43.684467 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-7989aad1-53e0-476a-93f9-f703b4655a79 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.087592 Aug 25 05:49:43.685019 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1013/1988] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:49:43 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:49:43.873123 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ab1e68c0-427d-4edd-9188-eb7081eb2a38 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:43.873686 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ab1e68c0-427d-4edd-9188-eb7081eb2a38 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:43.879679 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ab1e68c0-427d-4edd-9188-eb7081eb2a38 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:43.880127 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ab1e68c0-427d-4edd-9188-eb7081eb2a38 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:43.880897 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ab1e68c0-427d-4edd-9188-eb7081eb2a38 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:43.881325 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ab1e68c0-427d-4edd-9188-eb7081eb2a38 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:43.943008 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ab1e68c0-427d-4edd-9188-eb7081eb2a38 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:43.952193 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ab1e68c0-427d-4edd-9188-eb7081eb2a38 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.082895 Aug 25 05:49:43.952773 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 976/1989] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:43 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:44.702250 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-530c6855-f463-4a04-9276-dd67c2e8f110 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:44.702851 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-530c6855-f463-4a04-9276-dd67c2e8f110 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:44.708929 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-530c6855-f463-4a04-9276-dd67c2e8f110 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:44.709365 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-530c6855-f463-4a04-9276-dd67c2e8f110 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:44.710160 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-530c6855-f463-4a04-9276-dd67c2e8f110 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:44.710585 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-530c6855-f463-4a04-9276-dd67c2e8f110 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:44.771660 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-530c6855-f463-4a04-9276-dd67c2e8f110 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:44.781115 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-530c6855-f463-4a04-9276-dd67c2e8f110 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:44.782613 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-530c6855-f463-4a04-9276-dd67c2e8f110 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:44.783752 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-530c6855-f463-4a04-9276-dd67c2e8f110 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.085180 Aug 25 05:49:44.784295 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1014/1990] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:49:44 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:49:44.969182 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-32e85d3d-a6b9-49e6-a128-b2e4ce3b1e97 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:44.969760 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-32e85d3d-a6b9-49e6-a128-b2e4ce3b1e97 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:44.975567 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-32e85d3d-a6b9-49e6-a128-b2e4ce3b1e97 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:44.976003 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-32e85d3d-a6b9-49e6-a128-b2e4ce3b1e97 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:44.976770 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-32e85d3d-a6b9-49e6-a128-b2e4ce3b1e97 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:44.977194 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-32e85d3d-a6b9-49e6-a128-b2e4ce3b1e97 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:45.037339 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-32e85d3d-a6b9-49e6-a128-b2e4ce3b1e97 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:45.045780 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-32e85d3d-a6b9-49e6-a128-b2e4ce3b1e97 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.080393 Aug 25 05:49:45.046349 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 977/1991] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:44 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:45.801867 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ade07562-749c-422b-ad80-ceac321a6f2a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:45.802403 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ade07562-749c-422b-ad80-ceac321a6f2a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:45.809147 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ade07562-749c-422b-ad80-ceac321a6f2a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:45.809606 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ade07562-749c-422b-ad80-ceac321a6f2a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:45.810361 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ade07562-749c-422b-ad80-ceac321a6f2a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:45.810787 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ade07562-749c-422b-ad80-ceac321a6f2a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:45.873984 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ade07562-749c-422b-ad80-ceac321a6f2a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:45.882648 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ade07562-749c-422b-ad80-ceac321a6f2a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:45.883716 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ade07562-749c-422b-ad80-ceac321a6f2a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:45.884941 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ade07562-749c-422b-ad80-ceac321a6f2a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.086902 Aug 25 05:49:45.885486 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1015/1992] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:49:45 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:49:46.062417 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-48165079-de9b-4134-bf13-85f61671eee4 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:46.062963 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-48165079-de9b-4134-bf13-85f61671eee4 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:46.068733 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-48165079-de9b-4134-bf13-85f61671eee4 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:46.069177 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-48165079-de9b-4134-bf13-85f61671eee4 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:46.069967 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-48165079-de9b-4134-bf13-85f61671eee4 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:46.070409 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-48165079-de9b-4134-bf13-85f61671eee4 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:46.129932 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-48165079-de9b-4134-bf13-85f61671eee4 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:46.137939 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-48165079-de9b-4134-bf13-85f61671eee4 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.079221 Aug 25 05:49:46.138496 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 978/1993] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:46 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:46.903063 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b3805b49-6f0b-42b3-bc76-cfd728656273 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:46.903639 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b3805b49-6f0b-42b3-bc76-cfd728656273 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:46.909376 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b3805b49-6f0b-42b3-bc76-cfd728656273 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:46.909839 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b3805b49-6f0b-42b3-bc76-cfd728656273 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:46.910583 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b3805b49-6f0b-42b3-bc76-cfd728656273 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:46.911005 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b3805b49-6f0b-42b3-bc76-cfd728656273 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:46.972423 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-b3805b49-6f0b-42b3-bc76-cfd728656273 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:46.981471 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-b3805b49-6f0b-42b3-bc76-cfd728656273 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:46.983074 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-b3805b49-6f0b-42b3-bc76-cfd728656273 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:46.984207 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b3805b49-6f0b-42b3-bc76-cfd728656273 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.084981 Aug 25 05:49:46.984765 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1016/1994] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:49:46 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:49:47.155081 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c2cd187f-f371-4f21-b7d5-3b8696c20351 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:47.155608 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c2cd187f-f371-4f21-b7d5-3b8696c20351 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:47.161463 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c2cd187f-f371-4f21-b7d5-3b8696c20351 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:47.161929 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c2cd187f-f371-4f21-b7d5-3b8696c20351 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:47.162679 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c2cd187f-f371-4f21-b7d5-3b8696c20351 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:47.163107 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c2cd187f-f371-4f21-b7d5-3b8696c20351 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:47.222243 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-c2cd187f-f371-4f21-b7d5-3b8696c20351 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:47.230599 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c2cd187f-f371-4f21-b7d5-3b8696c20351 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.079256 Aug 25 05:49:47.231060 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 979/1995] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:47 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:48.002675 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ba7cb11d-2908-4bfd-82b5-97c31f67ce24 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:48.003525 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ba7cb11d-2908-4bfd-82b5-97c31f67ce24 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:48.014950 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ba7cb11d-2908-4bfd-82b5-97c31f67ce24 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:48.015399 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ba7cb11d-2908-4bfd-82b5-97c31f67ce24 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:48.016222 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ba7cb11d-2908-4bfd-82b5-97c31f67ce24 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:48.016748 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ba7cb11d-2908-4bfd-82b5-97c31f67ce24 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:48.080165 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ba7cb11d-2908-4bfd-82b5-97c31f67ce24 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:48.088599 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ba7cb11d-2908-4bfd-82b5-97c31f67ce24 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:48.090152 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ba7cb11d-2908-4bfd-82b5-97c31f67ce24 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:48.091296 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ba7cb11d-2908-4bfd-82b5-97c31f67ce24 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.093721 Aug 25 05:49:48.091856 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1017/1996] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:49:47 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:49:48.248121 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-165e80c9-dc46-434d-846e-1370bf819502 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:48.248682 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-165e80c9-dc46-434d-846e-1370bf819502 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:48.254998 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-165e80c9-dc46-434d-846e-1370bf819502 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:48.255446 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-165e80c9-dc46-434d-846e-1370bf819502 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:48.256434 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-165e80c9-dc46-434d-846e-1370bf819502 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:48.257467 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-165e80c9-dc46-434d-846e-1370bf819502 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:48.320256 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-165e80c9-dc46-434d-846e-1370bf819502 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:48.329411 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-165e80c9-dc46-434d-846e-1370bf819502 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.085758 Aug 25 05:49:48.330029 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 980/1997] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:48 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:49.109757 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-bdbd637a-0f21-4c48-893c-f42a5b003823 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:49.110399 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-bdbd637a-0f21-4c48-893c-f42a5b003823 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:49.116148 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bdbd637a-0f21-4c48-893c-f42a5b003823 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:49.116581 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bdbd637a-0f21-4c48-893c-f42a5b003823 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:49.117321 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bdbd637a-0f21-4c48-893c-f42a5b003823 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:49.117764 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bdbd637a-0f21-4c48-893c-f42a5b003823 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:49.182158 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-bdbd637a-0f21-4c48-893c-f42a5b003823 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:49.190405 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-bdbd637a-0f21-4c48-893c-f42a5b003823 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:49.191874 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-bdbd637a-0f21-4c48-893c-f42a5b003823 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:49.192970 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-bdbd637a-0f21-4c48-893c-f42a5b003823 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.086954 Aug 25 05:49:49.193514 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1018/1998] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:49:49 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:49:49.348869 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5567effb-c186-47d0-b7c7-1df4e5c6a707 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:49.349475 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5567effb-c186-47d0-b7c7-1df4e5c6a707 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:49.356501 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5567effb-c186-47d0-b7c7-1df4e5c6a707 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:49.356955 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5567effb-c186-47d0-b7c7-1df4e5c6a707 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:49.357770 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5567effb-c186-47d0-b7c7-1df4e5c6a707 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:49.358213 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5567effb-c186-47d0-b7c7-1df4e5c6a707 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:49.421166 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-5567effb-c186-47d0-b7c7-1df4e5c6a707 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:49.429142 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5567effb-c186-47d0-b7c7-1df4e5c6a707 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.083933 Aug 25 05:49:49.429779 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 981/1999] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:49 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:50.211148 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c9062bff-e151-4d15-b665-9fd9b9eae6c8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:50.211751 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c9062bff-e151-4d15-b665-9fd9b9eae6c8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:50.217910 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c9062bff-e151-4d15-b665-9fd9b9eae6c8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:50.218344 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c9062bff-e151-4d15-b665-9fd9b9eae6c8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:50.219088 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c9062bff-e151-4d15-b665-9fd9b9eae6c8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:50.219510 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c9062bff-e151-4d15-b665-9fd9b9eae6c8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:50.281291 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-c9062bff-e151-4d15-b665-9fd9b9eae6c8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:50.289389 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-c9062bff-e151-4d15-b665-9fd9b9eae6c8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:50.290877 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-c9062bff-e151-4d15-b665-9fd9b9eae6c8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:50.292381 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c9062bff-e151-4d15-b665-9fd9b9eae6c8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.084648 Aug 25 05:49:50.292707 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1019/2000] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:49:50 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:49:50.452950 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-97d3c90c-68bb-413b-bd4a-6b637fde4297 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:50.453564 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-97d3c90c-68bb-413b-bd4a-6b637fde4297 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:50.459494 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-97d3c90c-68bb-413b-bd4a-6b637fde4297 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:50.459939 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-97d3c90c-68bb-413b-bd4a-6b637fde4297 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:50.460704 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-97d3c90c-68bb-413b-bd4a-6b637fde4297 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:50.461132 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-97d3c90c-68bb-413b-bd4a-6b637fde4297 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:50.521677 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-97d3c90c-68bb-413b-bd4a-6b637fde4297 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:50.529841 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-97d3c90c-68bb-413b-bd4a-6b637fde4297 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.081128 Aug 25 05:49:50.530424 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 982/2001] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:50 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:51.310028 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-0450c7d1-49ba-49d5-92c8-e5f68c9a40ec tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:51.310613 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-0450c7d1-49ba-49d5-92c8-e5f68c9a40ec tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:51.316621 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0450c7d1-49ba-49d5-92c8-e5f68c9a40ec tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:51.317055 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0450c7d1-49ba-49d5-92c8-e5f68c9a40ec tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:51.317860 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0450c7d1-49ba-49d5-92c8-e5f68c9a40ec tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:51.318284 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0450c7d1-49ba-49d5-92c8-e5f68c9a40ec tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:51.377409 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-0450c7d1-49ba-49d5-92c8-e5f68c9a40ec tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:51.385445 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-0450c7d1-49ba-49d5-92c8-e5f68c9a40ec tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:51.386995 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-0450c7d1-49ba-49d5-92c8-e5f68c9a40ec tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:51.388101 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-0450c7d1-49ba-49d5-92c8-e5f68c9a40ec tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.081773 Aug 25 05:49:51.388644 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1020/2002] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:49:51 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:49:51.546709 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-71884e8b-eff7-44d3-aa19-5e73697ff0ad tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:51.547456 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-71884e8b-eff7-44d3-aa19-5e73697ff0ad tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:51.553958 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-71884e8b-eff7-44d3-aa19-5e73697ff0ad tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:51.554401 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-71884e8b-eff7-44d3-aa19-5e73697ff0ad tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:51.555157 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-71884e8b-eff7-44d3-aa19-5e73697ff0ad tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:51.555582 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-71884e8b-eff7-44d3-aa19-5e73697ff0ad tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:51.616900 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-71884e8b-eff7-44d3-aa19-5e73697ff0ad tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:51.625475 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-71884e8b-eff7-44d3-aa19-5e73697ff0ad tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.082590 Aug 25 05:49:51.626090 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 983/2003] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:51 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:49:52.406067 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-bce5454a-2c47-4c20-8271-c48eecf3eeea tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:52.406722 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-bce5454a-2c47-4c20-8271-c48eecf3eeea tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:52.413131 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bce5454a-2c47-4c20-8271-c48eecf3eeea tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:52.413598 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bce5454a-2c47-4c20-8271-c48eecf3eeea tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:52.414375 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bce5454a-2c47-4c20-8271-c48eecf3eeea tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:52.414801 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bce5454a-2c47-4c20-8271-c48eecf3eeea tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:52.479215 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-bce5454a-2c47-4c20-8271-c48eecf3eeea tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:52.488287 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-bce5454a-2c47-4c20-8271-c48eecf3eeea tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:52.489805 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-bce5454a-2c47-4c20-8271-c48eecf3eeea tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:52.490931 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-bce5454a-2c47-4c20-8271-c48eecf3eeea tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.088680 Aug 25 05:49:52.491485 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1021/2004] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:49:52 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:49:52.642322 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d62b0006-64c1-466e-a076-c8855f542ac8 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:52.642996 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-d62b0006-64c1-466e-a076-c8855f542ac8 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:52.649117 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d62b0006-64c1-466e-a076-c8855f542ac8 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:52.649572 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d62b0006-64c1-466e-a076-c8855f542ac8 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:52.650338 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d62b0006-64c1-466e-a076-c8855f542ac8 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:52.650762 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d62b0006-64c1-466e-a076-c8855f542ac8 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:52.713594 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-d62b0006-64c1-466e-a076-c8855f542ac8 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:52.722281 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d62b0006-64c1-466e-a076-c8855f542ac8 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.083649 Aug 25 05:49:52.722883 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 984/2005] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:52 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:53.510321 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-fcfe6146-77ee-4405-bf14-aa6df12b7cd3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:53.510918 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-fcfe6146-77ee-4405-bf14-aa6df12b7cd3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:53.517468 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fcfe6146-77ee-4405-bf14-aa6df12b7cd3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:53.517937 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fcfe6146-77ee-4405-bf14-aa6df12b7cd3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:53.518698 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fcfe6146-77ee-4405-bf14-aa6df12b7cd3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:53.519120 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fcfe6146-77ee-4405-bf14-aa6df12b7cd3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:53.579544 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-fcfe6146-77ee-4405-bf14-aa6df12b7cd3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:53.586766 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-fcfe6146-77ee-4405-bf14-aa6df12b7cd3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:53.588246 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-fcfe6146-77ee-4405-bf14-aa6df12b7cd3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:53.589354 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-fcfe6146-77ee-4405-bf14-aa6df12b7cd3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.082780 Aug 25 05:49:53.589927 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1022/2006] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:49:53 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:49:53.739659 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c635e193-432a-46f1-aa30-22045dc7a1fa tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:53.740264 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c635e193-432a-46f1-aa30-22045dc7a1fa tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:53.746087 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c635e193-432a-46f1-aa30-22045dc7a1fa tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:53.746527 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c635e193-432a-46f1-aa30-22045dc7a1fa tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:53.747284 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c635e193-432a-46f1-aa30-22045dc7a1fa tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:53.747708 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c635e193-432a-46f1-aa30-22045dc7a1fa tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:53.806510 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-c635e193-432a-46f1-aa30-22045dc7a1fa tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:53.815404 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c635e193-432a-46f1-aa30-22045dc7a1fa tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.079404 Aug 25 05:49:53.815964 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 985/2007] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:53 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:49:54.606283 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6dc79194-ae1c-43e6-9a2b-70aaee5920ad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:54.606882 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6dc79194-ae1c-43e6-9a2b-70aaee5920ad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:54.612693 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6dc79194-ae1c-43e6-9a2b-70aaee5920ad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:54.613130 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6dc79194-ae1c-43e6-9a2b-70aaee5920ad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:54.613900 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6dc79194-ae1c-43e6-9a2b-70aaee5920ad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:54.614319 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6dc79194-ae1c-43e6-9a2b-70aaee5920ad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:54.674178 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-6dc79194-ae1c-43e6-9a2b-70aaee5920ad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:54.682490 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-6dc79194-ae1c-43e6-9a2b-70aaee5920ad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:54.684024 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-6dc79194-ae1c-43e6-9a2b-70aaee5920ad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:54.685175 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6dc79194-ae1c-43e6-9a2b-70aaee5920ad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.082591 Aug 25 05:49:54.685732 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1023/2008] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:49:54 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:49:54.832523 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-febc4345-7512-4f34-82b3-99f192b685f7 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:54.833072 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-febc4345-7512-4f34-82b3-99f192b685f7 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:54.838723 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-febc4345-7512-4f34-82b3-99f192b685f7 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:54.839161 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-febc4345-7512-4f34-82b3-99f192b685f7 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:54.839917 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-febc4345-7512-4f34-82b3-99f192b685f7 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:54.840339 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-febc4345-7512-4f34-82b3-99f192b685f7 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:54.899258 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-febc4345-7512-4f34-82b3-99f192b685f7 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:54.906945 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-febc4345-7512-4f34-82b3-99f192b685f7 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.078800 Aug 25 05:49:54.907493 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 986/2009] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:54 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:55.704120 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-35f19473-0c29-4ecc-bde5-0bbfba9b46db tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:55.704761 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-35f19473-0c29-4ecc-bde5-0bbfba9b46db tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:55.710564 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-35f19473-0c29-4ecc-bde5-0bbfba9b46db tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:55.710998 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-35f19473-0c29-4ecc-bde5-0bbfba9b46db tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:55.711752 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-35f19473-0c29-4ecc-bde5-0bbfba9b46db tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:55.712172 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-35f19473-0c29-4ecc-bde5-0bbfba9b46db tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:55.774346 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-35f19473-0c29-4ecc-bde5-0bbfba9b46db tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:55.782656 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-35f19473-0c29-4ecc-bde5-0bbfba9b46db tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:55.784123 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-35f19473-0c29-4ecc-bde5-0bbfba9b46db tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:55.785230 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-35f19473-0c29-4ecc-bde5-0bbfba9b46db tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.085657 Aug 25 05:49:55.785885 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1024/2010] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:49:55 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:49:55.924326 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-0108f704-73f7-490c-a002-3ea3a87076dc tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:55.924937 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-0108f704-73f7-490c-a002-3ea3a87076dc tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:55.930711 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0108f704-73f7-490c-a002-3ea3a87076dc tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:55.931142 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0108f704-73f7-490c-a002-3ea3a87076dc tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:55.931899 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0108f704-73f7-490c-a002-3ea3a87076dc tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:55.932330 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0108f704-73f7-490c-a002-3ea3a87076dc tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:55.991568 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-0108f704-73f7-490c-a002-3ea3a87076dc tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:55.999188 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-0108f704-73f7-490c-a002-3ea3a87076dc tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.079514 Aug 25 05:49:55.999745 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 987/2011] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:55 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:56.804080 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-fa0d7f30-62de-44e9-9565-18e28e1c9b71 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:56.804690 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-fa0d7f30-62de-44e9-9565-18e28e1c9b71 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:56.810654 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fa0d7f30-62de-44e9-9565-18e28e1c9b71 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:56.811086 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fa0d7f30-62de-44e9-9565-18e28e1c9b71 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:56.811848 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fa0d7f30-62de-44e9-9565-18e28e1c9b71 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:56.812270 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fa0d7f30-62de-44e9-9565-18e28e1c9b71 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:56.873403 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-fa0d7f30-62de-44e9-9565-18e28e1c9b71 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:56.882642 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-fa0d7f30-62de-44e9-9565-18e28e1c9b71 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:56.884113 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-fa0d7f30-62de-44e9-9565-18e28e1c9b71 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:56.885247 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-fa0d7f30-62de-44e9-9565-18e28e1c9b71 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.084872 Aug 25 05:49:56.885827 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1025/2012] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:49:56 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:49:57.016510 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-88102497-4be5-47da-be0d-04cbcfa536f8 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:57.017249 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-88102497-4be5-47da-be0d-04cbcfa536f8 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:57.023576 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-88102497-4be5-47da-be0d-04cbcfa536f8 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:57.024021 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-88102497-4be5-47da-be0d-04cbcfa536f8 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:57.024794 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-88102497-4be5-47da-be0d-04cbcfa536f8 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:57.025223 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-88102497-4be5-47da-be0d-04cbcfa536f8 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:57.085549 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-88102497-4be5-47da-be0d-04cbcfa536f8 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:57.093324 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-88102497-4be5-47da-be0d-04cbcfa536f8 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.080504 Aug 25 05:49:57.094566 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 988/2013] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:57 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:57.904015 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-62034174-4b9c-480c-b21a-a186b0bdbd37 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:57.904544 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-62034174-4b9c-480c-b21a-a186b0bdbd37 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:57.910869 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-62034174-4b9c-480c-b21a-a186b0bdbd37 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:57.911311 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-62034174-4b9c-480c-b21a-a186b0bdbd37 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:57.912071 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-62034174-4b9c-480c-b21a-a186b0bdbd37 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:57.912498 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-62034174-4b9c-480c-b21a-a186b0bdbd37 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:57.972439 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-62034174-4b9c-480c-b21a-a186b0bdbd37 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:57.982987 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-62034174-4b9c-480c-b21a-a186b0bdbd37 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:57.985828 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-62034174-4b9c-480c-b21a-a186b0bdbd37 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:57.987209 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-62034174-4b9c-480c-b21a-a186b0bdbd37 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.087001 Aug 25 05:49:57.987776 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1026/2014] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:49:57 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:49:58.110608 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b7051e1c-d338-4846-8843-9c65f2005ec8 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:58.111221 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b7051e1c-d338-4846-8843-9c65f2005ec8 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:58.117133 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b7051e1c-d338-4846-8843-9c65f2005ec8 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:58.117614 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b7051e1c-d338-4846-8843-9c65f2005ec8 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:58.118379 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b7051e1c-d338-4846-8843-9c65f2005ec8 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:58.118812 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b7051e1c-d338-4846-8843-9c65f2005ec8 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:58.178217 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-b7051e1c-d338-4846-8843-9c65f2005ec8 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:58.186014 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b7051e1c-d338-4846-8843-9c65f2005ec8 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.079206 Aug 25 05:49:58.186575 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 989/2015] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:58 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:49:59.008729 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2c341d71-222e-42f2-a861-6d50ad235cb9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:59.009333 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2c341d71-222e-42f2-a861-6d50ad235cb9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:59.015126 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2c341d71-222e-42f2-a861-6d50ad235cb9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:59.016306 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2c341d71-222e-42f2-a861-6d50ad235cb9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:59.017068 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2c341d71-222e-42f2-a861-6d50ad235cb9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:59.017493 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2c341d71-222e-42f2-a861-6d50ad235cb9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:59.082685 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-2c341d71-222e-42f2-a861-6d50ad235cb9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:59.090791 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-2c341d71-222e-42f2-a861-6d50ad235cb9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:59.092251 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-2c341d71-222e-42f2-a861-6d50ad235cb9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:59.093350 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2c341d71-222e-42f2-a861-6d50ad235cb9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.088511 Aug 25 05:49:59.094633 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1027/2016] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:49:59 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:49:59.202019 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b55af7e3-bf64-42dd-9bb2-a86ed9d1748c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:49:59.202556 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b55af7e3-bf64-42dd-9bb2-a86ed9d1748c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:49:59.209127 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b55af7e3-bf64-42dd-9bb2-a86ed9d1748c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:59.209613 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b55af7e3-bf64-42dd-9bb2-a86ed9d1748c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:59.210378 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b55af7e3-bf64-42dd-9bb2-a86ed9d1748c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:49:59.210810 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b55af7e3-bf64-42dd-9bb2-a86ed9d1748c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:49:59.269313 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-b55af7e3-bf64-42dd-9bb2-a86ed9d1748c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:49:59.277327 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b55af7e3-bf64-42dd-9bb2-a86ed9d1748c tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.079206 Aug 25 05:49:59.277923 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 990/2017] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:49:59 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:50:00.112067 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ac799bad-4ea7-49c0-b536-038767f31556 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:00.112668 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ac799bad-4ea7-49c0-b536-038767f31556 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:00.118646 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ac799bad-4ea7-49c0-b536-038767f31556 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:00.119081 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ac799bad-4ea7-49c0-b536-038767f31556 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:00.119829 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ac799bad-4ea7-49c0-b536-038767f31556 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:00.120279 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ac799bad-4ea7-49c0-b536-038767f31556 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:00.179121 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ac799bad-4ea7-49c0-b536-038767f31556 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:00.187124 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ac799bad-4ea7-49c0-b536-038767f31556 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:00.189292 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ac799bad-4ea7-49c0-b536-038767f31556 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:00.190410 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ac799bad-4ea7-49c0-b536-038767f31556 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.082160 Aug 25 05:50:00.190959 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1028/2018] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:00 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:00.293442 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-285e5bb4-a593-444e-81a5-3bb1cd24a0da tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:00.294083 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-285e5bb4-a593-444e-81a5-3bb1cd24a0da tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:00.299976 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-285e5bb4-a593-444e-81a5-3bb1cd24a0da tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:00.300417 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-285e5bb4-a593-444e-81a5-3bb1cd24a0da tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:00.301179 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-285e5bb4-a593-444e-81a5-3bb1cd24a0da tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:00.301644 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-285e5bb4-a593-444e-81a5-3bb1cd24a0da tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:00.360590 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-285e5bb4-a593-444e-81a5-3bb1cd24a0da tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:00.368269 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-285e5bb4-a593-444e-81a5-3bb1cd24a0da tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.078398 Aug 25 05:50:00.368768 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 991/2019] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:50:00 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:50:01.208538 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-611e3f65-af3c-45e7-802f-c1cc684dd619 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:01.209146 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-611e3f65-af3c-45e7-802f-c1cc684dd619 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:01.215011 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-611e3f65-af3c-45e7-802f-c1cc684dd619 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:01.215451 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-611e3f65-af3c-45e7-802f-c1cc684dd619 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:01.216201 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-611e3f65-af3c-45e7-802f-c1cc684dd619 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:01.216628 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-611e3f65-af3c-45e7-802f-c1cc684dd619 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:01.274670 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-611e3f65-af3c-45e7-802f-c1cc684dd619 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:01.283271 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-611e3f65-af3c-45e7-802f-c1cc684dd619 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:01.284782 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-611e3f65-af3c-45e7-802f-c1cc684dd619 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:01.285929 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-611e3f65-af3c-45e7-802f-c1cc684dd619 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.081053 Aug 25 05:50:01.286481 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1029/2020] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:01 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:50:01.386739 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ca7e2070-6ff5-4741-b5b9-d9ba65e4d9ef tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:01.387348 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ca7e2070-6ff5-4741-b5b9-d9ba65e4d9ef tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:01.393901 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ca7e2070-6ff5-4741-b5b9-d9ba65e4d9ef tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:01.394342 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ca7e2070-6ff5-4741-b5b9-d9ba65e4d9ef tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:01.395099 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ca7e2070-6ff5-4741-b5b9-d9ba65e4d9ef tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:01.395527 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ca7e2070-6ff5-4741-b5b9-d9ba65e4d9ef tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:01.455559 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ca7e2070-6ff5-4741-b5b9-d9ba65e4d9ef tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:01.463201 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ca7e2070-6ff5-4741-b5b9-d9ba65e4d9ef tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.080043 Aug 25 05:50:01.463691 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 992/2021] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:50:01 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:50:02.303746 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-52f66b76-c6de-4616-81d8-8ea1a5970d54 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:02.304358 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-52f66b76-c6de-4616-81d8-8ea1a5970d54 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:02.309993 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-52f66b76-c6de-4616-81d8-8ea1a5970d54 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:02.310431 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-52f66b76-c6de-4616-81d8-8ea1a5970d54 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:02.311176 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-52f66b76-c6de-4616-81d8-8ea1a5970d54 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:02.311601 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-52f66b76-c6de-4616-81d8-8ea1a5970d54 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:02.375807 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-52f66b76-c6de-4616-81d8-8ea1a5970d54 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:02.388094 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-52f66b76-c6de-4616-81d8-8ea1a5970d54 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:02.390365 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-52f66b76-c6de-4616-81d8-8ea1a5970d54 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:02.391617 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-52f66b76-c6de-4616-81d8-8ea1a5970d54 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.091511 Aug 25 05:50:02.392475 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1030/2022] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:02 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:02.479628 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-eebf2e46-4a85-4f0c-a448-4ca2d0fc4930 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:02.480243 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-eebf2e46-4a85-4f0c-a448-4ca2d0fc4930 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:02.486865 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-eebf2e46-4a85-4f0c-a448-4ca2d0fc4930 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:02.487347 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-eebf2e46-4a85-4f0c-a448-4ca2d0fc4930 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:02.488113 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-eebf2e46-4a85-4f0c-a448-4ca2d0fc4930 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:02.488546 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-eebf2e46-4a85-4f0c-a448-4ca2d0fc4930 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:02.547586 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-eebf2e46-4a85-4f0c-a448-4ca2d0fc4930 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:02.555395 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-eebf2e46-4a85-4f0c-a448-4ca2d0fc4930 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.079416 Aug 25 05:50:02.555952 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 993/2023] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:50:02 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:50:03.410262 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-99f7c336-7a09-459a-998d-601960870b2b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:03.410867 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-99f7c336-7a09-459a-998d-601960870b2b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:03.417684 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-99f7c336-7a09-459a-998d-601960870b2b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:03.418130 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-99f7c336-7a09-459a-998d-601960870b2b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:03.418895 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-99f7c336-7a09-459a-998d-601960870b2b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:03.419440 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-99f7c336-7a09-459a-998d-601960870b2b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:03.478546 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-99f7c336-7a09-459a-998d-601960870b2b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:03.487508 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-99f7c336-7a09-459a-998d-601960870b2b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:03.489000 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-99f7c336-7a09-459a-998d-601960870b2b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:03.490163 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-99f7c336-7a09-459a-998d-601960870b2b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.084018 Aug 25 05:50:03.490755 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1031/2024] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:03 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:03.572063 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ff9e4696-3594-409b-a05a-8f02891b3479 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:03.572671 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ff9e4696-3594-409b-a05a-8f02891b3479 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:03.578574 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ff9e4696-3594-409b-a05a-8f02891b3479 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:03.579011 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ff9e4696-3594-409b-a05a-8f02891b3479 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:03.579773 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ff9e4696-3594-409b-a05a-8f02891b3479 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:03.580201 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ff9e4696-3594-409b-a05a-8f02891b3479 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:03.640581 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ff9e4696-3594-409b-a05a-8f02891b3479 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:03.648879 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ff9e4696-3594-409b-a05a-8f02891b3479 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.080530 Aug 25 05:50:03.649441 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 994/2025] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:50:03 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:50:04.508441 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-03ed0083-faa2-4228-a848-1cc8600426d7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:04.509087 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-03ed0083-faa2-4228-a848-1cc8600426d7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:04.514900 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-03ed0083-faa2-4228-a848-1cc8600426d7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:04.515339 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-03ed0083-faa2-4228-a848-1cc8600426d7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:04.516762 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-03ed0083-faa2-4228-a848-1cc8600426d7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:04.517193 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-03ed0083-faa2-4228-a848-1cc8600426d7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:04.575985 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-03ed0083-faa2-4228-a848-1cc8600426d7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:04.584702 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-03ed0083-faa2-4228-a848-1cc8600426d7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:04.586217 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-03ed0083-faa2-4228-a848-1cc8600426d7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:04.587331 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-03ed0083-faa2-4228-a848-1cc8600426d7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.082620 Aug 25 05:50:04.587870 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1032/2026] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:04 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:04.665448 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-382ab26b-268f-4ca6-b4ce-79306ded03ab tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:04.666085 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-382ab26b-268f-4ca6-b4ce-79306ded03ab tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:04.671890 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-382ab26b-268f-4ca6-b4ce-79306ded03ab tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:04.672378 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-382ab26b-268f-4ca6-b4ce-79306ded03ab tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:04.673129 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-382ab26b-268f-4ca6-b4ce-79306ded03ab tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:04.673577 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-382ab26b-268f-4ca6-b4ce-79306ded03ab tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:04.731599 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-382ab26b-268f-4ca6-b4ce-79306ded03ab tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:04.740325 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-382ab26b-268f-4ca6-b4ce-79306ded03ab tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.078428 Aug 25 05:50:04.740891 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 995/2027] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:50:04 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:50:05.605025 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d6f2b5dd-6d0c-418f-9d29-06273d992ffd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:05.605699 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d6f2b5dd-6d0c-418f-9d29-06273d992ffd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:05.611575 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d6f2b5dd-6d0c-418f-9d29-06273d992ffd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:05.612011 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d6f2b5dd-6d0c-418f-9d29-06273d992ffd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:05.612749 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d6f2b5dd-6d0c-418f-9d29-06273d992ffd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:05.613170 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d6f2b5dd-6d0c-418f-9d29-06273d992ffd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:05.676062 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d6f2b5dd-6d0c-418f-9d29-06273d992ffd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:05.684178 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d6f2b5dd-6d0c-418f-9d29-06273d992ffd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:05.685712 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d6f2b5dd-6d0c-418f-9d29-06273d992ffd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:05.686813 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d6f2b5dd-6d0c-418f-9d29-06273d992ffd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.085498 Aug 25 05:50:05.687593 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1033/2028] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:05 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:05.756494 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-f4ec76c0-345a-42cf-9736-3537b198f961 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:05.757099 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-f4ec76c0-345a-42cf-9736-3537b198f961 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:05.762896 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f4ec76c0-345a-42cf-9736-3537b198f961 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:05.763335 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f4ec76c0-345a-42cf-9736-3537b198f961 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:05.764084 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f4ec76c0-345a-42cf-9736-3537b198f961 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:05.764509 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f4ec76c0-345a-42cf-9736-3537b198f961 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:05.823185 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-f4ec76c0-345a-42cf-9736-3537b198f961 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:05.831361 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-f4ec76c0-345a-42cf-9736-3537b198f961 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.078568 Aug 25 05:50:05.831920 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 996/2029] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:50:05 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:50:06.705124 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9e5f03f8-7cb2-43bc-a484-701551101bcb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:06.705744 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9e5f03f8-7cb2-43bc-a484-701551101bcb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:06.711521 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9e5f03f8-7cb2-43bc-a484-701551101bcb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:06.711955 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9e5f03f8-7cb2-43bc-a484-701551101bcb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:06.712703 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9e5f03f8-7cb2-43bc-a484-701551101bcb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:06.713124 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9e5f03f8-7cb2-43bc-a484-701551101bcb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:06.771888 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-9e5f03f8-7cb2-43bc-a484-701551101bcb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:06.780193 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-9e5f03f8-7cb2-43bc-a484-701551101bcb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:06.782159 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-9e5f03f8-7cb2-43bc-a484-701551101bcb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:06.783282 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9e5f03f8-7cb2-43bc-a484-701551101bcb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.082473 Aug 25 05:50:06.783841 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1034/2030] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:06 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:06.847904 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7dbe52fd-13fd-413d-9a83-78248898a69a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:06.848433 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7dbe52fd-13fd-413d-9a83-78248898a69a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:06.854311 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7dbe52fd-13fd-413d-9a83-78248898a69a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:06.854752 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7dbe52fd-13fd-413d-9a83-78248898a69a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:06.855498 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7dbe52fd-13fd-413d-9a83-78248898a69a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:06.855929 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7dbe52fd-13fd-413d-9a83-78248898a69a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:06.914225 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-7dbe52fd-13fd-413d-9a83-78248898a69a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:06.921814 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7dbe52fd-13fd-413d-9a83-78248898a69a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.077629 Aug 25 05:50:06.922507 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 997/2031] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:50:06 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:50:07.800686 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1a2db755-4388-41fb-8f04-55128f731d55 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:07.801214 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1a2db755-4388-41fb-8f04-55128f731d55 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:07.807216 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1a2db755-4388-41fb-8f04-55128f731d55 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:07.807664 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1a2db755-4388-41fb-8f04-55128f731d55 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:07.808477 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1a2db755-4388-41fb-8f04-55128f731d55 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:07.808875 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1a2db755-4388-41fb-8f04-55128f731d55 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:07.867427 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-1a2db755-4388-41fb-8f04-55128f731d55 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:07.875527 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-1a2db755-4388-41fb-8f04-55128f731d55 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:07.877007 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-1a2db755-4388-41fb-8f04-55128f731d55 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:07.878157 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1a2db755-4388-41fb-8f04-55128f731d55 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.081917 Aug 25 05:50:07.878705 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1035/2032] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:07 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:07.938196 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-02acefb3-97c5-4904-9ca9-7f041b7da65d tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:07.938808 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-02acefb3-97c5-4904-9ca9-7f041b7da65d tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:07.944762 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-02acefb3-97c5-4904-9ca9-7f041b7da65d tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:07.945205 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-02acefb3-97c5-4904-9ca9-7f041b7da65d tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:07.945994 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-02acefb3-97c5-4904-9ca9-7f041b7da65d tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:07.946424 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-02acefb3-97c5-4904-9ca9-7f041b7da65d tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:08.004456 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-02acefb3-97c5-4904-9ca9-7f041b7da65d tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:08.012150 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-02acefb3-97c5-4904-9ca9-7f041b7da65d tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.077642 Aug 25 05:50:08.012710 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 998/2033] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:50:07 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:50:08.895836 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a6a2b658-cea1-400e-9414-2b020e5c736f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:08.896382 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a6a2b658-cea1-400e-9414-2b020e5c736f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:08.902465 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a6a2b658-cea1-400e-9414-2b020e5c736f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:08.902898 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a6a2b658-cea1-400e-9414-2b020e5c736f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:08.903635 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a6a2b658-cea1-400e-9414-2b020e5c736f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:08.904057 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a6a2b658-cea1-400e-9414-2b020e5c736f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:08.966238 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-a6a2b658-cea1-400e-9414-2b020e5c736f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:08.974779 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-a6a2b658-cea1-400e-9414-2b020e5c736f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:08.976232 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-a6a2b658-cea1-400e-9414-2b020e5c736f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:08.977331 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a6a2b658-cea1-400e-9414-2b020e5c736f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.085323 Aug 25 05:50:08.977905 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1036/2034] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:08 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:09.029550 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6c316ba0-bc2c-409c-8d1d-11bfc3285d7b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:09.030238 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6c316ba0-bc2c-409c-8d1d-11bfc3285d7b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:09.037002 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6c316ba0-bc2c-409c-8d1d-11bfc3285d7b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:09.037451 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6c316ba0-bc2c-409c-8d1d-11bfc3285d7b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:09.038257 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6c316ba0-bc2c-409c-8d1d-11bfc3285d7b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:09.038688 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6c316ba0-bc2c-409c-8d1d-11bfc3285d7b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:09.097666 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6c316ba0-bc2c-409c-8d1d-11bfc3285d7b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:09.105174 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6c316ba0-bc2c-409c-8d1d-11bfc3285d7b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.079299 Aug 25 05:50:09.105765 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 999/2035] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:50:09 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:50:09.996046 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7336c355-12cd-4ac7-91e0-4e6a3186eb26 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:09.996602 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-7336c355-12cd-4ac7-91e0-4e6a3186eb26 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:10.003347 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7336c355-12cd-4ac7-91e0-4e6a3186eb26 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:10.003795 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7336c355-12cd-4ac7-91e0-4e6a3186eb26 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:10.004564 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7336c355-12cd-4ac7-91e0-4e6a3186eb26 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:10.004993 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7336c355-12cd-4ac7-91e0-4e6a3186eb26 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:10.066661 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-7336c355-12cd-4ac7-91e0-4e6a3186eb26 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:10.075259 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-7336c355-12cd-4ac7-91e0-4e6a3186eb26 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:10.076732 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-7336c355-12cd-4ac7-91e0-4e6a3186eb26 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:10.077882 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-7336c355-12cd-4ac7-91e0-4e6a3186eb26 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.085802 Aug 25 05:50:10.079255 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1037/2036] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:09 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:50:10.122904 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-876d01ad-69b4-4eb9-a64a-02ca462d9b7a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:10.123517 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-876d01ad-69b4-4eb9-a64a-02ca462d9b7a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:10.131211 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-876d01ad-69b4-4eb9-a64a-02ca462d9b7a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:10.131211 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-876d01ad-69b4-4eb9-a64a-02ca462d9b7a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:10.133448 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-876d01ad-69b4-4eb9-a64a-02ca462d9b7a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:10.134123 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-876d01ad-69b4-4eb9-a64a-02ca462d9b7a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:10.208522 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-876d01ad-69b4-4eb9-a64a-02ca462d9b7a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:10.216446 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-876d01ad-69b4-4eb9-a64a-02ca462d9b7a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.097233 Aug 25 05:50:10.217008 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1000/2037] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:50:10 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:50:11.097251 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ad35af9d-4479-4db7-8de1-a12bd7619509 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:11.098851 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ad35af9d-4479-4db7-8de1-a12bd7619509 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:11.106211 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ad35af9d-4479-4db7-8de1-a12bd7619509 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:11.106689 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ad35af9d-4479-4db7-8de1-a12bd7619509 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:11.107526 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ad35af9d-4479-4db7-8de1-a12bd7619509 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:11.107952 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ad35af9d-4479-4db7-8de1-a12bd7619509 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:11.168385 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ad35af9d-4479-4db7-8de1-a12bd7619509 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:11.176992 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ad35af9d-4479-4db7-8de1-a12bd7619509 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:11.178509 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ad35af9d-4479-4db7-8de1-a12bd7619509 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:11.179629 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ad35af9d-4479-4db7-8de1-a12bd7619509 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.086896 Aug 25 05:50:11.180223 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1038/2038] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:11 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:50:11.233339 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3cb4f5d0-3b04-471a-8797-73645a68a719 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:11.233951 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3cb4f5d0-3b04-471a-8797-73645a68a719 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:11.240212 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3cb4f5d0-3b04-471a-8797-73645a68a719 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:11.240657 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3cb4f5d0-3b04-471a-8797-73645a68a719 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:11.241429 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3cb4f5d0-3b04-471a-8797-73645a68a719 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:11.241888 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3cb4f5d0-3b04-471a-8797-73645a68a719 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:11.301930 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-3cb4f5d0-3b04-471a-8797-73645a68a719 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:11.309673 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3cb4f5d0-3b04-471a-8797-73645a68a719 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.080020 Aug 25 05:50:11.310229 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1001/2039] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:50:11 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:50:12.198657 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-80dd0f87-d938-456e-b05a-e060be948a68 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:12.199249 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-80dd0f87-d938-456e-b05a-e060be948a68 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:12.206732 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-80dd0f87-d938-456e-b05a-e060be948a68 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:12.207166 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-80dd0f87-d938-456e-b05a-e060be948a68 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:12.207927 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-80dd0f87-d938-456e-b05a-e060be948a68 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:12.208352 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-80dd0f87-d938-456e-b05a-e060be948a68 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:12.271524 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-80dd0f87-d938-456e-b05a-e060be948a68 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:12.279981 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-80dd0f87-d938-456e-b05a-e060be948a68 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:12.281464 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-80dd0f87-d938-456e-b05a-e060be948a68 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:12.283383 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-80dd0f87-d938-456e-b05a-e060be948a68 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.088197 Aug 25 05:50:12.284027 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1039/2040] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:12 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:12.326928 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e78e6863-4b6c-405a-841f-b149105cbb88 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:12.327538 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e78e6863-4b6c-405a-841f-b149105cbb88 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:12.334015 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e78e6863-4b6c-405a-841f-b149105cbb88 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:12.334461 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e78e6863-4b6c-405a-841f-b149105cbb88 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:12.335216 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e78e6863-4b6c-405a-841f-b149105cbb88 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:12.335648 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e78e6863-4b6c-405a-841f-b149105cbb88 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:12.395832 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e78e6863-4b6c-405a-841f-b149105cbb88 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:12.405217 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e78e6863-4b6c-405a-841f-b149105cbb88 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.082009 Aug 25 05:50:12.405830 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1002/2041] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:50:12 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:50:13.301868 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5811cde9-8d4b-4603-bbdf-177e4cd79342 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:13.302480 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5811cde9-8d4b-4603-bbdf-177e4cd79342 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:13.308406 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5811cde9-8d4b-4603-bbdf-177e4cd79342 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:13.308850 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5811cde9-8d4b-4603-bbdf-177e4cd79342 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:13.309634 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5811cde9-8d4b-4603-bbdf-177e4cd79342 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:13.310178 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5811cde9-8d4b-4603-bbdf-177e4cd79342 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:13.370339 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-5811cde9-8d4b-4603-bbdf-177e4cd79342 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:13.379235 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-5811cde9-8d4b-4603-bbdf-177e4cd79342 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:13.380729 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-5811cde9-8d4b-4603-bbdf-177e4cd79342 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:13.381894 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5811cde9-8d4b-4603-bbdf-177e4cd79342 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.084620 Aug 25 05:50:13.382492 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1040/2042] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:13 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:13.422826 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3cafe3a2-428d-4bd4-abfa-8d59c0d5290a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:13.424240 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3cafe3a2-428d-4bd4-abfa-8d59c0d5290a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:13.430897 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3cafe3a2-428d-4bd4-abfa-8d59c0d5290a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:13.431350 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3cafe3a2-428d-4bd4-abfa-8d59c0d5290a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:13.432133 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3cafe3a2-428d-4bd4-abfa-8d59c0d5290a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:13.432595 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3cafe3a2-428d-4bd4-abfa-8d59c0d5290a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:13.505488 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-3cafe3a2-428d-4bd4-abfa-8d59c0d5290a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:13.513277 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3cafe3a2-428d-4bd4-abfa-8d59c0d5290a tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.094454 Aug 25 05:50:13.513864 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1003/2043] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:50:13 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:50:14.400013 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-23c44429-ddd1-414d-982e-958431d46425 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:14.437035 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-23c44429-ddd1-414d-982e-958431d46425 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:14.437035 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-23c44429-ddd1-414d-982e-958431d46425 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:14.437035 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-23c44429-ddd1-414d-982e-958431d46425 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:14.437035 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-23c44429-ddd1-414d-982e-958431d46425 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:14.437496 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-23c44429-ddd1-414d-982e-958431d46425 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:14.471297 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-23c44429-ddd1-414d-982e-958431d46425 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:14.479943 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-23c44429-ddd1-414d-982e-958431d46425 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:14.481414 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-23c44429-ddd1-414d-982e-958431d46425 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:14.482656 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-23c44429-ddd1-414d-982e-958431d46425 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.086612 Aug 25 05:50:14.483211 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1041/2044] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:14 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:14.529631 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3449c6fc-2699-450e-82ba-2ee403da44e2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:14.530461 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3449c6fc-2699-450e-82ba-2ee403da44e2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:14.537066 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3449c6fc-2699-450e-82ba-2ee403da44e2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:14.537552 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3449c6fc-2699-450e-82ba-2ee403da44e2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:14.538332 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3449c6fc-2699-450e-82ba-2ee403da44e2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:14.538766 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3449c6fc-2699-450e-82ba-2ee403da44e2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:14.602242 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-3449c6fc-2699-450e-82ba-2ee403da44e2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:14.609882 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3449c6fc-2699-450e-82ba-2ee403da44e2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.083979 Aug 25 05:50:14.610444 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1004/2045] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:50:14 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:50:15.500596 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-0a5f116c-6efd-4bed-bfdb-9ae4f8c9182b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:15.501210 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-0a5f116c-6efd-4bed-bfdb-9ae4f8c9182b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:15.507512 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0a5f116c-6efd-4bed-bfdb-9ae4f8c9182b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:15.508033 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0a5f116c-6efd-4bed-bfdb-9ae4f8c9182b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:15.508792 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0a5f116c-6efd-4bed-bfdb-9ae4f8c9182b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:15.509341 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0a5f116c-6efd-4bed-bfdb-9ae4f8c9182b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:15.571534 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-0a5f116c-6efd-4bed-bfdb-9ae4f8c9182b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:15.579605 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-0a5f116c-6efd-4bed-bfdb-9ae4f8c9182b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:15.581766 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-0a5f116c-6efd-4bed-bfdb-9ae4f8c9182b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:15.582908 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-0a5f116c-6efd-4bed-bfdb-9ae4f8c9182b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.085950 Aug 25 05:50:15.583457 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1042/2046] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:15 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:15.626422 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3f7694d8-4914-4945-a4e3-a1021ac50794 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:15.627552 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3f7694d8-4914-4945-a4e3-a1021ac50794 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:15.633315 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3f7694d8-4914-4945-a4e3-a1021ac50794 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:15.633787 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3f7694d8-4914-4945-a4e3-a1021ac50794 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:15.634538 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3f7694d8-4914-4945-a4e3-a1021ac50794 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:15.634963 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3f7694d8-4914-4945-a4e3-a1021ac50794 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:15.694198 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-3f7694d8-4914-4945-a4e3-a1021ac50794 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:15.701792 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3f7694d8-4914-4945-a4e3-a1021ac50794 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.078967 Aug 25 05:50:15.702355 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1005/2047] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:50:15 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:50:16.600852 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c474285f-17ff-4767-b069-f36bcd66d853 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:16.601453 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c474285f-17ff-4767-b069-f36bcd66d853 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:16.607251 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c474285f-17ff-4767-b069-f36bcd66d853 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:16.607691 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c474285f-17ff-4767-b069-f36bcd66d853 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:16.608430 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c474285f-17ff-4767-b069-f36bcd66d853 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:16.608851 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c474285f-17ff-4767-b069-f36bcd66d853 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:16.669682 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-c474285f-17ff-4767-b069-f36bcd66d853 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:16.678886 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-c474285f-17ff-4767-b069-f36bcd66d853 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:16.680384 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-c474285f-17ff-4767-b069-f36bcd66d853 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:16.681515 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c474285f-17ff-4767-b069-f36bcd66d853 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.084440 Aug 25 05:50:16.682116 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1043/2048] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:16 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:16.719315 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b055ca6a-bf0d-4713-af82-870d5736b7b5 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:16.719913 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b055ca6a-bf0d-4713-af82-870d5736b7b5 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:16.726505 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b055ca6a-bf0d-4713-af82-870d5736b7b5 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:16.726954 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b055ca6a-bf0d-4713-af82-870d5736b7b5 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:16.727730 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b055ca6a-bf0d-4713-af82-870d5736b7b5 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:16.728161 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b055ca6a-bf0d-4713-af82-870d5736b7b5 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:16.792212 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-b055ca6a-bf0d-4713-af82-870d5736b7b5 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:16.800159 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b055ca6a-bf0d-4713-af82-870d5736b7b5 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.084469 Aug 25 05:50:16.800717 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1006/2049] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:50:16 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:50:17.700777 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-095748bc-870d-4986-a52f-1dcc62a8168d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:17.701366 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-095748bc-870d-4986-a52f-1dcc62a8168d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:17.707337 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-095748bc-870d-4986-a52f-1dcc62a8168d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:17.707776 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-095748bc-870d-4986-a52f-1dcc62a8168d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:17.708803 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-095748bc-870d-4986-a52f-1dcc62a8168d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:17.708936 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-095748bc-870d-4986-a52f-1dcc62a8168d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:17.769342 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-095748bc-870d-4986-a52f-1dcc62a8168d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:17.778334 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-095748bc-870d-4986-a52f-1dcc62a8168d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:17.779817 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-095748bc-870d-4986-a52f-1dcc62a8168d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:17.780936 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-095748bc-870d-4986-a52f-1dcc62a8168d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.083854 Aug 25 05:50:17.781494 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1044/2050] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:17 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:17.817828 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3513e873-a10f-4a71-8c51-fba8d761bea1 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:17.819032 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3513e873-a10f-4a71-8c51-fba8d761bea1 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:17.824942 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3513e873-a10f-4a71-8c51-fba8d761bea1 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:17.825381 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3513e873-a10f-4a71-8c51-fba8d761bea1 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:17.826197 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3513e873-a10f-4a71-8c51-fba8d761bea1 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:17.826628 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3513e873-a10f-4a71-8c51-fba8d761bea1 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:17.885225 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-3513e873-a10f-4a71-8c51-fba8d761bea1 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:17.893274 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3513e873-a10f-4a71-8c51-fba8d761bea1 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.079600 Aug 25 05:50:17.903511 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1007/2051] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:50:17 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:50:18.799238 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7668bdf4-b1c9-4046-a79b-a6bf5ae0c1e1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:18.799819 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-7668bdf4-b1c9-4046-a79b-a6bf5ae0c1e1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:18.805747 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7668bdf4-b1c9-4046-a79b-a6bf5ae0c1e1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:18.806187 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7668bdf4-b1c9-4046-a79b-a6bf5ae0c1e1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:18.806940 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7668bdf4-b1c9-4046-a79b-a6bf5ae0c1e1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:18.807391 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7668bdf4-b1c9-4046-a79b-a6bf5ae0c1e1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:18.870212 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-7668bdf4-b1c9-4046-a79b-a6bf5ae0c1e1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:18.879226 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-7668bdf4-b1c9-4046-a79b-a6bf5ae0c1e1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:18.880736 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-7668bdf4-b1c9-4046-a79b-a6bf5ae0c1e1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:18.881922 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-7668bdf4-b1c9-4046-a79b-a6bf5ae0c1e1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.086692 Aug 25 05:50:18.882479 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1045/2052] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:18 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:18.919512 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7013f89c-f737-4d16-98a1-824a497b300e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:18.920117 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7013f89c-f737-4d16-98a1-824a497b300e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:18.926221 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7013f89c-f737-4d16-98a1-824a497b300e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:18.926667 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7013f89c-f737-4d16-98a1-824a497b300e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:18.927436 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7013f89c-f737-4d16-98a1-824a497b300e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:18.927889 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7013f89c-f737-4d16-98a1-824a497b300e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:18.990118 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-7013f89c-f737-4d16-98a1-824a497b300e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:18.997884 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7013f89c-f737-4d16-98a1-824a497b300e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.082093 Aug 25 05:50:18.998454 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1008/2053] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:50:18 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:50:19.900101 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-01c109f2-44bf-4eb5-8ac0-c411337a31bb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:19.900651 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-01c109f2-44bf-4eb5-8ac0-c411337a31bb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:19.906543 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-01c109f2-44bf-4eb5-8ac0-c411337a31bb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:19.906990 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-01c109f2-44bf-4eb5-8ac0-c411337a31bb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:19.907764 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-01c109f2-44bf-4eb5-8ac0-c411337a31bb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:19.908805 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-01c109f2-44bf-4eb5-8ac0-c411337a31bb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:19.969648 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-01c109f2-44bf-4eb5-8ac0-c411337a31bb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:19.988408 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-01c109f2-44bf-4eb5-8ac0-c411337a31bb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:19.989947 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-01c109f2-44bf-4eb5-8ac0-c411337a31bb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:19.991077 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-01c109f2-44bf-4eb5-8ac0-c411337a31bb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.095064 Aug 25 05:50:19.991632 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1046/2054] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:19 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:20.016309 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-39a012f6-02f4-4747-8512-ca3efe39dc35 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:20.017051 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-39a012f6-02f4-4747-8512-ca3efe39dc35 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:20.026633 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-39a012f6-02f4-4747-8512-ca3efe39dc35 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:20.027222 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-39a012f6-02f4-4747-8512-ca3efe39dc35 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:20.028465 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-39a012f6-02f4-4747-8512-ca3efe39dc35 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:20.029217 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-39a012f6-02f4-4747-8512-ca3efe39dc35 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:20.105386 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-39a012f6-02f4-4747-8512-ca3efe39dc35 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:20.114528 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-39a012f6-02f4-4747-8512-ca3efe39dc35 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.101929 Aug 25 05:50:20.115109 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1009/2055] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:50:20 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:50:21.009136 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9910aafa-4691-4a5e-b133-796c493a62ee tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:21.009718 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9910aafa-4691-4a5e-b133-796c493a62ee tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:21.015543 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9910aafa-4691-4a5e-b133-796c493a62ee tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:21.015977 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9910aafa-4691-4a5e-b133-796c493a62ee tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:21.016722 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9910aafa-4691-4a5e-b133-796c493a62ee tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:21.017146 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9910aafa-4691-4a5e-b133-796c493a62ee tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:21.075801 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-9910aafa-4691-4a5e-b133-796c493a62ee tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:21.084782 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-9910aafa-4691-4a5e-b133-796c493a62ee tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:21.086292 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-9910aafa-4691-4a5e-b133-796c493a62ee tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:21.087401 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9910aafa-4691-4a5e-b133-796c493a62ee tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.082112 Aug 25 05:50:21.087938 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1047/2056] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:21 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:21.132243 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6f59c65d-1236-44cc-91b3-74123340d19e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:21.132849 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6f59c65d-1236-44cc-91b3-74123340d19e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:21.138632 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6f59c65d-1236-44cc-91b3-74123340d19e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:21.139075 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6f59c65d-1236-44cc-91b3-74123340d19e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:21.139860 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6f59c65d-1236-44cc-91b3-74123340d19e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:21.140288 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6f59c65d-1236-44cc-91b3-74123340d19e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:21.199454 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6f59c65d-1236-44cc-91b3-74123340d19e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:21.207897 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6f59c65d-1236-44cc-91b3-74123340d19e tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.079397 Aug 25 05:50:21.208462 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1010/2057] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:50:21 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:50:22.106255 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-10511d82-ee5b-406a-8a37-bcf4411488ec tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:22.106853 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-10511d82-ee5b-406a-8a37-bcf4411488ec tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:22.113394 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-10511d82-ee5b-406a-8a37-bcf4411488ec tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:22.113851 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-10511d82-ee5b-406a-8a37-bcf4411488ec tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:22.114601 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-10511d82-ee5b-406a-8a37-bcf4411488ec tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:22.115024 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-10511d82-ee5b-406a-8a37-bcf4411488ec tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:22.176711 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-10511d82-ee5b-406a-8a37-bcf4411488ec tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:22.184760 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-10511d82-ee5b-406a-8a37-bcf4411488ec tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:22.186265 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-10511d82-ee5b-406a-8a37-bcf4411488ec tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:22.187365 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-10511d82-ee5b-406a-8a37-bcf4411488ec tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.084792 Aug 25 05:50:22.187910 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1048/2058] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:22 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:22.223863 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-526a4955-7fd8-4477-b7cf-9a01041264ec tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:22.224470 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-526a4955-7fd8-4477-b7cf-9a01041264ec tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:22.230211 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-526a4955-7fd8-4477-b7cf-9a01041264ec tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:22.230646 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-526a4955-7fd8-4477-b7cf-9a01041264ec tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:22.231390 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-526a4955-7fd8-4477-b7cf-9a01041264ec tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:22.231813 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-526a4955-7fd8-4477-b7cf-9a01041264ec tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:22.291183 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-526a4955-7fd8-4477-b7cf-9a01041264ec tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:22.299338 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-526a4955-7fd8-4477-b7cf-9a01041264ec tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.078637 Aug 25 05:50:22.300029 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1011/2059] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:50:22 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:50:23.206131 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b87b965e-5535-42a3-8bda-4ffe897c8f72 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:23.206737 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b87b965e-5535-42a3-8bda-4ffe897c8f72 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:23.212482 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b87b965e-5535-42a3-8bda-4ffe897c8f72 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:23.212924 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b87b965e-5535-42a3-8bda-4ffe897c8f72 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:23.213690 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b87b965e-5535-42a3-8bda-4ffe897c8f72 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:23.214116 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b87b965e-5535-42a3-8bda-4ffe897c8f72 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:23.272556 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-b87b965e-5535-42a3-8bda-4ffe897c8f72 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:23.281219 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-b87b965e-5535-42a3-8bda-4ffe897c8f72 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:23.282728 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-b87b965e-5535-42a3-8bda-4ffe897c8f72 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:23.284464 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b87b965e-5535-42a3-8bda-4ffe897c8f72 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.082289 Aug 25 05:50:23.285011 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1049/2060] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:23 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:23.315916 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3f1de713-4509-4f90-9161-2e1afbf6f467 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:23.316529 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3f1de713-4509-4f90-9161-2e1afbf6f467 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:23.322301 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3f1de713-4509-4f90-9161-2e1afbf6f467 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:23.322745 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3f1de713-4509-4f90-9161-2e1afbf6f467 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:23.323502 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3f1de713-4509-4f90-9161-2e1afbf6f467 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:23.323929 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3f1de713-4509-4f90-9161-2e1afbf6f467 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:23.383944 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-3f1de713-4509-4f90-9161-2e1afbf6f467 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:23.391629 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3f1de713-4509-4f90-9161-2e1afbf6f467 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.079387 Aug 25 05:50:23.392184 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1012/2061] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:50:23 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:50:24.302710 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-98b2d8c4-e759-41eb-8981-6625e5c63244 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:24.318769 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-98b2d8c4-e759-41eb-8981-6625e5c63244 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:24.318769 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-98b2d8c4-e759-41eb-8981-6625e5c63244 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:24.318769 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-98b2d8c4-e759-41eb-8981-6625e5c63244 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:24.318769 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-98b2d8c4-e759-41eb-8981-6625e5c63244 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:24.319174 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-98b2d8c4-e759-41eb-8981-6625e5c63244 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:24.370073 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-98b2d8c4-e759-41eb-8981-6625e5c63244 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:24.378838 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-98b2d8c4-e759-41eb-8981-6625e5c63244 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:24.380296 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-98b2d8c4-e759-41eb-8981-6625e5c63244 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:24.381403 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-98b2d8c4-e759-41eb-8981-6625e5c63244 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.083125 Aug 25 05:50:24.381994 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1050/2062] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:24 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:24.408605 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c38567df-c372-4e3f-aae5-40edd18e6cf4 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:24.409760 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c38567df-c372-4e3f-aae5-40edd18e6cf4 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:24.415183 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c38567df-c372-4e3f-aae5-40edd18e6cf4 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:24.415628 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c38567df-c372-4e3f-aae5-40edd18e6cf4 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:24.416383 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c38567df-c372-4e3f-aae5-40edd18e6cf4 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:24.416811 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c38567df-c372-4e3f-aae5-40edd18e6cf4 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:24.477160 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-c38567df-c372-4e3f-aae5-40edd18e6cf4 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:24.484845 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c38567df-c372-4e3f-aae5-40edd18e6cf4 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.080044 Aug 25 05:50:24.485412 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1013/2063] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:50:24 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:50:25.399198 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-99f1802b-a40b-464a-a881-d319160bc49b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:25.399813 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-99f1802b-a40b-464a-a881-d319160bc49b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:25.405592 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-99f1802b-a40b-464a-a881-d319160bc49b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:25.406030 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-99f1802b-a40b-464a-a881-d319160bc49b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:25.406773 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-99f1802b-a40b-464a-a881-d319160bc49b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:25.407196 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-99f1802b-a40b-464a-a881-d319160bc49b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:25.468997 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-99f1802b-a40b-464a-a881-d319160bc49b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:25.477861 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-99f1802b-a40b-464a-a881-d319160bc49b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:25.479324 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-99f1802b-a40b-464a-a881-d319160bc49b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:25.480426 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-99f1802b-a40b-464a-a881-d319160bc49b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.085202 Aug 25 05:50:25.480971 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1051/2064] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:25 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:25.502466 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-33801359-369a-4091-8274-f5c9cfcd4e92 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:25.503523 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-33801359-369a-4091-8274-f5c9cfcd4e92 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:25.510804 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-33801359-369a-4091-8274-f5c9cfcd4e92 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:25.511252 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-33801359-369a-4091-8274-f5c9cfcd4e92 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:25.512024 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-33801359-369a-4091-8274-f5c9cfcd4e92 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:25.512451 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-33801359-369a-4091-8274-f5c9cfcd4e92 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:25.573348 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-33801359-369a-4091-8274-f5c9cfcd4e92 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:25.581837 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-33801359-369a-4091-8274-f5c9cfcd4e92 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.083373 Aug 25 05:50:25.582404 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1014/2065] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:50:25 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:50:26.498814 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-45ddd3f7-510f-4b2f-9cf3-734feadbdfe2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:26.499452 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-45ddd3f7-510f-4b2f-9cf3-734feadbdfe2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:26.505435 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-45ddd3f7-510f-4b2f-9cf3-734feadbdfe2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:26.505905 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-45ddd3f7-510f-4b2f-9cf3-734feadbdfe2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:26.506658 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-45ddd3f7-510f-4b2f-9cf3-734feadbdfe2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:26.507095 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-45ddd3f7-510f-4b2f-9cf3-734feadbdfe2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:26.566836 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-45ddd3f7-510f-4b2f-9cf3-734feadbdfe2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:26.575385 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-45ddd3f7-510f-4b2f-9cf3-734feadbdfe2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:26.576861 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-45ddd3f7-510f-4b2f-9cf3-734feadbdfe2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:26.578025 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-45ddd3f7-510f-4b2f-9cf3-734feadbdfe2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.082900 Aug 25 05:50:26.578566 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1052/2066] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:26 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:26.599263 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-f5941df0-fe30-4fb4-9f23-7a66e9d1df05 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:26.599906 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-f5941df0-fe30-4fb4-9f23-7a66e9d1df05 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:26.605790 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f5941df0-fe30-4fb4-9f23-7a66e9d1df05 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:26.606236 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f5941df0-fe30-4fb4-9f23-7a66e9d1df05 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:26.606992 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f5941df0-fe30-4fb4-9f23-7a66e9d1df05 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:26.607421 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f5941df0-fe30-4fb4-9f23-7a66e9d1df05 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:26.666149 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-f5941df0-fe30-4fb4-9f23-7a66e9d1df05 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:26.673644 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-f5941df0-fe30-4fb4-9f23-7a66e9d1df05 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.079006 Aug 25 05:50:26.674376 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1015/2067] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:50:26 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:50:27.596616 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ade00037-dfbb-4114-be52-d6d1790b3126 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:27.597220 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ade00037-dfbb-4114-be52-d6d1790b3126 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:27.603131 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ade00037-dfbb-4114-be52-d6d1790b3126 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:27.603570 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ade00037-dfbb-4114-be52-d6d1790b3126 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:27.604321 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ade00037-dfbb-4114-be52-d6d1790b3126 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:27.604750 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ade00037-dfbb-4114-be52-d6d1790b3126 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:27.663914 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ade00037-dfbb-4114-be52-d6d1790b3126 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:27.671993 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ade00037-dfbb-4114-be52-d6d1790b3126 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:27.673468 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ade00037-dfbb-4114-be52-d6d1790b3126 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:27.674602 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ade00037-dfbb-4114-be52-d6d1790b3126 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.082291 Aug 25 05:50:27.675165 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1053/2068] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:27 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:27.689134 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1b6ca0f0-8625-4940-90f0-755810505f6b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:27.690507 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1b6ca0f0-8625-4940-90f0-755810505f6b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:27.696266 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1b6ca0f0-8625-4940-90f0-755810505f6b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:27.696707 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1b6ca0f0-8625-4940-90f0-755810505f6b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:27.697465 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1b6ca0f0-8625-4940-90f0-755810505f6b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:27.697920 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1b6ca0f0-8625-4940-90f0-755810505f6b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:27.757544 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-1b6ca0f0-8625-4940-90f0-755810505f6b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:27.765228 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1b6ca0f0-8625-4940-90f0-755810505f6b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.079710 Aug 25 05:50:27.765833 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1016/2069] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:50:27 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:50:28.692435 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-13163d24-d64b-41b7-90d1-eb17d49c2098 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:28.693011 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-13163d24-d64b-41b7-90d1-eb17d49c2098 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:28.698919 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-13163d24-d64b-41b7-90d1-eb17d49c2098 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:28.699362 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-13163d24-d64b-41b7-90d1-eb17d49c2098 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:28.700111 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-13163d24-d64b-41b7-90d1-eb17d49c2098 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:28.700552 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-13163d24-d64b-41b7-90d1-eb17d49c2098 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:28.766088 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-13163d24-d64b-41b7-90d1-eb17d49c2098 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:28.777391 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-13163d24-d64b-41b7-90d1-eb17d49c2098 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:28.778924 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-13163d24-d64b-41b7-90d1-eb17d49c2098 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:28.780129 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-13163d24-d64b-41b7-90d1-eb17d49c2098 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.091722 Aug 25 05:50:28.780679 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1054/2070] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:28 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:28.792982 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ce5fe6e2-8b68-491a-a654-076edf0d1d99 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:28.794067 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ce5fe6e2-8b68-491a-a654-076edf0d1d99 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:28.802310 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ce5fe6e2-8b68-491a-a654-076edf0d1d99 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:28.802752 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ce5fe6e2-8b68-491a-a654-076edf0d1d99 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:28.803511 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ce5fe6e2-8b68-491a-a654-076edf0d1d99 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:28.803936 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ce5fe6e2-8b68-491a-a654-076edf0d1d99 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:28.867966 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ce5fe6e2-8b68-491a-a654-076edf0d1d99 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:28.875605 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ce5fe6e2-8b68-491a-a654-076edf0d1d99 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.089705 Aug 25 05:50:28.876176 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1017/2071] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:50:28 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:50:29.807385 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f8397650-12a2-40a9-b887-13afb9519c23 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:29.807960 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f8397650-12a2-40a9-b887-13afb9519c23 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:29.813888 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f8397650-12a2-40a9-b887-13afb9519c23 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:29.814332 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f8397650-12a2-40a9-b887-13afb9519c23 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:29.815710 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f8397650-12a2-40a9-b887-13afb9519c23 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:29.816350 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f8397650-12a2-40a9-b887-13afb9519c23 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:29.875912 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-f8397650-12a2-40a9-b887-13afb9519c23 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:29.884766 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-f8397650-12a2-40a9-b887-13afb9519c23 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:29.886294 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-f8397650-12a2-40a9-b887-13afb9519c23 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:29.887424 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f8397650-12a2-40a9-b887-13afb9519c23 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.084728 Aug 25 05:50:29.887975 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1055/2072] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:29 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:29.892088 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d2295f0e-6056-46f8-9bda-79cda9d6c5f8 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:29.892732 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-d2295f0e-6056-46f8-9bda-79cda9d6c5f8 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:29.898932 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d2295f0e-6056-46f8-9bda-79cda9d6c5f8 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:29.899375 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d2295f0e-6056-46f8-9bda-79cda9d6c5f8 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:29.900134 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d2295f0e-6056-46f8-9bda-79cda9d6c5f8 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:29.900561 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d2295f0e-6056-46f8-9bda-79cda9d6c5f8 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:29.960090 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-d2295f0e-6056-46f8-9bda-79cda9d6c5f8 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:29.967648 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d2295f0e-6056-46f8-9bda-79cda9d6c5f8 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.079369 Aug 25 05:50:29.968204 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1018/2073] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:50:29 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:50:30.904732 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c671549e-0ad3-41d7-b23f-d6f6d994f691 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:30.905349 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c671549e-0ad3-41d7-b23f-d6f6d994f691 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:30.914293 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c671549e-0ad3-41d7-b23f-d6f6d994f691 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:30.915062 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c671549e-0ad3-41d7-b23f-d6f6d994f691 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:30.916985 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c671549e-0ad3-41d7-b23f-d6f6d994f691 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:30.918192 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c671549e-0ad3-41d7-b23f-d6f6d994f691 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:30.979401 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-c671549e-0ad3-41d7-b23f-d6f6d994f691 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:30.984262 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8a2d3212-aabf-4f86-a13e-58d24955ae15 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:30.984867 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8a2d3212-aabf-4f86-a13e-58d24955ae15 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:30.987802 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-c671549e-0ad3-41d7-b23f-d6f6d994f691 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:30.990126 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-c671549e-0ad3-41d7-b23f-d6f6d994f691 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:30.991260 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c671549e-0ad3-41d7-b23f-d6f6d994f691 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.090245 Aug 25 05:50:30.991393 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8a2d3212-aabf-4f86-a13e-58d24955ae15 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:30.991697 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8a2d3212-aabf-4f86-a13e-58d24955ae15 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:30.992106 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1056/2074] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:30 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:30.992716 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8a2d3212-aabf-4f86-a13e-58d24955ae15 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:30.993155 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8a2d3212-aabf-4f86-a13e-58d24955ae15 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:31.053704 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-8a2d3212-aabf-4f86-a13e-58d24955ae15 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:31.061638 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8a2d3212-aabf-4f86-a13e-58d24955ae15 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.081090 Aug 25 05:50:31.062146 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1019/2075] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:50:30 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:50:32.008962 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9e2c7268-a8e6-498b-9848-3ab2871a3404 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:32.009675 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9e2c7268-a8e6-498b-9848-3ab2871a3404 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:32.015432 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9e2c7268-a8e6-498b-9848-3ab2871a3404 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:32.015875 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9e2c7268-a8e6-498b-9848-3ab2871a3404 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:32.016638 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9e2c7268-a8e6-498b-9848-3ab2871a3404 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:32.017066 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9e2c7268-a8e6-498b-9848-3ab2871a3404 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:32.079200 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-2a18cb5b-83e8-4fb4-af5c-097935d49b5b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:32.079806 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-2a18cb5b-83e8-4fb4-af5c-097935d49b5b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:32.085883 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2a18cb5b-83e8-4fb4-af5c-097935d49b5b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:32.086326 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2a18cb5b-83e8-4fb4-af5c-097935d49b5b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:32.087093 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2a18cb5b-83e8-4fb4-af5c-097935d49b5b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:32.087516 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2a18cb5b-83e8-4fb4-af5c-097935d49b5b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:32.095606 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-9e2c7268-a8e6-498b-9848-3ab2871a3404 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:32.109833 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-9e2c7268-a8e6-498b-9848-3ab2871a3404 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:32.112368 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-9e2c7268-a8e6-498b-9848-3ab2871a3404 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:32.115139 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9e2c7268-a8e6-498b-9848-3ab2871a3404 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.109813 Aug 25 05:50:32.116084 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1057/2076] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:32 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:50:32.151821 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-2a18cb5b-83e8-4fb4-af5c-097935d49b5b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:32.159532 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-2a18cb5b-83e8-4fb4-af5c-097935d49b5b tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.084241 Aug 25 05:50:32.160644 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1020/2077] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:50:32 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:50:33.141467 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b9525c23-5ee1-4fe9-a496-c4bc0ab18b19 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:33.142108 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b9525c23-5ee1-4fe9-a496-c4bc0ab18b19 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:33.149631 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b9525c23-5ee1-4fe9-a496-c4bc0ab18b19 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:33.150086 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b9525c23-5ee1-4fe9-a496-c4bc0ab18b19 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:33.150857 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b9525c23-5ee1-4fe9-a496-c4bc0ab18b19 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:33.151292 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b9525c23-5ee1-4fe9-a496-c4bc0ab18b19 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:33.177436 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3b5ecbb5-600d-4e29-a390-7c44ed3a28a2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:33.177997 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3b5ecbb5-600d-4e29-a390-7c44ed3a28a2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:33.183734 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3b5ecbb5-600d-4e29-a390-7c44ed3a28a2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:33.184174 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3b5ecbb5-600d-4e29-a390-7c44ed3a28a2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:33.184935 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3b5ecbb5-600d-4e29-a390-7c44ed3a28a2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:33.185363 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3b5ecbb5-600d-4e29-a390-7c44ed3a28a2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:33.215881 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-b9525c23-5ee1-4fe9-a496-c4bc0ab18b19 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:33.224167 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-b9525c23-5ee1-4fe9-a496-c4bc0ab18b19 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:33.225666 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-b9525c23-5ee1-4fe9-a496-c4bc0ab18b19 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:33.226801 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b9525c23-5ee1-4fe9-a496-c4bc0ab18b19 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.089178 Aug 25 05:50:33.227345 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1058/2078] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:33 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:50:33.247210 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-3b5ecbb5-600d-4e29-a390-7c44ed3a28a2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:33.255877 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3b5ecbb5-600d-4e29-a390-7c44ed3a28a2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.082655 Aug 25 05:50:33.256450 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1021/2079] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:50:33 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:50:34.244618 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-205b6cce-a5af-4cf0-b208-9d71f08d6034 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:34.245233 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-205b6cce-a5af-4cf0-b208-9d71f08d6034 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:34.251021 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-205b6cce-a5af-4cf0-b208-9d71f08d6034 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:34.251459 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-205b6cce-a5af-4cf0-b208-9d71f08d6034 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:34.252206 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-205b6cce-a5af-4cf0-b208-9d71f08d6034 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:34.252647 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-205b6cce-a5af-4cf0-b208-9d71f08d6034 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:34.273549 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-40c97621-ac33-43af-9459-f7ac3ad03994 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:34.274159 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-40c97621-ac33-43af-9459-f7ac3ad03994 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:34.279977 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-40c97621-ac33-43af-9459-f7ac3ad03994 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:34.280577 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-40c97621-ac33-43af-9459-f7ac3ad03994 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:34.281266 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-40c97621-ac33-43af-9459-f7ac3ad03994 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:34.281731 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-40c97621-ac33-43af-9459-f7ac3ad03994 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:34.312033 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-205b6cce-a5af-4cf0-b208-9d71f08d6034 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:34.320700 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-205b6cce-a5af-4cf0-b208-9d71f08d6034 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:34.322226 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-205b6cce-a5af-4cf0-b208-9d71f08d6034 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:34.323347 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-205b6cce-a5af-4cf0-b208-9d71f08d6034 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.082434 Aug 25 05:50:34.323895 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1059/2080] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:34 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:34.343889 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-40c97621-ac33-43af-9459-f7ac3ad03994 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:34.353419 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-40c97621-ac33-43af-9459-f7ac3ad03994 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.084403 Aug 25 05:50:34.353984 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1022/2081] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:50:34 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:50:35.341743 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a0f6ae12-5890-496d-a068-219374c65508 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:35.342575 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a0f6ae12-5890-496d-a068-219374c65508 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:35.348795 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a0f6ae12-5890-496d-a068-219374c65508 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:35.349464 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a0f6ae12-5890-496d-a068-219374c65508 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:35.350770 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a0f6ae12-5890-496d-a068-219374c65508 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:35.351535 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a0f6ae12-5890-496d-a068-219374c65508 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:35.370420 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-4ce3c44f-025e-4f54-8876-8ddfdf6316da tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:35.371039 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-4ce3c44f-025e-4f54-8876-8ddfdf6316da tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:35.376788 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4ce3c44f-025e-4f54-8876-8ddfdf6316da tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:35.377167 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4ce3c44f-025e-4f54-8876-8ddfdf6316da tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:35.377971 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4ce3c44f-025e-4f54-8876-8ddfdf6316da tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:35.378504 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4ce3c44f-025e-4f54-8876-8ddfdf6316da tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:35.427249 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-a0f6ae12-5890-496d-a068-219374c65508 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:35.435678 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-a0f6ae12-5890-496d-a068-219374c65508 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:35.437407 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-a0f6ae12-5890-496d-a068-219374c65508 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:35.438283 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a0f6ae12-5890-496d-a068-219374c65508 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.100272 Aug 25 05:50:35.438829 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1060/2082] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:35 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:35.454093 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-4ce3c44f-025e-4f54-8876-8ddfdf6316da tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:35.463499 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-4ce3c44f-025e-4f54-8876-8ddfdf6316da tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.096793 Aug 25 05:50:35.464060 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1023/2083] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:50:35 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:50:36.457766 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d36ebcda-99dd-47c8-b724-49dd6d3b1019 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:36.458378 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d36ebcda-99dd-47c8-b724-49dd6d3b1019 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:36.464245 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d36ebcda-99dd-47c8-b724-49dd6d3b1019 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:36.464687 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d36ebcda-99dd-47c8-b724-49dd6d3b1019 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:36.465475 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d36ebcda-99dd-47c8-b724-49dd6d3b1019 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:36.465938 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d36ebcda-99dd-47c8-b724-49dd6d3b1019 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:36.479996 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1b1e5444-037e-4954-aa1f-7bf4816188a9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:36.481415 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1b1e5444-037e-4954-aa1f-7bf4816188a9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:36.487148 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1b1e5444-037e-4954-aa1f-7bf4816188a9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:36.487598 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1b1e5444-037e-4954-aa1f-7bf4816188a9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:36.488373 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1b1e5444-037e-4954-aa1f-7bf4816188a9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:36.488809 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1b1e5444-037e-4954-aa1f-7bf4816188a9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:36.538642 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d36ebcda-99dd-47c8-b724-49dd6d3b1019 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:36.547370 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d36ebcda-99dd-47c8-b724-49dd6d3b1019 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:36.548846 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d36ebcda-99dd-47c8-b724-49dd6d3b1019 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:36.550014 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d36ebcda-99dd-47c8-b724-49dd6d3b1019 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.096715 Aug 25 05:50:36.551353 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1061/2084] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:36 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:36.565050 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-1b1e5444-037e-4954-aa1f-7bf4816188a9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:36.573660 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1b1e5444-037e-4954-aa1f-7bf4816188a9 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.097323 Aug 25 05:50:36.574226 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1024/2085] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:50:36 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:50:37.574404 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f703c32b-5553-4834-a787-891526bcaf07 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:37.575004 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f703c32b-5553-4834-a787-891526bcaf07 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:37.580756 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f703c32b-5553-4834-a787-891526bcaf07 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:37.581201 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f703c32b-5553-4834-a787-891526bcaf07 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:37.581987 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f703c32b-5553-4834-a787-891526bcaf07 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:37.582418 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f703c32b-5553-4834-a787-891526bcaf07 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:37.591389 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e9a75650-7777-44a8-9250-9f1528b82ea3 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:37.591994 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e9a75650-7777-44a8-9250-9f1528b82ea3 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:37.597695 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e9a75650-7777-44a8-9250-9f1528b82ea3 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:37.598137 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e9a75650-7777-44a8-9250-9f1528b82ea3 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:37.599377 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e9a75650-7777-44a8-9250-9f1528b82ea3 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:37.600026 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e9a75650-7777-44a8-9250-9f1528b82ea3 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:37.644181 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-f703c32b-5553-4834-a787-891526bcaf07 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:37.653946 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-f703c32b-5553-4834-a787-891526bcaf07 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:37.655452 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-f703c32b-5553-4834-a787-891526bcaf07 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:37.656576 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f703c32b-5553-4834-a787-891526bcaf07 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.085934 Aug 25 05:50:37.657121 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1062/2086] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:37 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:50:37.672989 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e9a75650-7777-44a8-9250-9f1528b82ea3 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:37.681473 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e9a75650-7777-44a8-9250-9f1528b82ea3 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.093642 Aug 25 05:50:37.682071 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1025/2087] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:50:37 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:50:38.681060 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d17b5035-f42e-40f5-8905-7916bb2b0675 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:38.681710 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d17b5035-f42e-40f5-8905-7916bb2b0675 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:38.688079 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d17b5035-f42e-40f5-8905-7916bb2b0675 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:38.688832 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d17b5035-f42e-40f5-8905-7916bb2b0675 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:38.690210 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d17b5035-f42e-40f5-8905-7916bb2b0675 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:38.690990 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d17b5035-f42e-40f5-8905-7916bb2b0675 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:38.699636 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3aef8fcf-b811-4487-8e75-d2f9ddc68abf tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:38.700253 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3aef8fcf-b811-4487-8e75-d2f9ddc68abf tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:38.706192 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3aef8fcf-b811-4487-8e75-d2f9ddc68abf tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:38.706634 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3aef8fcf-b811-4487-8e75-d2f9ddc68abf tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:38.707680 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3aef8fcf-b811-4487-8e75-d2f9ddc68abf tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:38.708127 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3aef8fcf-b811-4487-8e75-d2f9ddc68abf tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:38.782442 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d17b5035-f42e-40f5-8905-7916bb2b0675 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:38.784455 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-3aef8fcf-b811-4487-8e75-d2f9ddc68abf tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:38.791111 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d17b5035-f42e-40f5-8905-7916bb2b0675 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:38.792473 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3aef8fcf-b811-4487-8e75-d2f9ddc68abf tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.097455 Aug 25 05:50:38.792637 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d17b5035-f42e-40f5-8905-7916bb2b0675 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:38.793036 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1026/2088] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:50:38 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:50:38.793754 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d17b5035-f42e-40f5-8905-7916bb2b0675 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.116371 Aug 25 05:50:38.794299 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1063/2089] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:38 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:39.810375 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7c465f62-29f2-4684-9297-ce0bc90a7e44 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:39.810941 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7c465f62-29f2-4684-9297-ce0bc90a7e44 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:39.811174 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-eed703af-89dc-4814-be97-9de17710c1de tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:39.811799 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-eed703af-89dc-4814-be97-9de17710c1de tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:39.816853 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7c465f62-29f2-4684-9297-ce0bc90a7e44 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:39.817970 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7c465f62-29f2-4684-9297-ce0bc90a7e44 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:39.818098 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-eed703af-89dc-4814-be97-9de17710c1de tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:39.818551 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-eed703af-89dc-4814-be97-9de17710c1de tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:39.818752 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7c465f62-29f2-4684-9297-ce0bc90a7e44 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:39.819179 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7c465f62-29f2-4684-9297-ce0bc90a7e44 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:39.819361 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-eed703af-89dc-4814-be97-9de17710c1de tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:39.819805 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-eed703af-89dc-4814-be97-9de17710c1de tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:39.887495 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-eed703af-89dc-4814-be97-9de17710c1de tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:39.896327 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-eed703af-89dc-4814-be97-9de17710c1de tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:39.897849 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-eed703af-89dc-4814-be97-9de17710c1de tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:39.899240 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-eed703af-89dc-4814-be97-9de17710c1de tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.091761 Aug 25 05:50:39.900021 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1064/2090] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:39 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:50:39.902794 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-7c465f62-29f2-4684-9297-ce0bc90a7e44 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:39.910643 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7c465f62-29f2-4684-9297-ce0bc90a7e44 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1350 microversion: 2.1 time: 0.104374 Aug 25 05:50:39.911258 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1027/2091] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:50:39 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1350 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:50:40.917379 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-343cfa45-29dc-40ef-8b80-e2494833a343 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:40.917996 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-343cfa45-29dc-40ef-8b80-e2494833a343 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:40.924065 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-343cfa45-29dc-40ef-8b80-e2494833a343 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:40.924498 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-343cfa45-29dc-40ef-8b80-e2494833a343 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:40.925258 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-343cfa45-29dc-40ef-8b80-e2494833a343 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:40.925712 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-343cfa45-29dc-40ef-8b80-e2494833a343 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:40.927809 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-211258b3-a679-45c6-9fdf-f80ee35877dd tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:40.928427 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-211258b3-a679-45c6-9fdf-f80ee35877dd tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:40.934473 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-211258b3-a679-45c6-9fdf-f80ee35877dd tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:40.934945 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-211258b3-a679-45c6-9fdf-f80ee35877dd tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:40.935726 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-211258b3-a679-45c6-9fdf-f80ee35877dd tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:40.936161 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-211258b3-a679-45c6-9fdf-f80ee35877dd tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:40.969612 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-211258b3-a679-45c6-9fdf-f80ee35877dd tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:40.970155 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-211258b3-a679-45c6-9fdf-f80ee35877dd tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:40.970612 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.objects.instance [None req-211258b3-a679-45c6-9fdf-f80ee35877dd tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lazy-loading 'fault' on Instance uuid 8e74fcd5-99b3-4716-b064-182c7db61275 {{(pid=108884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 05:50:40.990996 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-343cfa45-29dc-40ef-8b80-e2494833a343 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:40.999721 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-343cfa45-29dc-40ef-8b80-e2494833a343 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:41.001202 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-343cfa45-29dc-40ef-8b80-e2494833a343 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:41.002339 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-343cfa45-29dc-40ef-8b80-e2494833a343 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.088825 Aug 25 05:50:41.002887 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1065/2092] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:40 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:50:41.194697 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-211258b3-a679-45c6-9fdf-f80ee35877dd tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e051ab404b4faeb147e4d373166c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbccb403957943839b2b9f0171b88d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:41.202951 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-211258b3-a679-45c6-9fdf-f80ee35877dd tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 200 len: 1444 microversion: 2.1 time: 0.278660 Aug 25 05:50:41.203532 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1028/2093] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:50:40 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 1444 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:50:42.020685 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-81ffd1d8-1d70-4b37-96df-4a2e9887ebb8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:42.021830 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-81ffd1d8-1d70-4b37-96df-4a2e9887ebb8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:42.027939 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-81ffd1d8-1d70-4b37-96df-4a2e9887ebb8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:42.028388 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-81ffd1d8-1d70-4b37-96df-4a2e9887ebb8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:42.029144 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-81ffd1d8-1d70-4b37-96df-4a2e9887ebb8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:42.029611 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-81ffd1d8-1d70-4b37-96df-4a2e9887ebb8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:42.090859 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-81ffd1d8-1d70-4b37-96df-4a2e9887ebb8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:42.099453 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-81ffd1d8-1d70-4b37-96df-4a2e9887ebb8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:42.101035 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-81ffd1d8-1d70-4b37-96df-4a2e9887ebb8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:42.102224 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-81ffd1d8-1d70-4b37-96df-4a2e9887ebb8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.085906 Aug 25 05:50:42.102806 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1066/2094] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:42 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:42.220084 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-604073f4-3625-4c5f-a100-a29fe38cd7d2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:42.220695 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-604073f4-3625-4c5f-a100-a29fe38cd7d2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] [instance: 8e74fcd5-99b3-4716-b064-182c7db61275] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:42.226926 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-604073f4-3625-4c5f-a100-a29fe38cd7d2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:42.227368 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-604073f4-3625-4c5f-a100-a29fe38cd7d2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:42.228129 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-604073f4-3625-4c5f-a100-a29fe38cd7d2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:42.228559 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-604073f4-3625-4c5f-a100-a29fe38cd7d2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:42.242613 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.wsgi [None req-604073f4-3625-4c5f-a100-a29fe38cd7d2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] HTTP exception thrown: Instance 8e74fcd5-99b3-4716-b064-182c7db61275 could not be found. Aug 25 05:50:42.243191 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-604073f4-3625-4c5f-a100-a29fe38cd7d2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] Returning 404 to user: Instance 8e74fcd5-99b3-4716-b064-182c7db61275 could not be found. {{(pid=108884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 05:50:42.244010 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-604073f4-3625-4c5f-a100-a29fe38cd7d2 tempest-VolumesSnapshotTestJSON-1547092374 tempest-VolumesSnapshotTestJSON-1547092374-project] 10.222.0.42 "GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275" status: 404 len: 111 microversion: 2.1 time: 0.027692 Aug 25 05:50:42.244533 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1029/2095] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:50:42 2021] GET /compute/v2.1/servers/8e74fcd5-99b3-4716-b064-182c7db61275 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:50:43.120027 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6dd5ee55-2bdf-4999-838e-274b34134408 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:43.120728 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6dd5ee55-2bdf-4999-838e-274b34134408 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:43.126854 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6dd5ee55-2bdf-4999-838e-274b34134408 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:43.127301 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6dd5ee55-2bdf-4999-838e-274b34134408 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:43.128067 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6dd5ee55-2bdf-4999-838e-274b34134408 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:43.128500 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6dd5ee55-2bdf-4999-838e-274b34134408 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:43.193263 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-6dd5ee55-2bdf-4999-838e-274b34134408 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:43.201792 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-6dd5ee55-2bdf-4999-838e-274b34134408 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:43.203283 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-6dd5ee55-2bdf-4999-838e-274b34134408 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:43.204406 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6dd5ee55-2bdf-4999-838e-274b34134408 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.088074 Aug 25 05:50:43.204957 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1067/2096] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:43 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:44.222918 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b50f7ab7-d1df-40b6-bf6e-7fd2371cb7ac tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:44.223463 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b50f7ab7-d1df-40b6-bf6e-7fd2371cb7ac tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:44.229417 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b50f7ab7-d1df-40b6-bf6e-7fd2371cb7ac tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:44.229877 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b50f7ab7-d1df-40b6-bf6e-7fd2371cb7ac tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:44.230625 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b50f7ab7-d1df-40b6-bf6e-7fd2371cb7ac tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:44.231050 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b50f7ab7-d1df-40b6-bf6e-7fd2371cb7ac tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:44.290341 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-b50f7ab7-d1df-40b6-bf6e-7fd2371cb7ac tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:44.298544 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-b50f7ab7-d1df-40b6-bf6e-7fd2371cb7ac tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:44.300018 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-b50f7ab7-d1df-40b6-bf6e-7fd2371cb7ac tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:44.301124 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b50f7ab7-d1df-40b6-bf6e-7fd2371cb7ac tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.081993 Aug 25 05:50:44.301698 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1030/2097] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:44 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:45.319344 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-73bd0323-d703-4d1e-9424-c87024f2d17c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:45.319946 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-73bd0323-d703-4d1e-9424-c87024f2d17c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:45.325793 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-73bd0323-d703-4d1e-9424-c87024f2d17c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:45.326235 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-73bd0323-d703-4d1e-9424-c87024f2d17c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:45.326987 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-73bd0323-d703-4d1e-9424-c87024f2d17c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:45.327416 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-73bd0323-d703-4d1e-9424-c87024f2d17c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:45.387682 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-73bd0323-d703-4d1e-9424-c87024f2d17c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:45.395847 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-73bd0323-d703-4d1e-9424-c87024f2d17c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:45.399431 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-73bd0323-d703-4d1e-9424-c87024f2d17c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:45.401455 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-73bd0323-d703-4d1e-9424-c87024f2d17c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.085766 Aug 25 05:50:45.402498 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1068/2098] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:45 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:46.420278 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-0504e9cf-15d2-4168-8977-b23bf63cdec4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:46.420828 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-0504e9cf-15d2-4168-8977-b23bf63cdec4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:46.426678 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0504e9cf-15d2-4168-8977-b23bf63cdec4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:46.427123 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0504e9cf-15d2-4168-8977-b23bf63cdec4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:46.428892 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0504e9cf-15d2-4168-8977-b23bf63cdec4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:46.429680 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0504e9cf-15d2-4168-8977-b23bf63cdec4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:46.492112 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-0504e9cf-15d2-4168-8977-b23bf63cdec4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:46.500342 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-0504e9cf-15d2-4168-8977-b23bf63cdec4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:46.501895 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-0504e9cf-15d2-4168-8977-b23bf63cdec4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:46.503004 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-0504e9cf-15d2-4168-8977-b23bf63cdec4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.086556 Aug 25 05:50:46.503552 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1031/2099] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:46 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:47.523736 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-42dd6a46-a51e-43bd-9777-b017813fce67 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:47.524283 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-42dd6a46-a51e-43bd-9777-b017813fce67 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:47.530078 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-42dd6a46-a51e-43bd-9777-b017813fce67 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:47.530520 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-42dd6a46-a51e-43bd-9777-b017813fce67 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:47.531269 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-42dd6a46-a51e-43bd-9777-b017813fce67 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:47.531692 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-42dd6a46-a51e-43bd-9777-b017813fce67 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:47.591832 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-42dd6a46-a51e-43bd-9777-b017813fce67 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:47.600154 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-42dd6a46-a51e-43bd-9777-b017813fce67 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:47.601703 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-42dd6a46-a51e-43bd-9777-b017813fce67 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:47.602816 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-42dd6a46-a51e-43bd-9777-b017813fce67 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.083727 Aug 25 05:50:47.603363 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1069/2100] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:47 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:48.620266 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-2066bf4c-c7c4-45bf-8568-1efc6ab4eefe tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:48.620869 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-2066bf4c-c7c4-45bf-8568-1efc6ab4eefe tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:48.626661 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2066bf4c-c7c4-45bf-8568-1efc6ab4eefe tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:48.627111 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2066bf4c-c7c4-45bf-8568-1efc6ab4eefe tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:48.627874 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2066bf4c-c7c4-45bf-8568-1efc6ab4eefe tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:48.628297 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2066bf4c-c7c4-45bf-8568-1efc6ab4eefe tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:48.687583 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-2066bf4c-c7c4-45bf-8568-1efc6ab4eefe tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:48.695838 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-2066bf4c-c7c4-45bf-8568-1efc6ab4eefe tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:48.698016 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-2066bf4c-c7c4-45bf-8568-1efc6ab4eefe tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:48.699165 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-2066bf4c-c7c4-45bf-8568-1efc6ab4eefe tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.082748 Aug 25 05:50:48.699703 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1032/2101] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:48 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:49.716917 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-eab7ff57-1b10-48c0-ba26-90fb06f158f4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:49.717497 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-eab7ff57-1b10-48c0-ba26-90fb06f158f4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:49.723372 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-eab7ff57-1b10-48c0-ba26-90fb06f158f4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:49.723809 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-eab7ff57-1b10-48c0-ba26-90fb06f158f4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:49.724559 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-eab7ff57-1b10-48c0-ba26-90fb06f158f4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:49.724985 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-eab7ff57-1b10-48c0-ba26-90fb06f158f4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:49.785331 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-eab7ff57-1b10-48c0-ba26-90fb06f158f4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:49.793961 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-eab7ff57-1b10-48c0-ba26-90fb06f158f4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:49.795386 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-eab7ff57-1b10-48c0-ba26-90fb06f158f4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:49.796501 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-eab7ff57-1b10-48c0-ba26-90fb06f158f4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.083295 Aug 25 05:50:49.797054 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1070/2102] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:49 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:50.815498 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ea2731ad-f28e-422f-a778-d78acec7a4ee tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:50.816147 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ea2731ad-f28e-422f-a778-d78acec7a4ee tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:50.822621 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ea2731ad-f28e-422f-a778-d78acec7a4ee tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:50.823069 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ea2731ad-f28e-422f-a778-d78acec7a4ee tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:50.823825 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ea2731ad-f28e-422f-a778-d78acec7a4ee tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:50.824258 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ea2731ad-f28e-422f-a778-d78acec7a4ee tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:50.885637 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ea2731ad-f28e-422f-a778-d78acec7a4ee tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:50.893860 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ea2731ad-f28e-422f-a778-d78acec7a4ee tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:50.895363 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ea2731ad-f28e-422f-a778-d78acec7a4ee tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:50.896489 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ea2731ad-f28e-422f-a778-d78acec7a4ee tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.084839 Aug 25 05:50:50.897048 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1033/2103] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:50 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:51.915572 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d2b0d040-b435-433f-8e9c-7ac26a26db6d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:51.916188 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d2b0d040-b435-433f-8e9c-7ac26a26db6d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:51.922050 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d2b0d040-b435-433f-8e9c-7ac26a26db6d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:51.922491 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d2b0d040-b435-433f-8e9c-7ac26a26db6d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:51.923249 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d2b0d040-b435-433f-8e9c-7ac26a26db6d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:51.923673 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d2b0d040-b435-433f-8e9c-7ac26a26db6d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:51.982937 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d2b0d040-b435-433f-8e9c-7ac26a26db6d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:51.991056 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d2b0d040-b435-433f-8e9c-7ac26a26db6d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:51.992564 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d2b0d040-b435-433f-8e9c-7ac26a26db6d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:51.994588 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d2b0d040-b435-433f-8e9c-7ac26a26db6d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.083080 Aug 25 05:50:51.995132 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1071/2104] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:51 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:53.012897 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-52e98c3f-0cc9-4e43-ae0f-cde99078e9c8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:53.013709 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-52e98c3f-0cc9-4e43-ae0f-cde99078e9c8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:53.019818 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-52e98c3f-0cc9-4e43-ae0f-cde99078e9c8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:53.020268 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-52e98c3f-0cc9-4e43-ae0f-cde99078e9c8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:53.021028 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-52e98c3f-0cc9-4e43-ae0f-cde99078e9c8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:53.021459 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-52e98c3f-0cc9-4e43-ae0f-cde99078e9c8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:53.085646 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-52e98c3f-0cc9-4e43-ae0f-cde99078e9c8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:53.095096 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-52e98c3f-0cc9-4e43-ae0f-cde99078e9c8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:53.097009 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-52e98c3f-0cc9-4e43-ae0f-cde99078e9c8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:53.098186 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-52e98c3f-0cc9-4e43-ae0f-cde99078e9c8 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.089604 Aug 25 05:50:53.098748 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1034/2105] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:53 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:54.116320 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b9b32969-d5aa-442a-ac91-7db76c609638 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:54.116998 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b9b32969-d5aa-442a-ac91-7db76c609638 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:54.123422 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b9b32969-d5aa-442a-ac91-7db76c609638 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:54.123852 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b9b32969-d5aa-442a-ac91-7db76c609638 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:54.124604 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b9b32969-d5aa-442a-ac91-7db76c609638 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:54.125026 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b9b32969-d5aa-442a-ac91-7db76c609638 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:54.186394 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-b9b32969-d5aa-442a-ac91-7db76c609638 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:54.194461 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-b9b32969-d5aa-442a-ac91-7db76c609638 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:54.195942 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-b9b32969-d5aa-442a-ac91-7db76c609638 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:54.197068 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b9b32969-d5aa-442a-ac91-7db76c609638 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.084560 Aug 25 05:50:54.197642 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1072/2106] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:54 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:55.216252 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-df988a2f-e38a-4a0d-aa03-c2cc9c36a78e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:55.216893 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-df988a2f-e38a-4a0d-aa03-c2cc9c36a78e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:55.222899 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-df988a2f-e38a-4a0d-aa03-c2cc9c36a78e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:55.223350 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-df988a2f-e38a-4a0d-aa03-c2cc9c36a78e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:55.224112 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-df988a2f-e38a-4a0d-aa03-c2cc9c36a78e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:55.224545 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-df988a2f-e38a-4a0d-aa03-c2cc9c36a78e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:55.284501 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-df988a2f-e38a-4a0d-aa03-c2cc9c36a78e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:55.292790 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-df988a2f-e38a-4a0d-aa03-c2cc9c36a78e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:55.294304 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-df988a2f-e38a-4a0d-aa03-c2cc9c36a78e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:55.295433 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-df988a2f-e38a-4a0d-aa03-c2cc9c36a78e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.083607 Aug 25 05:50:55.295981 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1035/2107] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:55 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:55.856433 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 05:50:55.856673 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: Wed Aug 25 05:50:55 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 05:50:56.313292 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d053bc39-1ee2-4144-bec3-25fb9e3b8926 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:56.313951 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d053bc39-1ee2-4144-bec3-25fb9e3b8926 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:56.319766 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d053bc39-1ee2-4144-bec3-25fb9e3b8926 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:56.320212 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d053bc39-1ee2-4144-bec3-25fb9e3b8926 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:56.321469 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d053bc39-1ee2-4144-bec3-25fb9e3b8926 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:56.322152 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d053bc39-1ee2-4144-bec3-25fb9e3b8926 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:56.381831 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d053bc39-1ee2-4144-bec3-25fb9e3b8926 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:56.391038 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d053bc39-1ee2-4144-bec3-25fb9e3b8926 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:56.392522 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d053bc39-1ee2-4144-bec3-25fb9e3b8926 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:56.393670 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d053bc39-1ee2-4144-bec3-25fb9e3b8926 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.084057 Aug 25 05:50:56.394223 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1073/2108] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:56 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:57.411192 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-251eb66e-53fe-466b-9851-0c09be3e4621 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:57.411782 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-251eb66e-53fe-466b-9851-0c09be3e4621 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:57.417759 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-251eb66e-53fe-466b-9851-0c09be3e4621 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:57.418200 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-251eb66e-53fe-466b-9851-0c09be3e4621 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:57.418951 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-251eb66e-53fe-466b-9851-0c09be3e4621 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:57.419375 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-251eb66e-53fe-466b-9851-0c09be3e4621 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:57.480687 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-251eb66e-53fe-466b-9851-0c09be3e4621 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:57.488929 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-251eb66e-53fe-466b-9851-0c09be3e4621 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:57.490446 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-251eb66e-53fe-466b-9851-0c09be3e4621 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:57.491563 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-251eb66e-53fe-466b-9851-0c09be3e4621 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.084151 Aug 25 05:50:57.492116 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1036/2109] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:57 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:58.509948 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-252d289e-0080-4dfb-9e1b-98a592a375e6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:58.510503 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-252d289e-0080-4dfb-9e1b-98a592a375e6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:58.516408 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-252d289e-0080-4dfb-9e1b-98a592a375e6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:58.516851 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-252d289e-0080-4dfb-9e1b-98a592a375e6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:58.517637 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-252d289e-0080-4dfb-9e1b-98a592a375e6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:58.518064 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-252d289e-0080-4dfb-9e1b-98a592a375e6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:58.579298 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-252d289e-0080-4dfb-9e1b-98a592a375e6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:58.588027 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-252d289e-0080-4dfb-9e1b-98a592a375e6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:58.589548 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-252d289e-0080-4dfb-9e1b-98a592a375e6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:58.590767 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-252d289e-0080-4dfb-9e1b-98a592a375e6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.084565 Aug 25 05:50:58.591315 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1074/2110] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:58 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:50:59.608592 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3726e3e5-59e9-4415-8524-6e6e0d75e108 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:50:59.609186 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3726e3e5-59e9-4415-8524-6e6e0d75e108 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:50:59.615187 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3726e3e5-59e9-4415-8524-6e6e0d75e108 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:59.615623 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3726e3e5-59e9-4415-8524-6e6e0d75e108 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:59.616374 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3726e3e5-59e9-4415-8524-6e6e0d75e108 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:50:59.616798 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3726e3e5-59e9-4415-8524-6e6e0d75e108 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:50:59.909927 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-3726e3e5-59e9-4415-8524-6e6e0d75e108 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:59.919878 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-3726e3e5-59e9-4415-8524-6e6e0d75e108 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:59.921361 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-3726e3e5-59e9-4415-8524-6e6e0d75e108 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:50:59.922531 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3726e3e5-59e9-4415-8524-6e6e0d75e108 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.317859 Aug 25 05:50:59.923080 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1037/2111] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:50:59 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:51:00.940489 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e9acecf1-81b7-44b1-9c28-b697ec9ff23d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:51:00.941092 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e9acecf1-81b7-44b1-9c28-b697ec9ff23d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:00.947407 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e9acecf1-81b7-44b1-9c28-b697ec9ff23d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:00.947850 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e9acecf1-81b7-44b1-9c28-b697ec9ff23d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:00.948613 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e9acecf1-81b7-44b1-9c28-b697ec9ff23d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:00.949041 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e9acecf1-81b7-44b1-9c28-b697ec9ff23d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:01.008051 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-e9acecf1-81b7-44b1-9c28-b697ec9ff23d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:01.016625 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-e9acecf1-81b7-44b1-9c28-b697ec9ff23d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:01.018143 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-e9acecf1-81b7-44b1-9c28-b697ec9ff23d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:01.019248 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e9acecf1-81b7-44b1-9c28-b697ec9ff23d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.082397 Aug 25 05:51:01.019835 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1075/2112] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:51:00 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:51:02.141483 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1d88699e-8b90-47fc-8d97-6d1a72938365 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:51:02.142119 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1d88699e-8b90-47fc-8d97-6d1a72938365 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:02.147968 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1d88699e-8b90-47fc-8d97-6d1a72938365 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:02.148664 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1d88699e-8b90-47fc-8d97-6d1a72938365 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:02.149415 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1d88699e-8b90-47fc-8d97-6d1a72938365 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:02.150027 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1d88699e-8b90-47fc-8d97-6d1a72938365 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:02.210426 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-1d88699e-8b90-47fc-8d97-6d1a72938365 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:02.219414 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-1d88699e-8b90-47fc-8d97-6d1a72938365 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:02.220910 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-1d88699e-8b90-47fc-8d97-6d1a72938365 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:02.222069 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1d88699e-8b90-47fc-8d97-6d1a72938365 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.187651 Aug 25 05:51:02.222627 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1038/2113] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:51:02 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:51:03.217655 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 05:51:03.218197 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: Wed Aug 25 05:51:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 05:51:03.240277 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ebff8382-15ea-4757-84a9-e4f037c941aa tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:51:03.240885 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ebff8382-15ea-4757-84a9-e4f037c941aa tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:03.247053 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ebff8382-15ea-4757-84a9-e4f037c941aa tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:03.247522 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ebff8382-15ea-4757-84a9-e4f037c941aa tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:03.248282 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ebff8382-15ea-4757-84a9-e4f037c941aa tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:03.248709 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ebff8382-15ea-4757-84a9-e4f037c941aa tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:03.308190 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ebff8382-15ea-4757-84a9-e4f037c941aa tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:03.316720 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ebff8382-15ea-4757-84a9-e4f037c941aa tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:03.318237 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ebff8382-15ea-4757-84a9-e4f037c941aa tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:03.319348 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ebff8382-15ea-4757-84a9-e4f037c941aa tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.082751 Aug 25 05:51:03.319900 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1076/2114] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:51:03 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:51:04.337170 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-0d068593-ee03-4a14-8661-ff4efc88bcdd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:51:04.337813 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-0d068593-ee03-4a14-8661-ff4efc88bcdd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:04.343756 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0d068593-ee03-4a14-8661-ff4efc88bcdd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:04.344189 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0d068593-ee03-4a14-8661-ff4efc88bcdd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:04.344936 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0d068593-ee03-4a14-8661-ff4efc88bcdd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:04.345354 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0d068593-ee03-4a14-8661-ff4efc88bcdd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:04.408547 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-0d068593-ee03-4a14-8661-ff4efc88bcdd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:04.417458 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-0d068593-ee03-4a14-8661-ff4efc88bcdd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:04.419098 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-0d068593-ee03-4a14-8661-ff4efc88bcdd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:04.420203 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-0d068593-ee03-4a14-8661-ff4efc88bcdd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.086740 Aug 25 05:51:04.423366 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1039/2115] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:51:04 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:51:05.438295 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-aca9c681-17c1-41ec-bdc4-65abd2bb4953 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:51:05.438850 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-aca9c681-17c1-41ec-bdc4-65abd2bb4953 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:05.444529 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-aca9c681-17c1-41ec-bdc4-65abd2bb4953 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:05.444969 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-aca9c681-17c1-41ec-bdc4-65abd2bb4953 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:05.445746 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-aca9c681-17c1-41ec-bdc4-65abd2bb4953 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:05.446174 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-aca9c681-17c1-41ec-bdc4-65abd2bb4953 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:05.505358 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-aca9c681-17c1-41ec-bdc4-65abd2bb4953 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:05.514767 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-aca9c681-17c1-41ec-bdc4-65abd2bb4953 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:05.516295 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-aca9c681-17c1-41ec-bdc4-65abd2bb4953 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:05.517458 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-aca9c681-17c1-41ec-bdc4-65abd2bb4953 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.082908 Aug 25 05:51:05.518042 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1077/2116] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:51:05 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:51:06.536030 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-af12e54c-34db-406f-8863-5189c99765cf tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:51:06.536663 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-af12e54c-34db-406f-8863-5189c99765cf tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:06.542944 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-af12e54c-34db-406f-8863-5189c99765cf tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:06.543383 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-af12e54c-34db-406f-8863-5189c99765cf tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:06.544145 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-af12e54c-34db-406f-8863-5189c99765cf tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:06.544623 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-af12e54c-34db-406f-8863-5189c99765cf tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:06.609622 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-af12e54c-34db-406f-8863-5189c99765cf tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:06.623432 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-af12e54c-34db-406f-8863-5189c99765cf tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:06.624919 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-af12e54c-34db-406f-8863-5189c99765cf tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:06.626071 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-af12e54c-34db-406f-8863-5189c99765cf tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.093787 Aug 25 05:51:06.626626 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1040/2117] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:51:06 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:51:07.644171 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7bc2c50d-f335-435b-82c7-a05d200cf8fa tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:51:07.644775 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-7bc2c50d-f335-435b-82c7-a05d200cf8fa tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:07.651550 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7bc2c50d-f335-435b-82c7-a05d200cf8fa tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:07.651990 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7bc2c50d-f335-435b-82c7-a05d200cf8fa tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:07.652748 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7bc2c50d-f335-435b-82c7-a05d200cf8fa tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:07.653176 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7bc2c50d-f335-435b-82c7-a05d200cf8fa tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:07.711456 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-7bc2c50d-f335-435b-82c7-a05d200cf8fa tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:07.720550 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-7bc2c50d-f335-435b-82c7-a05d200cf8fa tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:07.722891 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-7bc2c50d-f335-435b-82c7-a05d200cf8fa tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:07.723206 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-7bc2c50d-f335-435b-82c7-a05d200cf8fa tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.082764 Aug 25 05:51:07.723764 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1078/2118] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:51:07 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:51:08.742164 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-2368b14b-e534-4561-915a-393b53b12f76 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:51:08.742766 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-2368b14b-e534-4561-915a-393b53b12f76 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:08.749421 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2368b14b-e534-4561-915a-393b53b12f76 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:08.749886 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2368b14b-e534-4561-915a-393b53b12f76 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:08.750632 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2368b14b-e534-4561-915a-393b53b12f76 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:08.751058 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2368b14b-e534-4561-915a-393b53b12f76 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:08.809859 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-2368b14b-e534-4561-915a-393b53b12f76 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:08.818139 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-2368b14b-e534-4561-915a-393b53b12f76 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:08.819627 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-2368b14b-e534-4561-915a-393b53b12f76 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:08.820735 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-2368b14b-e534-4561-915a-393b53b12f76 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.082394 Aug 25 05:51:08.821278 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1041/2119] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:51:08 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:51:09.838534 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a6e67744-e910-4a18-8b45-d5f0dd0d34cd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:51:09.839232 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a6e67744-e910-4a18-8b45-d5f0dd0d34cd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:09.845073 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a6e67744-e910-4a18-8b45-d5f0dd0d34cd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:09.845508 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a6e67744-e910-4a18-8b45-d5f0dd0d34cd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:09.846278 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a6e67744-e910-4a18-8b45-d5f0dd0d34cd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:09.846706 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a6e67744-e910-4a18-8b45-d5f0dd0d34cd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:09.905427 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-a6e67744-e910-4a18-8b45-d5f0dd0d34cd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:09.913610 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-a6e67744-e910-4a18-8b45-d5f0dd0d34cd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:09.915088 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-a6e67744-e910-4a18-8b45-d5f0dd0d34cd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:09.916226 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a6e67744-e910-4a18-8b45-d5f0dd0d34cd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.081411 Aug 25 05:51:09.916765 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1079/2120] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:51:09 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:51:10.934517 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-28f3b739-5269-40a8-8875-49eca49e6db0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:51:10.935128 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-28f3b739-5269-40a8-8875-49eca49e6db0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:10.940968 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-28f3b739-5269-40a8-8875-49eca49e6db0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:10.941409 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-28f3b739-5269-40a8-8875-49eca49e6db0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:10.942191 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-28f3b739-5269-40a8-8875-49eca49e6db0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:10.942620 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-28f3b739-5269-40a8-8875-49eca49e6db0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:11.004719 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-28f3b739-5269-40a8-8875-49eca49e6db0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:11.012783 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-28f3b739-5269-40a8-8875-49eca49e6db0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:11.014307 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-28f3b739-5269-40a8-8875-49eca49e6db0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:11.015417 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-28f3b739-5269-40a8-8875-49eca49e6db0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.085286 Aug 25 05:51:11.015973 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1042/2121] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:51:10 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:51:12.033163 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-8fb531b7-b9ba-4e49-9b8e-b0316e2c6225 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:51:12.033784 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-8fb531b7-b9ba-4e49-9b8e-b0316e2c6225 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:12.039758 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8fb531b7-b9ba-4e49-9b8e-b0316e2c6225 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:12.040215 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8fb531b7-b9ba-4e49-9b8e-b0316e2c6225 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:12.040986 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8fb531b7-b9ba-4e49-9b8e-b0316e2c6225 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:12.041422 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8fb531b7-b9ba-4e49-9b8e-b0316e2c6225 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:12.103010 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-8fb531b7-b9ba-4e49-9b8e-b0316e2c6225 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:12.117053 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-8fb531b7-b9ba-4e49-9b8e-b0316e2c6225 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:12.118555 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-8fb531b7-b9ba-4e49-9b8e-b0316e2c6225 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:12.119672 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-8fb531b7-b9ba-4e49-9b8e-b0316e2c6225 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.090558 Aug 25 05:51:12.120222 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1080/2122] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:51:12 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:51:13.138788 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-90624e76-0c5d-4b18-98ff-23ee49bc4804 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:51:13.140010 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-90624e76-0c5d-4b18-98ff-23ee49bc4804 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:13.146087 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-90624e76-0c5d-4b18-98ff-23ee49bc4804 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:13.146528 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-90624e76-0c5d-4b18-98ff-23ee49bc4804 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:13.147281 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-90624e76-0c5d-4b18-98ff-23ee49bc4804 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:13.147711 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-90624e76-0c5d-4b18-98ff-23ee49bc4804 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:13.208755 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-90624e76-0c5d-4b18-98ff-23ee49bc4804 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:13.217207 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-90624e76-0c5d-4b18-98ff-23ee49bc4804 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:13.219654 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-90624e76-0c5d-4b18-98ff-23ee49bc4804 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:13.220862 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-90624e76-0c5d-4b18-98ff-23ee49bc4804 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.085837 Aug 25 05:51:13.221410 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1043/2123] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:51:13 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:51:14.240147 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1f3d0c8f-db57-455f-858b-500a7ca6abed tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:51:14.240774 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1f3d0c8f-db57-455f-858b-500a7ca6abed tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:14.246705 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1f3d0c8f-db57-455f-858b-500a7ca6abed tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:14.247239 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1f3d0c8f-db57-455f-858b-500a7ca6abed tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:14.247943 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1f3d0c8f-db57-455f-858b-500a7ca6abed tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:14.248375 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1f3d0c8f-db57-455f-858b-500a7ca6abed tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:14.308044 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-1f3d0c8f-db57-455f-858b-500a7ca6abed tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:14.316885 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-1f3d0c8f-db57-455f-858b-500a7ca6abed tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:14.318582 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-1f3d0c8f-db57-455f-858b-500a7ca6abed tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:14.319718 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1f3d0c8f-db57-455f-858b-500a7ca6abed tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.083331 Aug 25 05:51:14.320266 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1081/2124] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:51:14 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:51:15.337300 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-67bda923-e0d1-4d03-8346-d9facb06b988 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:51:15.338003 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-67bda923-e0d1-4d03-8346-d9facb06b988 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:15.344471 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-67bda923-e0d1-4d03-8346-d9facb06b988 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:15.344915 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-67bda923-e0d1-4d03-8346-d9facb06b988 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:15.345762 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-67bda923-e0d1-4d03-8346-d9facb06b988 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:15.346191 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-67bda923-e0d1-4d03-8346-d9facb06b988 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:15.406241 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-67bda923-e0d1-4d03-8346-d9facb06b988 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:15.414454 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-67bda923-e0d1-4d03-8346-d9facb06b988 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:15.415956 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-67bda923-e0d1-4d03-8346-d9facb06b988 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:15.417147 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-67bda923-e0d1-4d03-8346-d9facb06b988 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.083537 Aug 25 05:51:15.417721 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1044/2125] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:51:15 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:51:16.435515 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-aa836885-dfdd-4a39-a3c5-62c0b6d4cc82 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:51:16.436123 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-aa836885-dfdd-4a39-a3c5-62c0b6d4cc82 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:16.442626 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-aa836885-dfdd-4a39-a3c5-62c0b6d4cc82 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:16.443062 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-aa836885-dfdd-4a39-a3c5-62c0b6d4cc82 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:16.443805 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-aa836885-dfdd-4a39-a3c5-62c0b6d4cc82 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:16.444229 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-aa836885-dfdd-4a39-a3c5-62c0b6d4cc82 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:16.503194 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-aa836885-dfdd-4a39-a3c5-62c0b6d4cc82 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:16.511302 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-aa836885-dfdd-4a39-a3c5-62c0b6d4cc82 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:16.512790 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-aa836885-dfdd-4a39-a3c5-62c0b6d4cc82 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:16.513931 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-aa836885-dfdd-4a39-a3c5-62c0b6d4cc82 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.082099 Aug 25 05:51:16.514472 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1082/2126] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:51:16 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:51:17.532876 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ad8c1b56-bdc4-4015-8a10-fcf0115a1246 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:51:17.534354 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ad8c1b56-bdc4-4015-8a10-fcf0115a1246 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:17.540296 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ad8c1b56-bdc4-4015-8a10-fcf0115a1246 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:17.540737 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ad8c1b56-bdc4-4015-8a10-fcf0115a1246 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:17.541512 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ad8c1b56-bdc4-4015-8a10-fcf0115a1246 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:17.541965 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ad8c1b56-bdc4-4015-8a10-fcf0115a1246 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:17.604423 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ad8c1b56-bdc4-4015-8a10-fcf0115a1246 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:17.613174 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ad8c1b56-bdc4-4015-8a10-fcf0115a1246 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:17.614734 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ad8c1b56-bdc4-4015-8a10-fcf0115a1246 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:17.615854 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ad8c1b56-bdc4-4015-8a10-fcf0115a1246 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1444 microversion: 2.20 time: 0.086876 Aug 25 05:51:17.616405 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1045/2127] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:51:17 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:51:18.633655 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ff376127-f5e7-49d0-800f-dd549fd99213 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:51:18.634249 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ff376127-f5e7-49d0-800f-dd549fd99213 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:18.640132 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ff376127-f5e7-49d0-800f-dd549fd99213 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:18.640572 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ff376127-f5e7-49d0-800f-dd549fd99213 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:18.641336 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ff376127-f5e7-49d0-800f-dd549fd99213 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:18.641785 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ff376127-f5e7-49d0-800f-dd549fd99213 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:18.674123 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ff376127-f5e7-49d0-800f-dd549fd99213 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:18.674797 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ff376127-f5e7-49d0-800f-dd549fd99213 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:18.675253 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.objects.instance [None req-ff376127-f5e7-49d0-800f-dd549fd99213 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lazy-loading 'fault' on Instance uuid 4cb635d4-76ba-4143-8f4d-a64c720966da {{(pid=108885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 05:51:18.715964 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ff376127-f5e7-49d0-800f-dd549fd99213 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:18.724717 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ff376127-f5e7-49d0-800f-dd549fd99213 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:18.726279 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ff376127-f5e7-49d0-800f-dd549fd99213 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:18.731684 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ff376127-f5e7-49d0-800f-dd549fd99213 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 200 len: 1538 microversion: 2.20 time: 0.097432 Aug 25 05:51:18.731684 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1083/2128] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:51:18 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 1538 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:51:19.746768 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1b2f5913-ed83-40b3-a992-15a2353fff65 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:51:19.747154 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1b2f5913-ed83-40b3-a992-15a2353fff65 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:19.754475 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1b2f5913-ed83-40b3-a992-15a2353fff65 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:19.755335 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1b2f5913-ed83-40b3-a992-15a2353fff65 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:19.756129 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1b2f5913-ed83-40b3-a992-15a2353fff65 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:19.756748 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1b2f5913-ed83-40b3-a992-15a2353fff65 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:19.770462 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.wsgi [None req-1b2f5913-ed83-40b3-a992-15a2353fff65 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] HTTP exception thrown: Instance 4cb635d4-76ba-4143-8f4d-a64c720966da could not be found. Aug 25 05:51:19.771039 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1b2f5913-ed83-40b3-a992-15a2353fff65 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Returning 404 to user: Instance 4cb635d4-76ba-4143-8f4d-a64c720966da could not be found. {{(pid=108884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 05:51:19.771859 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1b2f5913-ed83-40b3-a992-15a2353fff65 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 404 len: 111 microversion: 2.20 time: 0.029368 Aug 25 05:51:19.772382 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1046/2129] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:51:19 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 05:51:19.780936 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1c8c4246-0f27-440d-8ad8-7d31e36e79c3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '.version_select at 0x7f91064b6280>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:51:19.851601 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1c8c4246-0f27-440d-8ad8-7d31e36e79c3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-468200782" status: 204 len: 0 microversion: 2.20 time: 0.074143 Aug 25 05:51:19.852103 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1084/2130] 10.222.0.42 () {60 vars in 1259 bytes} [Wed Aug 25 05:51:19 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-468200782 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 05:51:20.856472 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e4442b89-3671-4839-b39e-6e30041d185f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'create', calling method: .version_select at 0x7f9106ca34c0>, body: {"keypair": {"name": "tempest-keypair-726273703"}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:51:20.877492 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.quota [None req-e4442b89-3671-4839-b39e-6e30041d185f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Getting quotas for project 8f18a68581ee4e5aa24440a7fd0389e3. Resources: {'key_pairs'} {{(pid=108884) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 05:51:20.881473 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.quota [None req-e4442b89-3671-4839-b39e-6e30041d185f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Getting quotas for user 416c753d158d492aba49e3e71db337f0 and project 8f18a68581ee4e5aa24440a7fd0389e3. Resources: {'key_pairs'} {{(pid=108884) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 05:51:21.082424 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.quota [None req-e4442b89-3671-4839-b39e-6e30041d185f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Getting quotas for project 8f18a68581ee4e5aa24440a7fd0389e3. Resources: {'key_pairs'} {{(pid=108884) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 05:51:21.086035 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.quota [None req-e4442b89-3671-4839-b39e-6e30041d185f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Getting quotas for user 416c753d158d492aba49e3e71db337f0 and project 8f18a68581ee4e5aa24440a7fd0389e3. Resources: {'key_pairs'} {{(pid=108884) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 05:51:21.099091 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e4442b89-3671-4839-b39e-6e30041d185f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.246357 Aug 25 05:51:21.099692 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1047/2131] 10.222.0.42 () {62 vars in 1199 bytes} [Wed Aug 25 05:51:20 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 248 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Aug 25 05:51:23.497628 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5eb083e3-f9f8-4e1d-8a07-5a6842317697 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1416710251", "imageRef": "05da2439-78f2-405c-b60a-89671b21a373", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dab4c80c-fdc3-4a74-bd40-de374e58701b"}], "security_groups": [{"name": "tempest-securitygroup--11334483"}], "key_name": "tempest-keypair-726273703", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:51:23.590377 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.network.neutron [None req-5eb083e3-f9f8-4e1d-8a07-5a6842317697 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] validate_networks() for [('dab4c80c-fdc3-4a74-bd40-de374e58701b', None, None, None, None, None)] {{(pid=108885) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 25 05:51:24.018210 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-5eb083e3-f9f8-4e1d-8a07-5a6842317697 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Flavor limits 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 05:51:24.018646 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-5eb083e3-f9f8-4e1d-8a07-5a6842317697 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Image limits 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 05:51:24.019213 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-5eb083e3-f9f8-4e1d-8a07-5a6842317697 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Flavor pref 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 05:51:24.019621 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-5eb083e3-f9f8-4e1d-8a07-5a6842317697 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Image pref 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 05:51:24.020027 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-5eb083e3-f9f8-4e1d-8a07-5a6842317697 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 05:51:24.028975 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5eb083e3-f9f8-4e1d-8a07-5a6842317697 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:24.029415 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5eb083e3-f9f8-4e1d-8a07-5a6842317697 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:24.030232 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5eb083e3-f9f8-4e1d-8a07-5a6842317697 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:24.030663 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5eb083e3-f9f8-4e1d-8a07-5a6842317697 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:24.046495 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.quota [None req-5eb083e3-f9f8-4e1d-8a07-5a6842317697 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Getting quotas for project 8f18a68581ee4e5aa24440a7fd0389e3. Resources: {'ram', 'cores', 'instances'} {{(pid=108885) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 05:51:24.050790 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.quota [None req-5eb083e3-f9f8-4e1d-8a07-5a6842317697 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Getting quotas for user 416c753d158d492aba49e3e71db337f0 and project 8f18a68581ee4e5aa24440a7fd0389e3. Resources: {'ram', 'cores', 'instances'} {{(pid=108885) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 05:51:24.061180 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5eb083e3-f9f8-4e1d-8a07-5a6842317697 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Going to run 1 instances... {{(pid=108885) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 25 05:51:24.063512 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5eb083e3-f9f8-4e1d-8a07-5a6842317697 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05da2439-78f2-405c-b60a-89671b21a373',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 25 05:51:24.178947 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5eb083e3-f9f8-4e1d-8a07-5a6842317697 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.685345 Aug 25 05:51:24.182016 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1085/2132] 10.222.0.42 () {62 vars in 1188 bytes} [Wed Aug 25 05:51:23 2021] POST /compute/v2.1/servers => generated 400 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 25 05:51:24.191640 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3e6dc2c6-6168-4443-aafc-1a97e6bfec0c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:51:24.192248 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3e6dc2c6-6168-4443-aafc-1a97e6bfec0c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:24.244304 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-3e6dc2c6-6168-4443-aafc-1a97e6bfec0c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:24.253942 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-3e6dc2c6-6168-4443-aafc-1a97e6bfec0c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:24.255120 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-3e6dc2c6-6168-4443-aafc-1a97e6bfec0c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:24.256194 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3e6dc2c6-6168-4443-aafc-1a97e6bfec0c tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1" status: 200 len: 1281 microversion: 2.20 time: 0.069404 Aug 25 05:51:24.256737 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1048/2133] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:51:24 2021] GET /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1 => generated 1281 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:51:25.280328 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-049ae90d-c5bf-4a2c-9458-1528efc03d40 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:51:25.280950 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-049ae90d-c5bf-4a2c-9458-1528efc03d40 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:25.288749 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-049ae90d-c5bf-4a2c-9458-1528efc03d40 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:25.288749 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-049ae90d-c5bf-4a2c-9458-1528efc03d40 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:25.289020 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-049ae90d-c5bf-4a2c-9458-1528efc03d40 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:25.289275 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-049ae90d-c5bf-4a2c-9458-1528efc03d40 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:25.350295 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-049ae90d-c5bf-4a2c-9458-1528efc03d40 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:25.357944 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-049ae90d-c5bf-4a2c-9458-1528efc03d40 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:25.359416 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-049ae90d-c5bf-4a2c-9458-1528efc03d40 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:25.360493 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-049ae90d-c5bf-4a2c-9458-1528efc03d40 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1" status: 200 len: 1285 microversion: 2.20 time: 0.083970 Aug 25 05:51:25.361383 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1086/2134] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:51:25 2021] GET /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1 => generated 1285 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:51:26.378553 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c292a98b-11d2-43eb-9c60-409dcbfeb736 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:51:26.379196 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c292a98b-11d2-43eb-9c60-409dcbfeb736 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:26.385310 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c292a98b-11d2-43eb-9c60-409dcbfeb736 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:26.385951 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c292a98b-11d2-43eb-9c60-409dcbfeb736 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:26.390013 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c292a98b-11d2-43eb-9c60-409dcbfeb736 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:26.390013 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c292a98b-11d2-43eb-9c60-409dcbfeb736 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:26.448364 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-c292a98b-11d2-43eb-9c60-409dcbfeb736 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:26.457008 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-c292a98b-11d2-43eb-9c60-409dcbfeb736 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:26.458535 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-c292a98b-11d2-43eb-9c60-409dcbfeb736 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:26.459641 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c292a98b-11d2-43eb-9c60-409dcbfeb736 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1" status: 200 len: 1339 microversion: 2.20 time: 0.084852 Aug 25 05:51:26.460196 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1049/2135] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:51:26 2021] GET /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1 => generated 1339 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:51:27.477690 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-66e29a8f-d0e9-4ace-b2b2-54ad6657d6d5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:51:27.478292 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-66e29a8f-d0e9-4ace-b2b2-54ad6657d6d5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:27.484633 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-66e29a8f-d0e9-4ace-b2b2-54ad6657d6d5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:27.485291 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-66e29a8f-d0e9-4ace-b2b2-54ad6657d6d5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:27.485901 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-66e29a8f-d0e9-4ace-b2b2-54ad6657d6d5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:27.486894 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-66e29a8f-d0e9-4ace-b2b2-54ad6657d6d5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:27.620828 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-66e29a8f-d0e9-4ace-b2b2-54ad6657d6d5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:27.630550 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-66e29a8f-d0e9-4ace-b2b2-54ad6657d6d5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:27.632310 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-66e29a8f-d0e9-4ace-b2b2-54ad6657d6d5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:27.633424 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-66e29a8f-d0e9-4ace-b2b2-54ad6657d6d5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1" status: 200 len: 1405 microversion: 2.20 time: 0.159525 Aug 25 05:51:27.634144 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1087/2136] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:51:27 2021] GET /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1 => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:51:27.980183 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [req-e7655277-6ec2-4680-88b3-f19bcd40ef1d req-fec3c82d-768c-4040-8623-ce000d41a166 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33e42717-0f3f-48eb-b4ba-78bcdc85dca1", "tag": "c9434a00-cf73-4905-8e81-82fdd59b276f"}]} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:51:27.981699 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:51:27.981699 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: warnings.warn(msg) Aug 25 05:51:27.989474 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-e7655277-6ec2-4680-88b3-f19bcd40ef1d req-fec3c82d-768c-4040-8623-ce000d41a166 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:27.989958 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-e7655277-6ec2-4680-88b3-f19bcd40ef1d req-fec3c82d-768c-4040-8623-ce000d41a166 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:28.002408 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.compute.server_external_events [req-e7655277-6ec2-4680-88b3-f19bcd40ef1d req-fec3c82d-768c-4040-8623-ce000d41a166 service nova] Creating event network-changed:c9434a00-cf73-4905-8e81-82fdd59b276f for instance 33e42717-0f3f-48eb-b4ba-78bcdc85dca1 on hv-cinder-78662 Aug 25 05:51:28.010495 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [req-e7655277-6ec2-4680-88b3-f19bcd40ef1d req-fec3c82d-768c-4040-8623-ce000d41a166 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095108 Aug 25 05:51:28.010927 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1050/2137] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:51:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:51:28.654034 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6a4fba29-6f5e-40de-b42c-51283e1baf10 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:51:28.654963 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6a4fba29-6f5e-40de-b42c-51283e1baf10 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:28.663345 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6a4fba29-6f5e-40de-b42c-51283e1baf10 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:28.663967 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6a4fba29-6f5e-40de-b42c-51283e1baf10 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:28.665048 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6a4fba29-6f5e-40de-b42c-51283e1baf10 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:28.665699 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6a4fba29-6f5e-40de-b42c-51283e1baf10 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:28.793262 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-6a4fba29-6f5e-40de-b42c-51283e1baf10 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:28.801847 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-6a4fba29-6f5e-40de-b42c-51283e1baf10 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:28.803338 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-6a4fba29-6f5e-40de-b42c-51283e1baf10 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:28.804439 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6a4fba29-6f5e-40de-b42c-51283e1baf10 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1" status: 200 len: 1405 microversion: 2.20 time: 0.156152 Aug 25 05:51:28.804975 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1088/2138] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:51:28 2021] GET /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:51:29.823536 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a5c1fe85-43f7-4bfb-b29c-dba1721279ae tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:51:29.824345 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a5c1fe85-43f7-4bfb-b29c-dba1721279ae tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:29.830558 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a5c1fe85-43f7-4bfb-b29c-dba1721279ae tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:29.830999 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a5c1fe85-43f7-4bfb-b29c-dba1721279ae tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:29.831930 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a5c1fe85-43f7-4bfb-b29c-dba1721279ae tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:29.832367 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a5c1fe85-43f7-4bfb-b29c-dba1721279ae tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:29.955843 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-a5c1fe85-43f7-4bfb-b29c-dba1721279ae tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:29.963650 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-a5c1fe85-43f7-4bfb-b29c-dba1721279ae tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:29.965145 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-a5c1fe85-43f7-4bfb-b29c-dba1721279ae tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:29.966266 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a5c1fe85-43f7-4bfb-b29c-dba1721279ae tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1" status: 200 len: 1405 microversion: 2.20 time: 0.146937 Aug 25 05:51:29.966818 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1051/2139] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:51:29 2021] GET /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1 => generated 1405 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:51:30.984481 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b947445e-6a02-4912-9b34-9f9805f6a22a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:51:30.985078 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b947445e-6a02-4912-9b34-9f9805f6a22a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:30.991675 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b947445e-6a02-4912-9b34-9f9805f6a22a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:30.992122 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b947445e-6a02-4912-9b34-9f9805f6a22a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:30.992882 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b947445e-6a02-4912-9b34-9f9805f6a22a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:30.993468 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b947445e-6a02-4912-9b34-9f9805f6a22a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:31.123907 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-b947445e-6a02-4912-9b34-9f9805f6a22a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:31.132594 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-b947445e-6a02-4912-9b34-9f9805f6a22a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:31.134111 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-b947445e-6a02-4912-9b34-9f9805f6a22a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:31.135199 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b947445e-6a02-4912-9b34-9f9805f6a22a tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1" status: 200 len: 1405 microversion: 2.20 time: 0.154481 Aug 25 05:51:31.135749 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1089/2140] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:51:30 2021] GET /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:51:32.152265 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e65ea3ff-cc37-45c1-a1a8-e9fad041e925 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:51:32.152871 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e65ea3ff-cc37-45c1-a1a8-e9fad041e925 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:32.158645 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e65ea3ff-cc37-45c1-a1a8-e9fad041e925 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:32.159091 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e65ea3ff-cc37-45c1-a1a8-e9fad041e925 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:32.160751 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e65ea3ff-cc37-45c1-a1a8-e9fad041e925 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:32.161189 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e65ea3ff-cc37-45c1-a1a8-e9fad041e925 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:32.283709 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e65ea3ff-cc37-45c1-a1a8-e9fad041e925 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:32.292004 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e65ea3ff-cc37-45c1-a1a8-e9fad041e925 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:32.293493 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e65ea3ff-cc37-45c1-a1a8-e9fad041e925 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:32.294684 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e65ea3ff-cc37-45c1-a1a8-e9fad041e925 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1" status: 200 len: 1405 microversion: 2.20 time: 0.146409 Aug 25 05:51:32.295242 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1052/2141] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:51:32 2021] GET /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1 => generated 1405 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:51:33.312993 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ba0c36c6-35a4-4a2e-9265-d9e7f860e742 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:51:33.313623 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ba0c36c6-35a4-4a2e-9265-d9e7f860e742 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:33.320190 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ba0c36c6-35a4-4a2e-9265-d9e7f860e742 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:33.320634 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ba0c36c6-35a4-4a2e-9265-d9e7f860e742 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:33.321398 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ba0c36c6-35a4-4a2e-9265-d9e7f860e742 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:33.321893 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ba0c36c6-35a4-4a2e-9265-d9e7f860e742 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:33.446670 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ba0c36c6-35a4-4a2e-9265-d9e7f860e742 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:33.454410 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ba0c36c6-35a4-4a2e-9265-d9e7f860e742 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:33.455907 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ba0c36c6-35a4-4a2e-9265-d9e7f860e742 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:33.457039 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ba0c36c6-35a4-4a2e-9265-d9e7f860e742 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1" status: 200 len: 1405 microversion: 2.20 time: 0.147898 Aug 25 05:51:33.457610 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1090/2142] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:51:33 2021] GET /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1 => generated 1405 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:51:34.261137 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [req-8b1e8684-ebc4-4004-8789-12cb058b45d2 req-88d8fc4c-ed5c-4bfa-a753-b8df89941f0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33e42717-0f3f-48eb-b4ba-78bcdc85dca1", "name": "network-vif-plugged", "status": "completed", "tag": "c9434a00-cf73-4905-8e81-82fdd59b276f"}]} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:51:34.270546 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:51:34.270546 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: warnings.warn(msg) Aug 25 05:51:34.270546 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-8b1e8684-ebc4-4004-8789-12cb058b45d2 req-88d8fc4c-ed5c-4bfa-a753-b8df89941f0f service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:34.270985 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-8b1e8684-ebc4-4004-8789-12cb058b45d2 req-88d8fc4c-ed5c-4bfa-a753-b8df89941f0f service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:34.281707 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.compute.server_external_events [req-8b1e8684-ebc4-4004-8789-12cb058b45d2 req-88d8fc4c-ed5c-4bfa-a753-b8df89941f0f service nova] Creating event network-vif-plugged:c9434a00-cf73-4905-8e81-82fdd59b276f for instance 33e42717-0f3f-48eb-b4ba-78bcdc85dca1 on hv-cinder-78662 Aug 25 05:51:34.287496 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [req-8b1e8684-ebc4-4004-8789-12cb058b45d2 req-88d8fc4c-ed5c-4bfa-a753-b8df89941f0f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083633 Aug 25 05:51:34.288166 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1053/2143] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:51:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:51:34.474499 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-452f07bc-4b20-4827-8372-d629aa61f906 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:51:34.475112 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-452f07bc-4b20-4827-8372-d629aa61f906 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:34.481086 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-452f07bc-4b20-4827-8372-d629aa61f906 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:34.481626 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-452f07bc-4b20-4827-8372-d629aa61f906 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:34.482391 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-452f07bc-4b20-4827-8372-d629aa61f906 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:34.482819 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-452f07bc-4b20-4827-8372-d629aa61f906 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:34.610556 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-452f07bc-4b20-4827-8372-d629aa61f906 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:34.618427 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-452f07bc-4b20-4827-8372-d629aa61f906 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:34.619907 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-452f07bc-4b20-4827-8372-d629aa61f906 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:34.621032 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-452f07bc-4b20-4827-8372-d629aa61f906 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1" status: 200 len: 1405 microversion: 2.20 time: 0.150544 Aug 25 05:51:34.621938 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1091/2144] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:51:34 2021] GET /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1 => generated 1405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:51:35.640111 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-0368f762-ea7a-4f03-84d3-de17bf8589ba tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:51:35.640786 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-0368f762-ea7a-4f03-84d3-de17bf8589ba tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:35.647588 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0368f762-ea7a-4f03-84d3-de17bf8589ba tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:35.648048 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0368f762-ea7a-4f03-84d3-de17bf8589ba tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:35.649046 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0368f762-ea7a-4f03-84d3-de17bf8589ba tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:35.649474 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0368f762-ea7a-4f03-84d3-de17bf8589ba tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:35.790122 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-0368f762-ea7a-4f03-84d3-de17bf8589ba tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:35.798155 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-0368f762-ea7a-4f03-84d3-de17bf8589ba tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:35.799651 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-0368f762-ea7a-4f03-84d3-de17bf8589ba tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:35.800747 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-0368f762-ea7a-4f03-84d3-de17bf8589ba tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1" status: 200 len: 1405 microversion: 2.20 time: 0.164703 Aug 25 05:51:35.801303 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1054/2145] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:51:35 2021] GET /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1 => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:51:36.820136 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f0a74657-2830-416d-a56c-3d558f64ec66 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:51:36.820742 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f0a74657-2830-416d-a56c-3d558f64ec66 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:36.826790 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f0a74657-2830-416d-a56c-3d558f64ec66 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:36.827233 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f0a74657-2830-416d-a56c-3d558f64ec66 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:36.828026 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f0a74657-2830-416d-a56c-3d558f64ec66 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:36.828467 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f0a74657-2830-416d-a56c-3d558f64ec66 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:36.955021 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-f0a74657-2830-416d-a56c-3d558f64ec66 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:36.967715 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-f0a74657-2830-416d-a56c-3d558f64ec66 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:36.970367 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-f0a74657-2830-416d-a56c-3d558f64ec66 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:51:36.972264 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f0a74657-2830-416d-a56c-3d558f64ec66 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1" status: 200 len: 1597 microversion: 2.20 time: 0.156713 Aug 25 05:51:36.973231 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1092/2146] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:51:36 2021] GET /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1 => generated 1597 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:51:36.989586 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-dd532a4c-a125-411d-818a-7588d2f52472 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:51:36.990669 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-dd532a4c-a125-411d-818a-7588d2f52472 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:36.996354 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dd532a4c-a125-411d-818a-7588d2f52472 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:36.996798 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dd532a4c-a125-411d-818a-7588d2f52472 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:36.997645 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dd532a4c-a125-411d-818a-7588d2f52472 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:36.998079 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dd532a4c-a125-411d-818a-7588d2f52472 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:37.079559 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-dd532a4c-a125-411d-818a-7588d2f52472 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.093623 Aug 25 05:51:37.080212 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1055/2147] 10.222.0.42 () {60 vars in 1316 bytes} [Wed Aug 25 05:51:36 2021] GET /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:51:38.061114 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-625c2b2c-c56d-49be-b629-157cbc993619 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:51:38.062135 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-625c2b2c-c56d-49be-b629-157cbc993619 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:38.068235 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [req-ca2003c7-c1a0-4148-b317-ceb7d9a57034 req-f001dfaf-ebc2-4f9e-b10c-583a1aebf0c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33e42717-0f3f-48eb-b4ba-78bcdc85dca1", "tag": "c9434a00-cf73-4905-8e81-82fdd59b276f"}]} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:51:38.068746 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-625c2b2c-c56d-49be-b629-157cbc993619 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:38.069039 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-625c2b2c-c56d-49be-b629-157cbc993619 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:38.069824 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-625c2b2c-c56d-49be-b629-157cbc993619 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:38.070254 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-625c2b2c-c56d-49be-b629-157cbc993619 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:38.070870 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:51:38.070870 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: warnings.warn(msg) Aug 25 05:51:38.078233 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-ca2003c7-c1a0-4148-b317-ceb7d9a57034 req-f001dfaf-ebc2-4f9e-b10c-583a1aebf0c8 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:38.079847 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-ca2003c7-c1a0-4148-b317-ceb7d9a57034 req-f001dfaf-ebc2-4f9e-b10c-583a1aebf0c8 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:38.091244 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.compute.server_external_events [req-ca2003c7-c1a0-4148-b317-ceb7d9a57034 req-f001dfaf-ebc2-4f9e-b10c-583a1aebf0c8 service nova] Creating event network-changed:c9434a00-cf73-4905-8e81-82fdd59b276f for instance 33e42717-0f3f-48eb-b4ba-78bcdc85dca1 on hv-cinder-78662 Aug 25 05:51:38.096437 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [req-ca2003c7-c1a0-4148-b317-ceb7d9a57034 req-f001dfaf-ebc2-4f9e-b10c-583a1aebf0c8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031994 Aug 25 05:51:38.097033 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1056/2148] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:51:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:51:38.132589 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-625c2b2c-c56d-49be-b629-157cbc993619 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 14 microversion: 2.20 time: 0.075072 Aug 25 05:51:38.135807 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1093/2149] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:51:38 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:51:39.146388 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4945947b-868a-4594-a167-64b475d876a3] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 25 05:51:39.146388 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-502d5d2d-ba0a-472b-b7e7-9ba63d103cad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:51:39.146388 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-502d5d2d-ba0a-472b-b7e7-9ba63d103cad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:39.153052 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-502d5d2d-ba0a-472b-b7e7-9ba63d103cad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:39.153503 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-502d5d2d-ba0a-472b-b7e7-9ba63d103cad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:39.154296 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-502d5d2d-ba0a-472b-b7e7-9ba63d103cad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:39.154730 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-502d5d2d-ba0a-472b-b7e7-9ba63d103cad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:40.158941 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [-] [4945947b-868a-4594-a167-64b475d876a3] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 39756. Aug 25 05:51:40.162494 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-502d5d2d-ba0a-472b-b7e7-9ba63d103cad tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 14 microversion: 2.20 time: 1.022740 Aug 25 05:51:40.163675 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1057/2150] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:51:39 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 14 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:51:41.174268 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-0351cdf4-0333-42e2-81de-a2f7106cbcfd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:51:41.175247 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-0351cdf4-0333-42e2-81de-a2f7106cbcfd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:41.181741 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0351cdf4-0333-42e2-81de-a2f7106cbcfd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:41.182178 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0351cdf4-0333-42e2-81de-a2f7106cbcfd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:41.182930 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0351cdf4-0333-42e2-81de-a2f7106cbcfd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:41.183356 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0351cdf4-0333-42e2-81de-a2f7106cbcfd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:41.241426 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-0351cdf4-0333-42e2-81de-a2f7106cbcfd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 14 microversion: 2.20 time: 0.070990 Aug 25 05:51:41.242113 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1094/2151] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:51:41 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:51:42.253053 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-27559397-f002-4ae8-ab28-62b0c0465ef2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:51:42.254112 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-27559397-f002-4ae8-ab28-62b0c0465ef2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:42.261104 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-27559397-f002-4ae8-ab28-62b0c0465ef2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:42.261571 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-27559397-f002-4ae8-ab28-62b0c0465ef2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:42.262386 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-27559397-f002-4ae8-ab28-62b0c0465ef2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:42.262819 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-27559397-f002-4ae8-ab28-62b0c0465ef2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:42.322297 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-27559397-f002-4ae8-ab28-62b0c0465ef2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 14 microversion: 2.20 time: 0.072951 Aug 25 05:51:42.322853 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1058/2152] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:51:42 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:51:43.333592 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-3788c7ff-2ca0-4e4c-88c4-2c8019718fcb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:51:43.334634 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-3788c7ff-2ca0-4e4c-88c4-2c8019718fcb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:43.341275 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3788c7ff-2ca0-4e4c-88c4-2c8019718fcb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:43.341700 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3788c7ff-2ca0-4e4c-88c4-2c8019718fcb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:43.342465 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3788c7ff-2ca0-4e4c-88c4-2c8019718fcb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:43.342894 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3788c7ff-2ca0-4e4c-88c4-2c8019718fcb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:43.400089 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-3788c7ff-2ca0-4e4c-88c4-2c8019718fcb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 14 microversion: 2.20 time: 0.070439 Aug 25 05:51:43.400718 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1095/2153] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:51:43 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:51:44.411856 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-4722f38d-3527-40f9-92b6-6b93ce93d800 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:51:44.418972 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-4722f38d-3527-40f9-92b6-6b93ce93d800 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:44.420723 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4722f38d-3527-40f9-92b6-6b93ce93d800 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:44.421167 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4722f38d-3527-40f9-92b6-6b93ce93d800 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:44.421971 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4722f38d-3527-40f9-92b6-6b93ce93d800 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:44.422399 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4722f38d-3527-40f9-92b6-6b93ce93d800 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:44.481477 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-4722f38d-3527-40f9-92b6-6b93ce93d800 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 14 microversion: 2.20 time: 0.073649 Aug 25 05:51:44.482180 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1059/2154] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:51:44 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:51:45.493242 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-3903b55c-2e8a-471a-ba86-33b035ab2327 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:51:45.494272 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-3903b55c-2e8a-471a-ba86-33b035ab2327 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:45.501099 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3903b55c-2e8a-471a-ba86-33b035ab2327 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:45.501564 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3903b55c-2e8a-471a-ba86-33b035ab2327 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:45.502349 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3903b55c-2e8a-471a-ba86-33b035ab2327 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:45.502788 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3903b55c-2e8a-471a-ba86-33b035ab2327 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:45.566983 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-3903b55c-2e8a-471a-ba86-33b035ab2327 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 14 microversion: 2.20 time: 0.077753 Aug 25 05:51:45.567626 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1096/2155] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:51:45 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:51:46.578997 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1d67fd4d-2157-43d2-8152-b8db99eb9e22 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:51:46.580022 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1d67fd4d-2157-43d2-8152-b8db99eb9e22 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:46.587246 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1d67fd4d-2157-43d2-8152-b8db99eb9e22 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:46.587727 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1d67fd4d-2157-43d2-8152-b8db99eb9e22 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:46.588461 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1d67fd4d-2157-43d2-8152-b8db99eb9e22 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:46.588897 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1d67fd4d-2157-43d2-8152-b8db99eb9e22 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:46.645729 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1d67fd4d-2157-43d2-8152-b8db99eb9e22 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 14 microversion: 2.20 time: 0.070498 Aug 25 05:51:46.646361 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1060/2156] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:51:46 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:51:47.666956 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-55c28649-8ffc-48cc-a967-cb259320bd4b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:51:47.667966 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-55c28649-8ffc-48cc-a967-cb259320bd4b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:47.674347 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-55c28649-8ffc-48cc-a967-cb259320bd4b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:47.674783 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-55c28649-8ffc-48cc-a967-cb259320bd4b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:47.675527 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-55c28649-8ffc-48cc-a967-cb259320bd4b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:47.675953 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-55c28649-8ffc-48cc-a967-cb259320bd4b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:47.765148 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-55c28649-8ffc-48cc-a967-cb259320bd4b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 14 microversion: 2.20 time: 0.102640 Aug 25 05:51:47.766063 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1097/2157] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:51:47 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:51:48.776627 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e690e958-a683-44de-b0a5-eecf04e38a86 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:51:48.777641 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e690e958-a683-44de-b0a5-eecf04e38a86 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:48.784051 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e690e958-a683-44de-b0a5-eecf04e38a86 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:48.784494 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e690e958-a683-44de-b0a5-eecf04e38a86 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:48.785251 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e690e958-a683-44de-b0a5-eecf04e38a86 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:48.785723 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e690e958-a683-44de-b0a5-eecf04e38a86 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:48.860301 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e690e958-a683-44de-b0a5-eecf04e38a86 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 12331 microversion: 2.20 time: 0.087822 Aug 25 05:51:48.860948 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1061/2158] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:51:48 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 12331 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:51:49.872802 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-54a11322-8100-4109-8879-7e1fb3175e0f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:51:49.873819 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-54a11322-8100-4109-8879-7e1fb3175e0f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:49.880229 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-54a11322-8100-4109-8879-7e1fb3175e0f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:49.880666 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-54a11322-8100-4109-8879-7e1fb3175e0f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:49.881419 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-54a11322-8100-4109-8879-7e1fb3175e0f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:49.881877 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-54a11322-8100-4109-8879-7e1fb3175e0f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:49.947734 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-54a11322-8100-4109-8879-7e1fb3175e0f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 18498 microversion: 2.20 time: 0.078812 Aug 25 05:51:49.948279 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1098/2159] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:51:49 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 18498 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:51:50.959567 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3530037a-59db-4291-94ff-88e3bc835379 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:51:50.960582 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3530037a-59db-4291-94ff-88e3bc835379 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:50.967098 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3530037a-59db-4291-94ff-88e3bc835379 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:50.967481 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3530037a-59db-4291-94ff-88e3bc835379 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:50.968228 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3530037a-59db-4291-94ff-88e3bc835379 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:50.968656 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3530037a-59db-4291-94ff-88e3bc835379 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:51.040061 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3530037a-59db-4291-94ff-88e3bc835379 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 19342 microversion: 2.20 time: 0.084432 Aug 25 05:51:51.040671 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1062/2160] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:51:50 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 19342 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:51:52.051873 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2a62e63d-f2fe-4109-93ab-ada2be07c708 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:51:52.052770 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2a62e63d-f2fe-4109-93ab-ada2be07c708 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:52.059151 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2a62e63d-f2fe-4109-93ab-ada2be07c708 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:52.059587 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2a62e63d-f2fe-4109-93ab-ada2be07c708 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:52.060335 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2a62e63d-f2fe-4109-93ab-ada2be07c708 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:52.060758 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2a62e63d-f2fe-4109-93ab-ada2be07c708 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:52.134773 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2a62e63d-f2fe-4109-93ab-ada2be07c708 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 21972 microversion: 2.20 time: 0.086883 Aug 25 05:51:52.135397 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1099/2161] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:51:52 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 21972 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:51:53.146892 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-13348b34-0265-4e2b-b55b-11379374a382 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:51:53.147815 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-13348b34-0265-4e2b-b55b-11379374a382 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:53.155105 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-13348b34-0265-4e2b-b55b-11379374a382 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:53.155549 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-13348b34-0265-4e2b-b55b-11379374a382 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:53.156304 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-13348b34-0265-4e2b-b55b-11379374a382 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:53.156732 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-13348b34-0265-4e2b-b55b-11379374a382 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:53.225305 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-13348b34-0265-4e2b-b55b-11379374a382 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 23235 microversion: 2.20 time: 0.082461 Aug 25 05:51:53.226194 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1063/2162] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:51:53 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 23235 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:51:54.238157 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-0dc05c1d-7e8c-4563-b6d4-879dc828ee7d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:51:54.239099 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-0dc05c1d-7e8c-4563-b6d4-879dc828ee7d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:54.246396 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0dc05c1d-7e8c-4563-b6d4-879dc828ee7d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:54.247440 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0dc05c1d-7e8c-4563-b6d4-879dc828ee7d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:54.247629 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0dc05c1d-7e8c-4563-b6d4-879dc828ee7d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:54.248062 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0dc05c1d-7e8c-4563-b6d4-879dc828ee7d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:54.319275 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-0dc05c1d-7e8c-4563-b6d4-879dc828ee7d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 24915 microversion: 2.20 time: 0.085125 Aug 25 05:51:54.319942 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1100/2163] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:51:54 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 24915 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:51:55.331614 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c4eef1f7-d182-40ed-afe6-d0b2c694f10e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:51:55.332611 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c4eef1f7-d182-40ed-afe6-d0b2c694f10e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:55.339364 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c4eef1f7-d182-40ed-afe6-d0b2c694f10e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:55.339811 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c4eef1f7-d182-40ed-afe6-d0b2c694f10e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:55.340576 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c4eef1f7-d182-40ed-afe6-d0b2c694f10e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:55.341014 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c4eef1f7-d182-40ed-afe6-d0b2c694f10e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:55.411914 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c4eef1f7-d182-40ed-afe6-d0b2c694f10e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 26580 microversion: 2.20 time: 0.084214 Aug 25 05:51:55.412532 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1064/2164] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:51:55 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 26580 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:51:56.424061 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-dd99e32c-d40d-4241-a13f-40488c791d7e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:51:56.425044 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-dd99e32c-d40d-4241-a13f-40488c791d7e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:56.431401 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-dd99e32c-d40d-4241-a13f-40488c791d7e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:56.431875 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-dd99e32c-d40d-4241-a13f-40488c791d7e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:56.432666 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-dd99e32c-d40d-4241-a13f-40488c791d7e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:56.433091 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-dd99e32c-d40d-4241-a13f-40488c791d7e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:56.503251 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-dd99e32c-d40d-4241-a13f-40488c791d7e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 27631 microversion: 2.20 time: 0.083223 Aug 25 05:51:56.503906 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1101/2165] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:51:56 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 27631 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:51:57.515192 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-9cf75090-6367-4f61-988a-78a9728de0f6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:51:57.516123 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-9cf75090-6367-4f61-988a-78a9728de0f6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:57.522691 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9cf75090-6367-4f61-988a-78a9728de0f6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:57.523862 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9cf75090-6367-4f61-988a-78a9728de0f6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:57.524709 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9cf75090-6367-4f61-988a-78a9728de0f6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:57.525140 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9cf75090-6367-4f61-988a-78a9728de0f6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:57.596131 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-9cf75090-6367-4f61-988a-78a9728de0f6 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 27959 microversion: 2.20 time: 0.084915 Aug 25 05:51:57.596794 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1065/2166] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:51:57 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 27959 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 25 05:51:58.608451 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-0129c2bb-77c5-4e69-8d99-f2f1e1168859 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:51:58.609445 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-0129c2bb-77c5-4e69-8d99-f2f1e1168859 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:58.615872 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0129c2bb-77c5-4e69-8d99-f2f1e1168859 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:58.616319 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0129c2bb-77c5-4e69-8d99-f2f1e1168859 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:58.617689 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0129c2bb-77c5-4e69-8d99-f2f1e1168859 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:58.618333 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0129c2bb-77c5-4e69-8d99-f2f1e1168859 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:58.693681 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-0129c2bb-77c5-4e69-8d99-f2f1e1168859 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 28225 microversion: 2.20 time: 0.089122 Aug 25 05:51:58.694318 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1102/2167] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:51:58 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 28225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:51:59.705810 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-26eb7bea-d0be-4522-bbe3-165025e08135 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:51:59.706796 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-26eb7bea-d0be-4522-bbe3-165025e08135 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:51:59.713924 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-26eb7bea-d0be-4522-bbe3-165025e08135 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:59.714366 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-26eb7bea-d0be-4522-bbe3-165025e08135 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:59.715114 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-26eb7bea-d0be-4522-bbe3-165025e08135 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:51:59.715541 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-26eb7bea-d0be-4522-bbe3-165025e08135 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:51:59.774604 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-26eb7bea-d0be-4522-bbe3-165025e08135 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 28225 microversion: 2.20 time: 0.071832 Aug 25 05:51:59.775137 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1066/2168] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:51:59 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 28225 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:00.786862 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-85c68dc2-f069-48a4-894c-0da05da3f266 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:00.787771 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-85c68dc2-f069-48a4-894c-0da05da3f266 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:00.795408 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-85c68dc2-f069-48a4-894c-0da05da3f266 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:00.795849 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-85c68dc2-f069-48a4-894c-0da05da3f266 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:00.796606 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-85c68dc2-f069-48a4-894c-0da05da3f266 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:00.797036 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-85c68dc2-f069-48a4-894c-0da05da3f266 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:00.864241 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-85c68dc2-f069-48a4-894c-0da05da3f266 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 28225 microversion: 2.20 time: 0.081313 Aug 25 05:52:00.864880 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1103/2169] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:00 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 28225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 25 05:52:01.877785 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-42628f6e-f2cb-41af-bbbb-3bf3998d5a25 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:01.878789 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-42628f6e-f2cb-41af-bbbb-3bf3998d5a25 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:01.886614 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-42628f6e-f2cb-41af-bbbb-3bf3998d5a25 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:01.887067 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-42628f6e-f2cb-41af-bbbb-3bf3998d5a25 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:01.887855 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-42628f6e-f2cb-41af-bbbb-3bf3998d5a25 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:01.888305 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-42628f6e-f2cb-41af-bbbb-3bf3998d5a25 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:01.962168 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-42628f6e-f2cb-41af-bbbb-3bf3998d5a25 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 28225 microversion: 2.20 time: 0.088924 Aug 25 05:52:01.966450 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1067/2170] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:01 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 28225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:02.973946 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a49cc484-3fa6-42bc-a4a4-6c757db014ba tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:02.974939 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a49cc484-3fa6-42bc-a4a4-6c757db014ba tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:02.981671 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a49cc484-3fa6-42bc-a4a4-6c757db014ba tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:02.982114 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a49cc484-3fa6-42bc-a4a4-6c757db014ba tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:02.982865 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a49cc484-3fa6-42bc-a4a4-6c757db014ba tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:02.983292 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a49cc484-3fa6-42bc-a4a4-6c757db014ba tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:03.041545 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a49cc484-3fa6-42bc-a4a4-6c757db014ba tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 28225 microversion: 2.20 time: 0.071511 Aug 25 05:52:03.042226 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1104/2171] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:02 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 28225 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:04.053589 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-bdf6cd20-8b02-45de-83c4-44da326e94a9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:04.054629 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-bdf6cd20-8b02-45de-83c4-44da326e94a9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:04.061684 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bdf6cd20-8b02-45de-83c4-44da326e94a9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:04.062130 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bdf6cd20-8b02-45de-83c4-44da326e94a9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:04.062892 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bdf6cd20-8b02-45de-83c4-44da326e94a9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:04.063324 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bdf6cd20-8b02-45de-83c4-44da326e94a9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:04.123946 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-bdf6cd20-8b02-45de-83c4-44da326e94a9 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 28225 microversion: 2.20 time: 0.074211 Aug 25 05:52:04.124605 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1068/2172] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:04 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 28225 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:05.136449 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-79403f76-37b0-4e9d-8c96-8385f80c49dd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:05.137446 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-79403f76-37b0-4e9d-8c96-8385f80c49dd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:05.143896 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-79403f76-37b0-4e9d-8c96-8385f80c49dd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:05.144335 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-79403f76-37b0-4e9d-8c96-8385f80c49dd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:05.145090 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-79403f76-37b0-4e9d-8c96-8385f80c49dd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:05.145519 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-79403f76-37b0-4e9d-8c96-8385f80c49dd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:05.208547 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-79403f76-37b0-4e9d-8c96-8385f80c49dd tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 28225 microversion: 2.20 time: 0.076323 Aug 25 05:52:05.209194 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1105/2173] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:05 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 28225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:06.221186 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c56c624e-1211-409a-a702-b3cb70621a53 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:06.222213 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c56c624e-1211-409a-a702-b3cb70621a53 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:06.228750 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c56c624e-1211-409a-a702-b3cb70621a53 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:06.229198 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c56c624e-1211-409a-a702-b3cb70621a53 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:06.230609 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c56c624e-1211-409a-a702-b3cb70621a53 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:06.231124 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c56c624e-1211-409a-a702-b3cb70621a53 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:06.295838 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c56c624e-1211-409a-a702-b3cb70621a53 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 28225 microversion: 2.20 time: 0.078611 Aug 25 05:52:06.296488 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1069/2174] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:06 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 28225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:07.307847 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-71cda76d-8281-4fd5-b6e1-1576dc3387b0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:07.309006 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-71cda76d-8281-4fd5-b6e1-1576dc3387b0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:07.315570 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-71cda76d-8281-4fd5-b6e1-1576dc3387b0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:07.316153 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-71cda76d-8281-4fd5-b6e1-1576dc3387b0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:07.316933 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-71cda76d-8281-4fd5-b6e1-1576dc3387b0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:07.317364 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-71cda76d-8281-4fd5-b6e1-1576dc3387b0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:07.376438 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-71cda76d-8281-4fd5-b6e1-1576dc3387b0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 28225 microversion: 2.20 time: 0.072664 Aug 25 05:52:07.377312 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1106/2175] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:07 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 28225 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:08.389113 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-4c0df3d4-be68-4602-9490-d9c9abb3c385 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:08.390179 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-4c0df3d4-be68-4602-9490-d9c9abb3c385 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:08.396764 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4c0df3d4-be68-4602-9490-d9c9abb3c385 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:08.397214 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4c0df3d4-be68-4602-9490-d9c9abb3c385 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:08.398019 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4c0df3d4-be68-4602-9490-d9c9abb3c385 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:08.398451 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4c0df3d4-be68-4602-9490-d9c9abb3c385 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:08.465202 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-4c0df3d4-be68-4602-9490-d9c9abb3c385 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 28225 microversion: 2.20 time: 0.079650 Aug 25 05:52:08.465890 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1070/2176] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:08 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 28225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:09.477203 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7dcba33b-b663-4a19-8482-f51a9e84c8fb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:09.478221 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-7dcba33b-b663-4a19-8482-f51a9e84c8fb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:09.485017 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7dcba33b-b663-4a19-8482-f51a9e84c8fb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:09.485455 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7dcba33b-b663-4a19-8482-f51a9e84c8fb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:09.486233 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7dcba33b-b663-4a19-8482-f51a9e84c8fb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:09.486659 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7dcba33b-b663-4a19-8482-f51a9e84c8fb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:09.545615 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-7dcba33b-b663-4a19-8482-f51a9e84c8fb tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 28225 microversion: 2.20 time: 0.072231 Aug 25 05:52:09.546266 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1107/2177] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:09 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 28225 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:10.556953 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b2e5154f-b5fa-46ae-a527-718832864450 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:10.558084 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b2e5154f-b5fa-46ae-a527-718832864450 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:10.564645 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b2e5154f-b5fa-46ae-a527-718832864450 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:10.565086 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b2e5154f-b5fa-46ae-a527-718832864450 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:10.565922 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b2e5154f-b5fa-46ae-a527-718832864450 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:10.566352 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b2e5154f-b5fa-46ae-a527-718832864450 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:10.639781 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b2e5154f-b5fa-46ae-a527-718832864450 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 28516 microversion: 2.20 time: 0.086859 Aug 25 05:52:10.640403 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1071/2178] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:10 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 28516 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:11.653552 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c5e47bfa-f7fa-4a1d-a490-40cab8501a22 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:11.654880 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c5e47bfa-f7fa-4a1d-a490-40cab8501a22 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:11.661677 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c5e47bfa-f7fa-4a1d-a490-40cab8501a22 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:11.662120 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c5e47bfa-f7fa-4a1d-a490-40cab8501a22 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:11.662891 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c5e47bfa-f7fa-4a1d-a490-40cab8501a22 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:11.663320 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c5e47bfa-f7fa-4a1d-a490-40cab8501a22 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:11.740927 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c5e47bfa-f7fa-4a1d-a490-40cab8501a22 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 28684 microversion: 2.20 time: 0.092423 Aug 25 05:52:11.741590 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1108/2179] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:11 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 28684 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:12.753296 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-801b014d-2a0c-4b90-ad67-4d2b4d221d73 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:12.754367 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-801b014d-2a0c-4b90-ad67-4d2b4d221d73 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:12.761669 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-801b014d-2a0c-4b90-ad67-4d2b4d221d73 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:12.762121 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-801b014d-2a0c-4b90-ad67-4d2b4d221d73 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:12.762906 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-801b014d-2a0c-4b90-ad67-4d2b4d221d73 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:12.763337 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-801b014d-2a0c-4b90-ad67-4d2b4d221d73 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:12.825466 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-801b014d-2a0c-4b90-ad67-4d2b4d221d73 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 28684 microversion: 2.20 time: 0.075954 Aug 25 05:52:12.826033 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1072/2180] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:12 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 28684 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:13.836965 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1b6230a8-5839-43ca-a153-498ed8c1dd20 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:13.837965 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1b6230a8-5839-43ca-a153-498ed8c1dd20 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:13.845268 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1b6230a8-5839-43ca-a153-498ed8c1dd20 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:13.845747 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1b6230a8-5839-43ca-a153-498ed8c1dd20 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:13.846509 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1b6230a8-5839-43ca-a153-498ed8c1dd20 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:13.846941 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1b6230a8-5839-43ca-a153-498ed8c1dd20 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:13.910783 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1b6230a8-5839-43ca-a153-498ed8c1dd20 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 28684 microversion: 2.20 time: 0.077759 Aug 25 05:52:13.911481 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1109/2181] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:13 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 28684 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 25 05:52:14.924578 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-2e0ae86a-c035-40ec-8a87-2e62fcebbea4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:14.925472 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-2e0ae86a-c035-40ec-8a87-2e62fcebbea4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:14.932055 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2e0ae86a-c035-40ec-8a87-2e62fcebbea4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:14.932606 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2e0ae86a-c035-40ec-8a87-2e62fcebbea4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:14.933771 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2e0ae86a-c035-40ec-8a87-2e62fcebbea4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:14.934211 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2e0ae86a-c035-40ec-8a87-2e62fcebbea4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:14.996580 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-2e0ae86a-c035-40ec-8a87-2e62fcebbea4 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 28684 microversion: 2.20 time: 0.075960 Aug 25 05:52:14.997241 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1073/2182] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:14 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 28684 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:16.008766 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b4610c09-a811-4e85-be5e-4fa1ee32b085 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:16.009689 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b4610c09-a811-4e85-be5e-4fa1ee32b085 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:16.016645 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b4610c09-a811-4e85-be5e-4fa1ee32b085 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:16.017088 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b4610c09-a811-4e85-be5e-4fa1ee32b085 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:16.017899 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b4610c09-a811-4e85-be5e-4fa1ee32b085 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:16.018328 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b4610c09-a811-4e85-be5e-4fa1ee32b085 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:16.079519 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b4610c09-a811-4e85-be5e-4fa1ee32b085 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 28684 microversion: 2.20 time: 0.074429 Aug 25 05:52:16.081582 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1110/2183] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:16 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 28684 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:17.091664 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-4e66c841-3a3d-46bc-9e81-c94464d70188 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:17.092580 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-4e66c841-3a3d-46bc-9e81-c94464d70188 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:17.099141 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4e66c841-3a3d-46bc-9e81-c94464d70188 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:17.099591 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4e66c841-3a3d-46bc-9e81-c94464d70188 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:17.100358 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4e66c841-3a3d-46bc-9e81-c94464d70188 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:17.100797 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4e66c841-3a3d-46bc-9e81-c94464d70188 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:17.161964 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-4e66c841-3a3d-46bc-9e81-c94464d70188 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 28684 microversion: 2.20 time: 0.074412 Aug 25 05:52:17.162707 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1074/2184] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:17 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 28684 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:18.174857 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9aa0226b-5b7c-42fc-b683-d07d51f82478 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:18.175782 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9aa0226b-5b7c-42fc-b683-d07d51f82478 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:18.182167 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9aa0226b-5b7c-42fc-b683-d07d51f82478 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:18.183274 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9aa0226b-5b7c-42fc-b683-d07d51f82478 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:18.183956 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9aa0226b-5b7c-42fc-b683-d07d51f82478 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:18.184380 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9aa0226b-5b7c-42fc-b683-d07d51f82478 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:18.248086 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9aa0226b-5b7c-42fc-b683-d07d51f82478 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 28684 microversion: 2.20 time: 0.077215 Aug 25 05:52:18.248725 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1111/2185] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:18 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 28684 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:19.260203 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-bf68ad2f-ee00-426a-9ef5-cb6a43c9ee80 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:19.261464 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-bf68ad2f-ee00-426a-9ef5-cb6a43c9ee80 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:19.268281 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bf68ad2f-ee00-426a-9ef5-cb6a43c9ee80 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:19.268722 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bf68ad2f-ee00-426a-9ef5-cb6a43c9ee80 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:19.269475 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bf68ad2f-ee00-426a-9ef5-cb6a43c9ee80 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:19.269940 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bf68ad2f-ee00-426a-9ef5-cb6a43c9ee80 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:19.329088 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-bf68ad2f-ee00-426a-9ef5-cb6a43c9ee80 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 28684 microversion: 2.20 time: 0.072847 Aug 25 05:52:19.330003 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1075/2186] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:19 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 28684 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:20.340988 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c771ad7c-f0fe-4f01-8d24-7ac4e291ee75 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:20.342001 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c771ad7c-f0fe-4f01-8d24-7ac4e291ee75 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:20.348531 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c771ad7c-f0fe-4f01-8d24-7ac4e291ee75 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:20.348972 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c771ad7c-f0fe-4f01-8d24-7ac4e291ee75 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:20.349759 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c771ad7c-f0fe-4f01-8d24-7ac4e291ee75 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:20.350197 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c771ad7c-f0fe-4f01-8d24-7ac4e291ee75 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:20.413361 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c771ad7c-f0fe-4f01-8d24-7ac4e291ee75 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 28684 microversion: 2.20 time: 0.076639 Aug 25 05:52:20.414032 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1112/2187] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:20 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 28684 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:21.426002 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-11dd23c3-c2ef-406c-bd61-7a5ff4489cb3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:21.426994 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-11dd23c3-c2ef-406c-bd61-7a5ff4489cb3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:21.434045 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-11dd23c3-c2ef-406c-bd61-7a5ff4489cb3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:21.434487 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-11dd23c3-c2ef-406c-bd61-7a5ff4489cb3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:21.435250 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-11dd23c3-c2ef-406c-bd61-7a5ff4489cb3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:21.435682 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-11dd23c3-c2ef-406c-bd61-7a5ff4489cb3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:21.497713 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-11dd23c3-c2ef-406c-bd61-7a5ff4489cb3 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 28684 microversion: 2.20 time: 0.075584 Aug 25 05:52:21.498579 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1076/2188] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:21 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 28684 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:22.508962 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a384d93e-ff01-4902-b4ef-0136c2de81f2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:22.509974 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a384d93e-ff01-4902-b4ef-0136c2de81f2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:22.516825 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a384d93e-ff01-4902-b4ef-0136c2de81f2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:22.517265 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a384d93e-ff01-4902-b4ef-0136c2de81f2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:22.518062 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a384d93e-ff01-4902-b4ef-0136c2de81f2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:22.518489 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a384d93e-ff01-4902-b4ef-0136c2de81f2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:22.584086 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a384d93e-ff01-4902-b4ef-0136c2de81f2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 28684 microversion: 2.20 time: 0.078999 Aug 25 05:52:22.584699 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1113/2189] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:22 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 28684 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:23.597069 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-4d6e26c5-f05e-41ca-86f3-8cd6159ba59d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:23.598091 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-4d6e26c5-f05e-41ca-86f3-8cd6159ba59d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:23.604589 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4d6e26c5-f05e-41ca-86f3-8cd6159ba59d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:23.605040 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4d6e26c5-f05e-41ca-86f3-8cd6159ba59d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:23.605877 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4d6e26c5-f05e-41ca-86f3-8cd6159ba59d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:23.606324 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4d6e26c5-f05e-41ca-86f3-8cd6159ba59d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:23.671076 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-4d6e26c5-f05e-41ca-86f3-8cd6159ba59d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 28684 microversion: 2.20 time: 0.077848 Aug 25 05:52:23.671752 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1077/2190] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:23 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 28684 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:24.684283 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-862051a6-b499-4020-9bcb-71a0d7c6a495 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:24.685410 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-862051a6-b499-4020-9bcb-71a0d7c6a495 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:24.691811 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-862051a6-b499-4020-9bcb-71a0d7c6a495 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:24.692247 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-862051a6-b499-4020-9bcb-71a0d7c6a495 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:24.692989 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-862051a6-b499-4020-9bcb-71a0d7c6a495 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:24.693410 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-862051a6-b499-4020-9bcb-71a0d7c6a495 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:24.752260 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-862051a6-b499-4020-9bcb-71a0d7c6a495 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 28684 microversion: 2.20 time: 0.071846 Aug 25 05:52:24.752881 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1114/2191] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:24 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 28684 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:24.977264 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 05:52:24.977912 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: Wed Aug 25 05:52:24 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 05:52:25.764314 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8e128161-90e5-4730-87b3-63ce182c25b1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:25.765300 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8e128161-90e5-4730-87b3-63ce182c25b1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:25.772112 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8e128161-90e5-4730-87b3-63ce182c25b1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:25.772560 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8e128161-90e5-4730-87b3-63ce182c25b1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:25.773326 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8e128161-90e5-4730-87b3-63ce182c25b1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:25.774057 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8e128161-90e5-4730-87b3-63ce182c25b1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:25.833114 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8e128161-90e5-4730-87b3-63ce182c25b1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 28684 microversion: 2.20 time: 0.072730 Aug 25 05:52:25.833963 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1078/2192] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:25 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 28684 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:26.845628 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5b395280-7a36-4002-9345-c841cb3d3b8f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:26.846538 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5b395280-7a36-4002-9345-c841cb3d3b8f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:26.852995 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5b395280-7a36-4002-9345-c841cb3d3b8f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:26.853431 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5b395280-7a36-4002-9345-c841cb3d3b8f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:26.854215 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5b395280-7a36-4002-9345-c841cb3d3b8f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:26.854640 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5b395280-7a36-4002-9345-c841cb3d3b8f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:26.912809 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5b395280-7a36-4002-9345-c841cb3d3b8f tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 28684 microversion: 2.20 time: 0.071466 Aug 25 05:52:26.913461 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1115/2193] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:26 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 28684 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:27.925163 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8ec8df9a-c476-45a4-8204-e0f27ce06a22 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:27.926180 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8ec8df9a-c476-45a4-8204-e0f27ce06a22 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:27.932567 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8ec8df9a-c476-45a4-8204-e0f27ce06a22 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:27.933004 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8ec8df9a-c476-45a4-8204-e0f27ce06a22 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:27.933787 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8ec8df9a-c476-45a4-8204-e0f27ce06a22 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:27.934207 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8ec8df9a-c476-45a4-8204-e0f27ce06a22 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:27.993556 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8ec8df9a-c476-45a4-8204-e0f27ce06a22 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 28684 microversion: 2.20 time: 0.072292 Aug 25 05:52:27.994118 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1079/2194] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:27 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 28684 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:29.005233 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2f501f99-e98e-4cc7-a931-1f653690d279 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:29.006199 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2f501f99-e98e-4cc7-a931-1f653690d279 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:29.012667 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2f501f99-e98e-4cc7-a931-1f653690d279 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:29.013661 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2f501f99-e98e-4cc7-a931-1f653690d279 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:29.014072 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2f501f99-e98e-4cc7-a931-1f653690d279 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:29.014577 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2f501f99-e98e-4cc7-a931-1f653690d279 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:29.078294 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2f501f99-e98e-4cc7-a931-1f653690d279 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 28684 microversion: 2.20 time: 0.077328 Aug 25 05:52:29.078946 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1116/2195] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:28 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 28684 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:30.090472 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b050c65d-15d5-4120-9a5b-694c70b20c84 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:30.091364 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b050c65d-15d5-4120-9a5b-694c70b20c84 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:30.098937 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b050c65d-15d5-4120-9a5b-694c70b20c84 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:30.098937 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b050c65d-15d5-4120-9a5b-694c70b20c84 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:30.099365 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b050c65d-15d5-4120-9a5b-694c70b20c84 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:30.099751 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b050c65d-15d5-4120-9a5b-694c70b20c84 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:30.162309 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b050c65d-15d5-4120-9a5b-694c70b20c84 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 28684 microversion: 2.20 time: 0.075817 Aug 25 05:52:30.162952 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1080/2196] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:30 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 28684 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:31.174743 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2596cd29-2f32-413b-bc82-abfebcff7665 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:31.175705 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2596cd29-2f32-413b-bc82-abfebcff7665 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:31.182124 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2596cd29-2f32-413b-bc82-abfebcff7665 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:31.182560 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2596cd29-2f32-413b-bc82-abfebcff7665 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:31.183306 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2596cd29-2f32-413b-bc82-abfebcff7665 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:31.183729 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2596cd29-2f32-413b-bc82-abfebcff7665 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:31.242400 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2596cd29-2f32-413b-bc82-abfebcff7665 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 28684 microversion: 2.20 time: 0.071733 Aug 25 05:52:31.243052 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1117/2197] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:31 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 28684 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:32.255595 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-271657ed-bf0d-4b5e-9358-67da80968b19 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:32.257157 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-271657ed-bf0d-4b5e-9358-67da80968b19 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:32.267274 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-271657ed-bf0d-4b5e-9358-67da80968b19 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:32.267935 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-271657ed-bf0d-4b5e-9358-67da80968b19 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:32.269083 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-271657ed-bf0d-4b5e-9358-67da80968b19 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:32.269776 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-271657ed-bf0d-4b5e-9358-67da80968b19 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:32.336403 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-271657ed-bf0d-4b5e-9358-67da80968b19 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 28684 microversion: 2.20 time: 0.085358 Aug 25 05:52:32.336996 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1081/2198] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:32 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 28684 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:33.348444 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f009add6-3771-4c0a-bd7b-afd6e92d7376 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:33.349432 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f009add6-3771-4c0a-bd7b-afd6e92d7376 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:33.355895 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f009add6-3771-4c0a-bd7b-afd6e92d7376 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:33.356338 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f009add6-3771-4c0a-bd7b-afd6e92d7376 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:33.357630 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f009add6-3771-4c0a-bd7b-afd6e92d7376 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:33.358068 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f009add6-3771-4c0a-bd7b-afd6e92d7376 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:33.414705 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f009add6-3771-4c0a-bd7b-afd6e92d7376 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 28684 microversion: 2.20 time: 0.070187 Aug 25 05:52:33.415337 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1118/2199] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:33 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 28684 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:34.427246 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-aa389405-9103-44f7-9069-383c34099445 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:34.428141 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-aa389405-9103-44f7-9069-383c34099445 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:34.434672 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-aa389405-9103-44f7-9069-383c34099445 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:34.435104 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-aa389405-9103-44f7-9069-383c34099445 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:34.436523 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-aa389405-9103-44f7-9069-383c34099445 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:34.436961 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-aa389405-9103-44f7-9069-383c34099445 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:34.500515 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-aa389405-9103-44f7-9069-383c34099445 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 28684 microversion: 2.20 time: 0.077285 Aug 25 05:52:34.501403 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1082/2200] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:34 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 28684 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:35.512943 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-109e4508-78e7-4783-88a4-664d92c9ee58 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:35.514162 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-109e4508-78e7-4783-88a4-664d92c9ee58 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:35.521439 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-109e4508-78e7-4783-88a4-664d92c9ee58 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:35.521921 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-109e4508-78e7-4783-88a4-664d92c9ee58 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:35.522691 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-109e4508-78e7-4783-88a4-664d92c9ee58 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:35.523122 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-109e4508-78e7-4783-88a4-664d92c9ee58 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:35.582888 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-109e4508-78e7-4783-88a4-664d92c9ee58 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 28684 microversion: 2.20 time: 0.073841 Aug 25 05:52:35.583408 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1119/2201] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:35 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 28684 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:36.595711 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e57391a6-44ef-4207-8c88-8a0193133ef2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:36.596741 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e57391a6-44ef-4207-8c88-8a0193133ef2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:36.603306 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e57391a6-44ef-4207-8c88-8a0193133ef2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:36.603806 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e57391a6-44ef-4207-8c88-8a0193133ef2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:36.604584 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e57391a6-44ef-4207-8c88-8a0193133ef2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:36.605015 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e57391a6-44ef-4207-8c88-8a0193133ef2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:36.666282 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e57391a6-44ef-4207-8c88-8a0193133ef2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 28684 microversion: 2.20 time: 0.075093 Aug 25 05:52:36.666958 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1083/2202] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:36 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 28684 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:37.679317 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-4e02f4e7-8eb8-4b3c-992d-49e27aed0b94 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:37.680313 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-4e02f4e7-8eb8-4b3c-992d-49e27aed0b94 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:37.687465 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4e02f4e7-8eb8-4b3c-992d-49e27aed0b94 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:37.687911 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4e02f4e7-8eb8-4b3c-992d-49e27aed0b94 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:37.688673 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4e02f4e7-8eb8-4b3c-992d-49e27aed0b94 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:37.689109 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4e02f4e7-8eb8-4b3c-992d-49e27aed0b94 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:37.759400 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-4e02f4e7-8eb8-4b3c-992d-49e27aed0b94 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 29106 microversion: 2.20 time: 0.083963 Aug 25 05:52:37.760041 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1120/2203] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:37 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 29106 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:38.771680 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c314749d-2107-4433-9eb7-abba879f61c2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:38.772732 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c314749d-2107-4433-9eb7-abba879f61c2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:38.780094 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c314749d-2107-4433-9eb7-abba879f61c2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:38.780538 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c314749d-2107-4433-9eb7-abba879f61c2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:38.781297 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c314749d-2107-4433-9eb7-abba879f61c2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:38.781765 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c314749d-2107-4433-9eb7-abba879f61c2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:38.852371 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c314749d-2107-4433-9eb7-abba879f61c2 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 31382 microversion: 2.20 time: 0.084594 Aug 25 05:52:38.853030 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1084/2204] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:38 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 31382 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:39.867985 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d1665b33-661a-4248-9192-741ce536c7a7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:39.869616 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d1665b33-661a-4248-9192-741ce536c7a7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:39.877391 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d1665b33-661a-4248-9192-741ce536c7a7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:39.877869 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d1665b33-661a-4248-9192-741ce536c7a7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:39.878636 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d1665b33-661a-4248-9192-741ce536c7a7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:39.879069 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d1665b33-661a-4248-9192-741ce536c7a7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:39.958797 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d1665b33-661a-4248-9192-741ce536c7a7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 33138 microversion: 2.20 time: 0.097646 Aug 25 05:52:39.959452 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1121/2205] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:39 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 33138 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:40.971040 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8e696f67-ded8-41da-9bf7-32e69bfdaa8e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:40.972018 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8e696f67-ded8-41da-9bf7-32e69bfdaa8e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:40.978444 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8e696f67-ded8-41da-9bf7-32e69bfdaa8e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:40.978881 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8e696f67-ded8-41da-9bf7-32e69bfdaa8e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:40.979628 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8e696f67-ded8-41da-9bf7-32e69bfdaa8e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:40.980057 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8e696f67-ded8-41da-9bf7-32e69bfdaa8e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:41.051509 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8e696f67-ded8-41da-9bf7-32e69bfdaa8e tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 34129 microversion: 2.20 time: 0.084333 Aug 25 05:52:41.054960 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1085/2206] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:40 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 34129 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:42.063706 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ccfdaf31-14dd-4f0d-98e2-58ddb384d176 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:42.064613 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ccfdaf31-14dd-4f0d-98e2-58ddb384d176 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:42.071092 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ccfdaf31-14dd-4f0d-98e2-58ddb384d176 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:42.071527 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ccfdaf31-14dd-4f0d-98e2-58ddb384d176 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:42.072277 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ccfdaf31-14dd-4f0d-98e2-58ddb384d176 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:42.072706 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ccfdaf31-14dd-4f0d-98e2-58ddb384d176 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:42.142566 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ccfdaf31-14dd-4f0d-98e2-58ddb384d176 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 35421 microversion: 2.20 time: 0.083500 Aug 25 05:52:42.143203 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1122/2207] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:42 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 35421 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:43.154841 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1d6588f5-dd4f-4de2-859d-61e4b38c13d7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:43.155823 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1d6588f5-dd4f-4de2-859d-61e4b38c13d7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:43.163553 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1d6588f5-dd4f-4de2-859d-61e4b38c13d7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:43.164032 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1d6588f5-dd4f-4de2-859d-61e4b38c13d7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:43.164789 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1d6588f5-dd4f-4de2-859d-61e4b38c13d7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:43.165225 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1d6588f5-dd4f-4de2-859d-61e4b38c13d7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:43.245110 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1d6588f5-dd4f-4de2-859d-61e4b38c13d7 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 36970 microversion: 2.20 time: 0.094020 Aug 25 05:52:43.255310 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1086/2208] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:43 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 36970 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:44.266019 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c0cc9076-644d-4d66-9722-be655c4a8b2d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:44.267046 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c0cc9076-644d-4d66-9722-be655c4a8b2d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:44.273993 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c0cc9076-644d-4d66-9722-be655c4a8b2d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:44.274426 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c0cc9076-644d-4d66-9722-be655c4a8b2d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:44.275736 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c0cc9076-644d-4d66-9722-be655c4a8b2d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:44.275736 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c0cc9076-644d-4d66-9722-be655c4a8b2d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:44.348386 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c0cc9076-644d-4d66-9722-be655c4a8b2d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 38240 microversion: 2.20 time: 0.086599 Aug 25 05:52:44.349039 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1123/2209] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:44 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 38240 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:45.361348 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-dc7549c9-6ce1-4684-9c44-5fed5b9764c5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:45.362406 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-dc7549c9-6ce1-4684-9c44-5fed5b9764c5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:45.368840 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dc7549c9-6ce1-4684-9c44-5fed5b9764c5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:45.369286 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dc7549c9-6ce1-4684-9c44-5fed5b9764c5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:45.370079 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dc7549c9-6ce1-4684-9c44-5fed5b9764c5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:45.370512 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dc7549c9-6ce1-4684-9c44-5fed5b9764c5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:45.429247 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-dc7549c9-6ce1-4684-9c44-5fed5b9764c5 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 38240 microversion: 2.20 time: 0.072361 Aug 25 05:52:45.430201 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1087/2210] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:45 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 38240 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:46.442071 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-204b4134-e909-4bb9-b2a8-30cafa6a3f83 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:46.443068 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-204b4134-e909-4bb9-b2a8-30cafa6a3f83 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:46.449470 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-204b4134-e909-4bb9-b2a8-30cafa6a3f83 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:46.449941 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-204b4134-e909-4bb9-b2a8-30cafa6a3f83 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:46.450696 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-204b4134-e909-4bb9-b2a8-30cafa6a3f83 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:46.451132 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-204b4134-e909-4bb9-b2a8-30cafa6a3f83 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:46.517069 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-204b4134-e909-4bb9-b2a8-30cafa6a3f83 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 38240 microversion: 2.20 time: 0.079037 Aug 25 05:52:46.517737 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1124/2211] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:46 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 38240 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:47.529254 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5309dfb0-39f5-4d8c-bc80-f030a3d8a1be tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:47.530279 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5309dfb0-39f5-4d8c-bc80-f030a3d8a1be tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:47.537368 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5309dfb0-39f5-4d8c-bc80-f030a3d8a1be tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:47.537855 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5309dfb0-39f5-4d8c-bc80-f030a3d8a1be tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:47.538614 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5309dfb0-39f5-4d8c-bc80-f030a3d8a1be tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:47.539039 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5309dfb0-39f5-4d8c-bc80-f030a3d8a1be tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:47.598129 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5309dfb0-39f5-4d8c-bc80-f030a3d8a1be tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 38240 microversion: 2.20 time: 0.072735 Aug 25 05:52:47.599000 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1088/2212] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:47 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 38240 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:48.611312 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-44e221c2-aa95-43af-94f8-5f1a7e91e376 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:52:48.612336 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-44e221c2-aa95-43af-94f8-5f1a7e91e376 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:48.618777 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-44e221c2-aa95-43af-94f8-5f1a7e91e376 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:48.619219 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-44e221c2-aa95-43af-94f8-5f1a7e91e376 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:48.619973 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-44e221c2-aa95-43af-94f8-5f1a7e91e376 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:48.620399 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-44e221c2-aa95-43af-94f8-5f1a7e91e376 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:48.688392 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-44e221c2-aa95-43af-94f8-5f1a7e91e376 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action" status: 200 len: 38383 microversion: 2.20 time: 0.081794 Aug 25 05:52:48.689240 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1125/2213] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 25 05:52:48 2021] POST /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/action => generated 38383 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:52:48.699037 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-fa91fb03-c654-46a1-8f0c-db39f7bbed2b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:52:48.699613 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-fa91fb03-c654-46a1-8f0c-db39f7bbed2b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:52:48.706783 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fa91fb03-c654-46a1-8f0c-db39f7bbed2b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:48.707219 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fa91fb03-c654-46a1-8f0c-db39f7bbed2b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:48.707977 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fa91fb03-c654-46a1-8f0c-db39f7bbed2b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:52:48.708411 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fa91fb03-c654-46a1-8f0c-db39f7bbed2b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:52:48.731766 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-fa91fb03-c654-46a1-8f0c-db39f7bbed2b tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/ips" status: 200 len: 151 microversion: 2.20 time: 0.036765 Aug 25 05:52:48.732327 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1089/2214] 10.222.0.42 () {60 vars in 1289 bytes} [Wed Aug 25 05:52:48 2021] GET /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:54:15.874286 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 05:54:15.874889 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: Wed Aug 25 05:54:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 05:54:23.236466 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 05:54:23.237019 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: Wed Aug 25 05:54:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 05:54:28.407341 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 05:54:28.408068 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: Wed Aug 25 05:54:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 05:54:38.907690 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-46d2540f-3786-4e34-80e6-df7425873d76 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:54:38.908468 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-46d2540f-3786-4e34-80e6-df7425873d76 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:54:38.915355 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-46d2540f-3786-4e34-80e6-df7425873d76 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:54:38.915800 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-46d2540f-3786-4e34-80e6-df7425873d76 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:54:38.916573 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-46d2540f-3786-4e34-80e6-df7425873d76 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:54:38.916999 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-46d2540f-3786-4e34-80e6-df7425873d76 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:54:38.945347 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-46d2540f-3786-4e34-80e6-df7425873d76 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Going to try to terminate instance {{(pid=108885) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 25 05:54:39.232868 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-46d2540f-3786-4e34-80e6-df7425873d76 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 204 len: 0 microversion: 2.1 time: 0.330973 Aug 25 05:54:39.234055 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1126/2215] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 25 05:54:38 2021] DELETE /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 05:54:39.242990 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a65bd1fc-5fb6-4791-9985-6413a29d0d24 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:54:39.243657 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a65bd1fc-5fb6-4791-9985-6413a29d0d24 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:54:39.250338 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a65bd1fc-5fb6-4791-9985-6413a29d0d24 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:54:39.250776 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a65bd1fc-5fb6-4791-9985-6413a29d0d24 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:54:39.251526 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a65bd1fc-5fb6-4791-9985-6413a29d0d24 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:54:39.251953 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a65bd1fc-5fb6-4791-9985-6413a29d0d24 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:54:39.375150 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-a65bd1fc-5fb6-4791-9985-6413a29d0d24 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:54:39.383031 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a65bd1fc-5fb6-4791-9985-6413a29d0d24 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1718 microversion: 2.1 time: 0.144650 Aug 25 05:54:39.383597 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1090/2216] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:54:39 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1718 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:54:40.400790 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-962dd36a-5dab-4361-b368-ebdb845f5693 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:54:40.401500 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-962dd36a-5dab-4361-b368-ebdb845f5693 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:54:40.407841 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-962dd36a-5dab-4361-b368-ebdb845f5693 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:54:40.408277 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-962dd36a-5dab-4361-b368-ebdb845f5693 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:54:40.409028 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-962dd36a-5dab-4361-b368-ebdb845f5693 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:54:40.409451 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-962dd36a-5dab-4361-b368-ebdb845f5693 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:54:40.602760 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-962dd36a-5dab-4361-b368-ebdb845f5693 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:54:40.611323 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-962dd36a-5dab-4361-b368-ebdb845f5693 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1718 microversion: 2.1 time: 0.214752 Aug 25 05:54:40.611893 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1127/2217] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:54:40 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1718 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:54:41.272732 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [req-822596a6-cee3-44ac-b21b-f29a2a100087 req-926a5629-8efe-4893-af31-64afc266e05a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c438716-186a-4b29-b29e-e9c6a71a5a27", "name": "network-vif-deleted", "tag": "b6d4c9a3-6a56-41ed-b144-3a1d1e9cfbd6"}]} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:54:41.274577 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:54:41.274577 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: warnings.warn(msg) Aug 25 05:54:41.283299 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-822596a6-cee3-44ac-b21b-f29a2a100087 req-926a5629-8efe-4893-af31-64afc266e05a service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:54:41.287034 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-822596a6-cee3-44ac-b21b-f29a2a100087 req-926a5629-8efe-4893-af31-64afc266e05a service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:54:41.296501 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.compute.server_external_events [req-822596a6-cee3-44ac-b21b-f29a2a100087 req-926a5629-8efe-4893-af31-64afc266e05a service nova] Creating event network-vif-deleted:b6d4c9a3-6a56-41ed-b144-3a1d1e9cfbd6 for instance 4c438716-186a-4b29-b29e-e9c6a71a5a27 on hv-cinder-78662 Aug 25 05:54:41.302112 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [req-822596a6-cee3-44ac-b21b-f29a2a100087 req-926a5629-8efe-4893-af31-64afc266e05a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034452 Aug 25 05:54:41.302880 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1091/2218] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:54:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:54:41.628981 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-127e9f4e-da52-4749-a2d5-267bb64e998b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:54:41.629597 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-127e9f4e-da52-4749-a2d5-267bb64e998b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:54:41.635527 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-127e9f4e-da52-4749-a2d5-267bb64e998b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:54:41.636048 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-127e9f4e-da52-4749-a2d5-267bb64e998b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:54:41.636837 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-127e9f4e-da52-4749-a2d5-267bb64e998b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:54:41.637272 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-127e9f4e-da52-4749-a2d5-267bb64e998b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:54:41.706172 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-127e9f4e-da52-4749-a2d5-267bb64e998b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:54:41.714201 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-127e9f4e-da52-4749-a2d5-267bb64e998b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.089030 Aug 25 05:54:41.714705 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1128/2219] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:54:41 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:54:42.734656 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1395fbf4-e224-4627-946b-fbe907d36f04 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:54:42.735871 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1395fbf4-e224-4627-946b-fbe907d36f04 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:54:42.745676 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1395fbf4-e224-4627-946b-fbe907d36f04 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:54:42.746124 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1395fbf4-e224-4627-946b-fbe907d36f04 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:54:42.746896 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1395fbf4-e224-4627-946b-fbe907d36f04 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:54:42.747330 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1395fbf4-e224-4627-946b-fbe907d36f04 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:54:42.817311 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-1395fbf4-e224-4627-946b-fbe907d36f04 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:54:42.830934 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1395fbf4-e224-4627-946b-fbe907d36f04 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.102717 Aug 25 05:54:42.831960 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1092/2220] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:54:42 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:54:43.852383 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5ef85062-f541-4638-9114-6411fd4b5150 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:54:43.852940 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5ef85062-f541-4638-9114-6411fd4b5150 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:54:43.859766 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5ef85062-f541-4638-9114-6411fd4b5150 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:54:43.860208 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5ef85062-f541-4638-9114-6411fd4b5150 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:54:43.860954 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5ef85062-f541-4638-9114-6411fd4b5150 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:54:43.861377 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5ef85062-f541-4638-9114-6411fd4b5150 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:54:43.926953 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-5ef85062-f541-4638-9114-6411fd4b5150 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:54:43.934973 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5ef85062-f541-4638-9114-6411fd4b5150 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.086371 Aug 25 05:54:43.935697 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1129/2221] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:54:43 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:54:44.952665 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-87eea7f9-fa48-46d9-8afa-4bdfb9cac243 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:54:44.953672 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-87eea7f9-fa48-46d9-8afa-4bdfb9cac243 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:54:44.960576 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-87eea7f9-fa48-46d9-8afa-4bdfb9cac243 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:54:44.961018 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-87eea7f9-fa48-46d9-8afa-4bdfb9cac243 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:54:44.961888 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-87eea7f9-fa48-46d9-8afa-4bdfb9cac243 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:54:44.962238 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-87eea7f9-fa48-46d9-8afa-4bdfb9cac243 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:54:45.024851 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-87eea7f9-fa48-46d9-8afa-4bdfb9cac243 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:54:45.034485 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-87eea7f9-fa48-46d9-8afa-4bdfb9cac243 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.086247 Aug 25 05:54:45.035068 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1093/2222] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:54:44 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:54:46.051722 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e2963318-a2fc-428a-9783-3c155adb2e8a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:54:46.052330 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e2963318-a2fc-428a-9783-3c155adb2e8a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:54:46.058245 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e2963318-a2fc-428a-9783-3c155adb2e8a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:54:46.058688 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e2963318-a2fc-428a-9783-3c155adb2e8a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:54:46.059442 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e2963318-a2fc-428a-9783-3c155adb2e8a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:54:46.059866 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e2963318-a2fc-428a-9783-3c155adb2e8a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:54:46.126904 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-e2963318-a2fc-428a-9783-3c155adb2e8a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:54:46.134808 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e2963318-a2fc-428a-9783-3c155adb2e8a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.087090 Aug 25 05:54:46.135367 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1130/2223] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:54:46 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:54:47.152963 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-291cce40-b0e7-4710-984d-8ac6f2f6b9b8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:54:47.153592 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-291cce40-b0e7-4710-984d-8ac6f2f6b9b8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:54:47.162394 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-291cce40-b0e7-4710-984d-8ac6f2f6b9b8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:54:47.163125 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-291cce40-b0e7-4710-984d-8ac6f2f6b9b8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:54:47.163911 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-291cce40-b0e7-4710-984d-8ac6f2f6b9b8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:54:47.164346 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-291cce40-b0e7-4710-984d-8ac6f2f6b9b8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:54:47.226311 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-291cce40-b0e7-4710-984d-8ac6f2f6b9b8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:54:47.234858 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-291cce40-b0e7-4710-984d-8ac6f2f6b9b8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.086050 Aug 25 05:54:47.235424 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1094/2224] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:54:47 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:54:48.251994 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-de74afae-9b9e-4a9d-a740-4d97c4bba04e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:54:48.252582 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-de74afae-9b9e-4a9d-a740-4d97c4bba04e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:54:48.258710 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-de74afae-9b9e-4a9d-a740-4d97c4bba04e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:54:48.259147 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-de74afae-9b9e-4a9d-a740-4d97c4bba04e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:54:48.259889 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-de74afae-9b9e-4a9d-a740-4d97c4bba04e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:54:48.260312 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-de74afae-9b9e-4a9d-a740-4d97c4bba04e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:54:48.330080 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-de74afae-9b9e-4a9d-a740-4d97c4bba04e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:54:48.337786 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-de74afae-9b9e-4a9d-a740-4d97c4bba04e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.090081 Aug 25 05:54:48.338333 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1131/2225] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:54:48 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:54:49.354110 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c41fb778-7b4d-47d4-bacc-2bc2bfb4cfa2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:54:49.354735 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c41fb778-7b4d-47d4-bacc-2bc2bfb4cfa2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:54:49.361664 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c41fb778-7b4d-47d4-bacc-2bc2bfb4cfa2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:54:49.362112 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c41fb778-7b4d-47d4-bacc-2bc2bfb4cfa2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:54:49.362860 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c41fb778-7b4d-47d4-bacc-2bc2bfb4cfa2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:54:49.363287 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c41fb778-7b4d-47d4-bacc-2bc2bfb4cfa2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:54:49.423019 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-c41fb778-7b4d-47d4-bacc-2bc2bfb4cfa2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:54:49.430658 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c41fb778-7b4d-47d4-bacc-2bc2bfb4cfa2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.080149 Aug 25 05:54:49.431220 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1095/2226] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:54:49 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:54:50.448062 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ab9b1449-7947-4890-83f5-9a3e556b6044 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:54:50.448658 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ab9b1449-7947-4890-83f5-9a3e556b6044 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:54:50.454599 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ab9b1449-7947-4890-83f5-9a3e556b6044 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:54:50.455043 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ab9b1449-7947-4890-83f5-9a3e556b6044 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:54:50.455798 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ab9b1449-7947-4890-83f5-9a3e556b6044 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:54:50.456225 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ab9b1449-7947-4890-83f5-9a3e556b6044 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:54:50.515327 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ab9b1449-7947-4890-83f5-9a3e556b6044 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:54:50.523179 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ab9b1449-7947-4890-83f5-9a3e556b6044 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.078850 Aug 25 05:54:50.523731 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1132/2227] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:54:50 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:54:51.540092 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-65956f13-4abd-4b70-a395-2d517e4c0f37 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:54:51.540707 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-65956f13-4abd-4b70-a395-2d517e4c0f37 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:54:51.547051 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-65956f13-4abd-4b70-a395-2d517e4c0f37 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:54:51.547500 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-65956f13-4abd-4b70-a395-2d517e4c0f37 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:54:51.548252 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-65956f13-4abd-4b70-a395-2d517e4c0f37 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:54:51.548680 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-65956f13-4abd-4b70-a395-2d517e4c0f37 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:54:51.607451 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-65956f13-4abd-4b70-a395-2d517e4c0f37 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:54:51.619971 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-65956f13-4abd-4b70-a395-2d517e4c0f37 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.083547 Aug 25 05:54:51.620531 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1096/2228] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:54:51 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:54:52.637322 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-53d2543d-67af-46ba-8ab6-13f7d1287238 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:54:52.637910 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-53d2543d-67af-46ba-8ab6-13f7d1287238 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:54:52.644654 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-53d2543d-67af-46ba-8ab6-13f7d1287238 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:54:52.645105 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-53d2543d-67af-46ba-8ab6-13f7d1287238 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:54:52.645919 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-53d2543d-67af-46ba-8ab6-13f7d1287238 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:54:52.646347 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-53d2543d-67af-46ba-8ab6-13f7d1287238 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:54:52.705645 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-53d2543d-67af-46ba-8ab6-13f7d1287238 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:54:52.713568 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-53d2543d-67af-46ba-8ab6-13f7d1287238 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.079847 Aug 25 05:54:52.714224 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1133/2229] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:54:52 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:54:53.729932 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-375fbc3c-e9b3-4314-a5e5-87fa84e27eef tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:54:53.730488 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-375fbc3c-e9b3-4314-a5e5-87fa84e27eef tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:54:53.737415 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-375fbc3c-e9b3-4314-a5e5-87fa84e27eef tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:54:53.737895 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-375fbc3c-e9b3-4314-a5e5-87fa84e27eef tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:54:53.738673 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-375fbc3c-e9b3-4314-a5e5-87fa84e27eef tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:54:53.739091 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-375fbc3c-e9b3-4314-a5e5-87fa84e27eef tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:54:53.798937 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-375fbc3c-e9b3-4314-a5e5-87fa84e27eef tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:54:53.806948 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-375fbc3c-e9b3-4314-a5e5-87fa84e27eef tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.080754 Aug 25 05:54:53.807506 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1097/2230] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:54:53 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:54:54.822857 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-785cd5e2-e51b-4c09-9288-f92218369768 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:54:54.823467 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-785cd5e2-e51b-4c09-9288-f92218369768 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:54:54.829696 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-785cd5e2-e51b-4c09-9288-f92218369768 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:54:54.830136 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-785cd5e2-e51b-4c09-9288-f92218369768 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:54:54.830905 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-785cd5e2-e51b-4c09-9288-f92218369768 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:54:54.831333 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-785cd5e2-e51b-4c09-9288-f92218369768 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:54:54.896167 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-785cd5e2-e51b-4c09-9288-f92218369768 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:54:54.904422 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-785cd5e2-e51b-4c09-9288-f92218369768 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.085230 Aug 25 05:54:54.904977 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1134/2231] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:54:54 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:54:55.919973 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-270655ce-9162-4515-94f8-6be3b08fae0f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:54:55.921422 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-270655ce-9162-4515-94f8-6be3b08fae0f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:54:55.927787 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-270655ce-9162-4515-94f8-6be3b08fae0f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:54:55.928369 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-270655ce-9162-4515-94f8-6be3b08fae0f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:54:55.934154 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-270655ce-9162-4515-94f8-6be3b08fae0f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:54:55.934584 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-270655ce-9162-4515-94f8-6be3b08fae0f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:54:55.998450 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-270655ce-9162-4515-94f8-6be3b08fae0f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:54:56.006273 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-270655ce-9162-4515-94f8-6be3b08fae0f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.089925 Aug 25 05:54:56.006822 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1098/2232] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:54:55 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:54:57.022271 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-0ff86ddd-7cc3-4e04-9953-4ca5a0921499 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:54:57.022863 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-0ff86ddd-7cc3-4e04-9953-4ca5a0921499 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:54:57.028943 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0ff86ddd-7cc3-4e04-9953-4ca5a0921499 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:54:57.029379 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0ff86ddd-7cc3-4e04-9953-4ca5a0921499 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:54:57.030194 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0ff86ddd-7cc3-4e04-9953-4ca5a0921499 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:54:57.030726 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0ff86ddd-7cc3-4e04-9953-4ca5a0921499 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:54:57.089839 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-0ff86ddd-7cc3-4e04-9953-4ca5a0921499 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:54:57.097567 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-0ff86ddd-7cc3-4e04-9953-4ca5a0921499 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.078882 Aug 25 05:54:57.098128 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1135/2233] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:54:57 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:54:58.113981 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-0a4a3540-af23-4d75-8d7d-5d6b42cebb2b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:54:58.114530 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-0a4a3540-af23-4d75-8d7d-5d6b42cebb2b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:54:58.120730 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0a4a3540-af23-4d75-8d7d-5d6b42cebb2b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:54:58.121172 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0a4a3540-af23-4d75-8d7d-5d6b42cebb2b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:54:58.121954 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0a4a3540-af23-4d75-8d7d-5d6b42cebb2b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:54:58.122383 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0a4a3540-af23-4d75-8d7d-5d6b42cebb2b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:54:58.182100 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-0a4a3540-af23-4d75-8d7d-5d6b42cebb2b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:54:58.190418 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-0a4a3540-af23-4d75-8d7d-5d6b42cebb2b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.080115 Aug 25 05:54:58.190983 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1099/2234] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:54:58 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:54:59.207302 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7883c753-37a6-44ec-931d-2a1dae8baf70 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:54:59.207897 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-7883c753-37a6-44ec-931d-2a1dae8baf70 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:54:59.213729 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7883c753-37a6-44ec-931d-2a1dae8baf70 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:54:59.214168 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7883c753-37a6-44ec-931d-2a1dae8baf70 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:54:59.214910 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7883c753-37a6-44ec-931d-2a1dae8baf70 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:54:59.215330 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7883c753-37a6-44ec-931d-2a1dae8baf70 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:54:59.276183 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-7883c753-37a6-44ec-931d-2a1dae8baf70 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:54:59.284583 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-7883c753-37a6-44ec-931d-2a1dae8baf70 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.080914 Aug 25 05:54:59.285141 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1136/2235] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:54:59 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:00.300238 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-dc02927e-9740-4054-8664-56593f91f929 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:00.300856 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-dc02927e-9740-4054-8664-56593f91f929 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:00.306765 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dc02927e-9740-4054-8664-56593f91f929 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:00.307269 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dc02927e-9740-4054-8664-56593f91f929 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:00.307994 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dc02927e-9740-4054-8664-56593f91f929 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:00.308424 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dc02927e-9740-4054-8664-56593f91f929 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:00.368481 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-dc02927e-9740-4054-8664-56593f91f929 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:00.377109 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-dc02927e-9740-4054-8664-56593f91f929 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.080569 Aug 25 05:55:00.377682 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1100/2236] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:00 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:01.394447 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1f671473-f8cd-4f8f-98b9-d23a6ed6ceb8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:01.395015 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1f671473-f8cd-4f8f-98b9-d23a6ed6ceb8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:01.401595 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1f671473-f8cd-4f8f-98b9-d23a6ed6ceb8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:01.402044 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1f671473-f8cd-4f8f-98b9-d23a6ed6ceb8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:01.402814 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1f671473-f8cd-4f8f-98b9-d23a6ed6ceb8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:01.403248 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1f671473-f8cd-4f8f-98b9-d23a6ed6ceb8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:01.468940 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-1f671473-f8cd-4f8f-98b9-d23a6ed6ceb8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:01.477166 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1f671473-f8cd-4f8f-98b9-d23a6ed6ceb8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.087188 Aug 25 05:55:01.477757 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1137/2237] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:01 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:02.494395 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-744046da-adae-46dc-9322-843432ff0eef tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:02.494973 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-744046da-adae-46dc-9322-843432ff0eef tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:02.502576 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-744046da-adae-46dc-9322-843432ff0eef tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:02.503018 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-744046da-adae-46dc-9322-843432ff0eef tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:02.503773 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-744046da-adae-46dc-9322-843432ff0eef tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:02.504200 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-744046da-adae-46dc-9322-843432ff0eef tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:02.565760 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-744046da-adae-46dc-9322-843432ff0eef tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:02.573624 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-744046da-adae-46dc-9322-843432ff0eef tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.082982 Aug 25 05:55:02.574176 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1101/2238] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:02 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:03.590134 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-61a4a3cd-ef69-49a8-8516-2dbb918b3832 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:03.590775 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-61a4a3cd-ef69-49a8-8516-2dbb918b3832 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:03.596729 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-61a4a3cd-ef69-49a8-8516-2dbb918b3832 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:03.597171 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-61a4a3cd-ef69-49a8-8516-2dbb918b3832 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:03.597959 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-61a4a3cd-ef69-49a8-8516-2dbb918b3832 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:03.598392 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-61a4a3cd-ef69-49a8-8516-2dbb918b3832 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:03.658645 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-61a4a3cd-ef69-49a8-8516-2dbb918b3832 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:03.666199 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-61a4a3cd-ef69-49a8-8516-2dbb918b3832 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.079745 Aug 25 05:55:03.666767 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1138/2239] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:03 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:04.682247 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b9e4d179-390f-4572-9fe1-bea8fc2dda10 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:04.682851 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b9e4d179-390f-4572-9fe1-bea8fc2dda10 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:04.688539 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b9e4d179-390f-4572-9fe1-bea8fc2dda10 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:04.688978 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b9e4d179-390f-4572-9fe1-bea8fc2dda10 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:04.689770 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b9e4d179-390f-4572-9fe1-bea8fc2dda10 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:04.690196 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b9e4d179-390f-4572-9fe1-bea8fc2dda10 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:04.755146 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-b9e4d179-390f-4572-9fe1-bea8fc2dda10 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:04.763437 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b9e4d179-390f-4572-9fe1-bea8fc2dda10 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.084662 Aug 25 05:55:04.764021 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1102/2240] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:04 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:05.780141 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6b4796b5-bd9a-4c13-81a1-b7701b48f4b1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:05.780797 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6b4796b5-bd9a-4c13-81a1-b7701b48f4b1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:05.787873 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6b4796b5-bd9a-4c13-81a1-b7701b48f4b1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:05.788317 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6b4796b5-bd9a-4c13-81a1-b7701b48f4b1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:05.789070 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6b4796b5-bd9a-4c13-81a1-b7701b48f4b1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:05.789500 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6b4796b5-bd9a-4c13-81a1-b7701b48f4b1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:05.848537 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-6b4796b5-bd9a-4c13-81a1-b7701b48f4b1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:05.856212 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6b4796b5-bd9a-4c13-81a1-b7701b48f4b1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.079711 Aug 25 05:55:05.856761 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1139/2241] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:05 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:06.873130 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-4898b44b-09b6-410c-a8c5-dfd24cdc29e2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:06.873783 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-4898b44b-09b6-410c-a8c5-dfd24cdc29e2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:06.880226 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4898b44b-09b6-410c-a8c5-dfd24cdc29e2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:06.880661 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4898b44b-09b6-410c-a8c5-dfd24cdc29e2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:06.881402 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4898b44b-09b6-410c-a8c5-dfd24cdc29e2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:06.881851 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4898b44b-09b6-410c-a8c5-dfd24cdc29e2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:06.941581 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-4898b44b-09b6-410c-a8c5-dfd24cdc29e2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:06.949581 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-4898b44b-09b6-410c-a8c5-dfd24cdc29e2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.079980 Aug 25 05:55:06.950188 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1103/2242] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:06 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:07.966191 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-fab1fc65-8d33-4226-8600-bb65a47831d8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:07.966929 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-fab1fc65-8d33-4226-8600-bb65a47831d8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:07.973671 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fab1fc65-8d33-4226-8600-bb65a47831d8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:07.974162 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fab1fc65-8d33-4226-8600-bb65a47831d8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:07.974982 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fab1fc65-8d33-4226-8600-bb65a47831d8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:07.975426 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fab1fc65-8d33-4226-8600-bb65a47831d8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:08.041035 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-fab1fc65-8d33-4226-8600-bb65a47831d8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:08.048879 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-fab1fc65-8d33-4226-8600-bb65a47831d8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.086396 Aug 25 05:55:08.049514 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1140/2243] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:07 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:09.064848 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7fc19d66-f88a-4e48-8463-f1080e7fab0b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:09.065454 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7fc19d66-f88a-4e48-8463-f1080e7fab0b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:09.071585 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7fc19d66-f88a-4e48-8463-f1080e7fab0b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:09.072032 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7fc19d66-f88a-4e48-8463-f1080e7fab0b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:09.072792 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7fc19d66-f88a-4e48-8463-f1080e7fab0b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:09.073230 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7fc19d66-f88a-4e48-8463-f1080e7fab0b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:09.132367 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-7fc19d66-f88a-4e48-8463-f1080e7fab0b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:09.141234 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7fc19d66-f88a-4e48-8463-f1080e7fab0b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.080232 Aug 25 05:55:09.141829 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1104/2244] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:09 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:10.159188 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-3aeee91d-76db-4940-869c-32a8f0167815 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:10.159733 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-3aeee91d-76db-4940-869c-32a8f0167815 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:10.165583 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3aeee91d-76db-4940-869c-32a8f0167815 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:10.166035 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3aeee91d-76db-4940-869c-32a8f0167815 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:10.166792 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3aeee91d-76db-4940-869c-32a8f0167815 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:10.167255 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3aeee91d-76db-4940-869c-32a8f0167815 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:10.231862 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-3aeee91d-76db-4940-869c-32a8f0167815 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:10.240158 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-3aeee91d-76db-4940-869c-32a8f0167815 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.085470 Aug 25 05:55:10.240711 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1141/2245] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:10 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:11.256317 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-12b1be73-1c64-45ab-b41c-ab9913a023cf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:11.256919 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-12b1be73-1c64-45ab-b41c-ab9913a023cf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:11.262673 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-12b1be73-1c64-45ab-b41c-ab9913a023cf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:11.263110 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-12b1be73-1c64-45ab-b41c-ab9913a023cf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:11.263855 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-12b1be73-1c64-45ab-b41c-ab9913a023cf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:11.264345 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-12b1be73-1c64-45ab-b41c-ab9913a023cf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:11.330243 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-12b1be73-1c64-45ab-b41c-ab9913a023cf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:11.337986 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-12b1be73-1c64-45ab-b41c-ab9913a023cf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.085207 Aug 25 05:55:11.338542 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1105/2246] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:11 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:12.354045 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-088da10e-4c34-477a-bbd8-feede23ab67e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:12.354650 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-088da10e-4c34-477a-bbd8-feede23ab67e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:12.360463 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-088da10e-4c34-477a-bbd8-feede23ab67e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:12.360929 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-088da10e-4c34-477a-bbd8-feede23ab67e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:12.361734 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-088da10e-4c34-477a-bbd8-feede23ab67e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:12.362160 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-088da10e-4c34-477a-bbd8-feede23ab67e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:12.421506 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-088da10e-4c34-477a-bbd8-feede23ab67e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:12.429111 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-088da10e-4c34-477a-bbd8-feede23ab67e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.078641 Aug 25 05:55:12.429695 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1142/2247] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:12 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:13.446114 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-fce37563-1ec1-445a-9d37-6f599fdb8366 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:13.446720 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-fce37563-1ec1-445a-9d37-6f599fdb8366 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:13.452619 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fce37563-1ec1-445a-9d37-6f599fdb8366 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:13.453056 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fce37563-1ec1-445a-9d37-6f599fdb8366 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:13.453840 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fce37563-1ec1-445a-9d37-6f599fdb8366 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:13.454278 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fce37563-1ec1-445a-9d37-6f599fdb8366 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:13.519681 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-fce37563-1ec1-445a-9d37-6f599fdb8366 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:13.527675 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-fce37563-1ec1-445a-9d37-6f599fdb8366 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.085153 Aug 25 05:55:13.528230 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1106/2248] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:13 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:14.551357 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-3a48f600-7d94-4a2f-ae1b-71cb00371c59 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:14.551965 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-3a48f600-7d94-4a2f-ae1b-71cb00371c59 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:14.557814 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3a48f600-7d94-4a2f-ae1b-71cb00371c59 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:14.558256 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3a48f600-7d94-4a2f-ae1b-71cb00371c59 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:14.559008 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3a48f600-7d94-4a2f-ae1b-71cb00371c59 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:14.559437 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3a48f600-7d94-4a2f-ae1b-71cb00371c59 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:14.622129 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-3a48f600-7d94-4a2f-ae1b-71cb00371c59 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:14.630819 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-3a48f600-7d94-4a2f-ae1b-71cb00371c59 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.083524 Aug 25 05:55:14.631375 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1143/2249] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:14 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:15.647263 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-094ef4d4-cf6f-45bc-81a1-dd4a48c2f52a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:15.647867 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-094ef4d4-cf6f-45bc-81a1-dd4a48c2f52a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:15.654107 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-094ef4d4-cf6f-45bc-81a1-dd4a48c2f52a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:15.654562 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-094ef4d4-cf6f-45bc-81a1-dd4a48c2f52a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:15.655293 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-094ef4d4-cf6f-45bc-81a1-dd4a48c2f52a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:15.655715 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-094ef4d4-cf6f-45bc-81a1-dd4a48c2f52a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:15.714149 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-094ef4d4-cf6f-45bc-81a1-dd4a48c2f52a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:15.722396 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-094ef4d4-cf6f-45bc-81a1-dd4a48c2f52a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.078794 Aug 25 05:55:15.722952 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1107/2250] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:15 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:16.738290 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-859f0749-c27b-4890-bdf7-c78ad5c55e46 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:16.738901 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-859f0749-c27b-4890-bdf7-c78ad5c55e46 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:16.744693 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-859f0749-c27b-4890-bdf7-c78ad5c55e46 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:16.745166 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-859f0749-c27b-4890-bdf7-c78ad5c55e46 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:16.745918 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-859f0749-c27b-4890-bdf7-c78ad5c55e46 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:16.746349 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-859f0749-c27b-4890-bdf7-c78ad5c55e46 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:16.805736 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-859f0749-c27b-4890-bdf7-c78ad5c55e46 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:16.813292 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-859f0749-c27b-4890-bdf7-c78ad5c55e46 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.078704 Aug 25 05:55:16.813876 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1144/2251] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:16 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:17.830129 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-bf21ef55-d3a8-46f9-af65-f87237f27d75 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:17.830694 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-bf21ef55-d3a8-46f9-af65-f87237f27d75 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:17.836393 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bf21ef55-d3a8-46f9-af65-f87237f27d75 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:17.836831 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bf21ef55-d3a8-46f9-af65-f87237f27d75 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:17.837594 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bf21ef55-d3a8-46f9-af65-f87237f27d75 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:17.838023 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bf21ef55-d3a8-46f9-af65-f87237f27d75 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:17.898099 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-bf21ef55-d3a8-46f9-af65-f87237f27d75 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:17.906005 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-bf21ef55-d3a8-46f9-af65-f87237f27d75 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.079851 Aug 25 05:55:17.906567 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1108/2252] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:17 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:18.922945 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d60af809-ad73-415d-a4d7-ddf8952bccf8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:18.924043 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d60af809-ad73-415d-a4d7-ddf8952bccf8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:18.930471 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d60af809-ad73-415d-a4d7-ddf8952bccf8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:18.930912 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d60af809-ad73-415d-a4d7-ddf8952bccf8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:18.931675 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d60af809-ad73-415d-a4d7-ddf8952bccf8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:18.932103 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d60af809-ad73-415d-a4d7-ddf8952bccf8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:19.000798 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d60af809-ad73-415d-a4d7-ddf8952bccf8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:19.009736 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d60af809-ad73-415d-a4d7-ddf8952bccf8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.090342 Aug 25 05:55:19.010336 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1145/2253] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:18 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:20.026927 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-26cc37b6-39f2-4d48-a0e5-6d063360b8dc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:20.027588 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-26cc37b6-39f2-4d48-a0e5-6d063360b8dc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:20.033870 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-26cc37b6-39f2-4d48-a0e5-6d063360b8dc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:20.034304 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-26cc37b6-39f2-4d48-a0e5-6d063360b8dc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:20.035050 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-26cc37b6-39f2-4d48-a0e5-6d063360b8dc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:20.035472 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-26cc37b6-39f2-4d48-a0e5-6d063360b8dc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:20.093293 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-26cc37b6-39f2-4d48-a0e5-6d063360b8dc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:20.101678 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-26cc37b6-39f2-4d48-a0e5-6d063360b8dc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.078631 Aug 25 05:55:20.102234 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1109/2254] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:20 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:21.118148 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c4b58dfa-6176-40af-a0de-762dafa69ec5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:21.118747 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c4b58dfa-6176-40af-a0de-762dafa69ec5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:21.124618 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c4b58dfa-6176-40af-a0de-762dafa69ec5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:21.125060 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c4b58dfa-6176-40af-a0de-762dafa69ec5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:21.125840 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c4b58dfa-6176-40af-a0de-762dafa69ec5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:21.126273 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c4b58dfa-6176-40af-a0de-762dafa69ec5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:21.190200 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-c4b58dfa-6176-40af-a0de-762dafa69ec5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:21.198062 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c4b58dfa-6176-40af-a0de-762dafa69ec5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.083539 Aug 25 05:55:21.198628 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1146/2255] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:21 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:22.214846 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d1105ddc-e00b-4c21-bda4-0b10212656bb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:22.215431 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-d1105ddc-e00b-4c21-bda4-0b10212656bb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:22.221959 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d1105ddc-e00b-4c21-bda4-0b10212656bb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:22.222404 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d1105ddc-e00b-4c21-bda4-0b10212656bb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:22.223312 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d1105ddc-e00b-4c21-bda4-0b10212656bb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:22.223727 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d1105ddc-e00b-4c21-bda4-0b10212656bb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:22.295080 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-d1105ddc-e00b-4c21-bda4-0b10212656bb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:22.303260 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d1105ddc-e00b-4c21-bda4-0b10212656bb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.092222 Aug 25 05:55:22.303822 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1110/2256] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:22 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:23.319511 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-0693c3f6-2363-4651-a0fc-9d99615b6536 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:23.320114 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-0693c3f6-2363-4651-a0fc-9d99615b6536 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:23.326291 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0693c3f6-2363-4651-a0fc-9d99615b6536 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:23.326729 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0693c3f6-2363-4651-a0fc-9d99615b6536 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:23.327481 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0693c3f6-2363-4651-a0fc-9d99615b6536 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:23.327912 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0693c3f6-2363-4651-a0fc-9d99615b6536 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:23.389263 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-0693c3f6-2363-4651-a0fc-9d99615b6536 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:23.397600 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-0693c3f6-2363-4651-a0fc-9d99615b6536 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.081679 Aug 25 05:55:23.398162 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1147/2257] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:23 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:24.415016 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c3203f33-7720-4f8c-9875-74dfc988f3d8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:24.415653 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c3203f33-7720-4f8c-9875-74dfc988f3d8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:24.421466 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c3203f33-7720-4f8c-9875-74dfc988f3d8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:24.421930 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c3203f33-7720-4f8c-9875-74dfc988f3d8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:24.424511 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c3203f33-7720-4f8c-9875-74dfc988f3d8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:24.424983 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c3203f33-7720-4f8c-9875-74dfc988f3d8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:24.485954 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-c3203f33-7720-4f8c-9875-74dfc988f3d8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:24.494860 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c3203f33-7720-4f8c-9875-74dfc988f3d8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.083572 Aug 25 05:55:24.495425 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1111/2258] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:24 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:25.511849 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-0f2b0b50-fe81-4d76-aef4-0dc58c4b038a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:25.512451 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-0f2b0b50-fe81-4d76-aef4-0dc58c4b038a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:25.518990 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0f2b0b50-fe81-4d76-aef4-0dc58c4b038a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:25.519536 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0f2b0b50-fe81-4d76-aef4-0dc58c4b038a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:25.520304 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0f2b0b50-fe81-4d76-aef4-0dc58c4b038a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:25.520730 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0f2b0b50-fe81-4d76-aef4-0dc58c4b038a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:25.582115 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-0f2b0b50-fe81-4d76-aef4-0dc58c4b038a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:25.590199 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-0f2b0b50-fe81-4d76-aef4-0dc58c4b038a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.081987 Aug 25 05:55:25.590762 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1148/2259] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:25 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:26.607067 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6a91b32d-166b-4156-8567-5dbe035ead66 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:26.607652 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6a91b32d-166b-4156-8567-5dbe035ead66 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:26.614777 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6a91b32d-166b-4156-8567-5dbe035ead66 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:26.615219 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6a91b32d-166b-4156-8567-5dbe035ead66 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:26.615979 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6a91b32d-166b-4156-8567-5dbe035ead66 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:26.616410 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6a91b32d-166b-4156-8567-5dbe035ead66 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:26.692874 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6a91b32d-166b-4156-8567-5dbe035ead66 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:26.700963 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6a91b32d-166b-4156-8567-5dbe035ead66 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.097626 Aug 25 05:55:26.701557 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1112/2260] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:26 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:27.717909 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f31d7e0f-76d8-4542-866e-c279d74f50e7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:27.718603 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f31d7e0f-76d8-4542-866e-c279d74f50e7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:27.725178 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f31d7e0f-76d8-4542-866e-c279d74f50e7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:27.725647 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f31d7e0f-76d8-4542-866e-c279d74f50e7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:27.726421 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f31d7e0f-76d8-4542-866e-c279d74f50e7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:27.726857 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f31d7e0f-76d8-4542-866e-c279d74f50e7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:27.792472 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-f31d7e0f-76d8-4542-866e-c279d74f50e7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:27.800493 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f31d7e0f-76d8-4542-866e-c279d74f50e7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.086633 Aug 25 05:55:27.801045 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1149/2261] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:27 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:28.816268 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1c378c8b-17b8-4fd0-be1f-43929bd55307 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:28.816846 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1c378c8b-17b8-4fd0-be1f-43929bd55307 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:28.823102 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1c378c8b-17b8-4fd0-be1f-43929bd55307 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:28.823539 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1c378c8b-17b8-4fd0-be1f-43929bd55307 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:28.824292 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1c378c8b-17b8-4fd0-be1f-43929bd55307 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:28.824717 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1c378c8b-17b8-4fd0-be1f-43929bd55307 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:28.887622 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-1c378c8b-17b8-4fd0-be1f-43929bd55307 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:28.896269 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1c378c8b-17b8-4fd0-be1f-43929bd55307 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.083756 Aug 25 05:55:28.896864 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1113/2262] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:28 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:29.917880 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-48454b16-c5e3-464f-9d9e-3af43d2f9648 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:29.918488 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-48454b16-c5e3-464f-9d9e-3af43d2f9648 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:29.924917 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-48454b16-c5e3-464f-9d9e-3af43d2f9648 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:29.925360 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-48454b16-c5e3-464f-9d9e-3af43d2f9648 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:29.926213 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-48454b16-c5e3-464f-9d9e-3af43d2f9648 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:29.926649 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-48454b16-c5e3-464f-9d9e-3af43d2f9648 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:29.985833 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-48454b16-c5e3-464f-9d9e-3af43d2f9648 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:29.993640 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-48454b16-c5e3-464f-9d9e-3af43d2f9648 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.079425 Aug 25 05:55:29.994203 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1150/2263] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:29 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:31.010224 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-bdd96b72-0c16-4725-be24-3a00a74a391d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:31.010816 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-bdd96b72-0c16-4725-be24-3a00a74a391d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:31.016779 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bdd96b72-0c16-4725-be24-3a00a74a391d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:31.017230 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bdd96b72-0c16-4725-be24-3a00a74a391d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:31.018093 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bdd96b72-0c16-4725-be24-3a00a74a391d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:31.018526 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bdd96b72-0c16-4725-be24-3a00a74a391d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:31.077864 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-bdd96b72-0c16-4725-be24-3a00a74a391d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:31.086423 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-bdd96b72-0c16-4725-be24-3a00a74a391d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.079935 Aug 25 05:55:31.087332 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1114/2264] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:31 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:32.104502 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-12e753cb-787f-4857-8d08-5942f1f04255 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:32.105207 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-12e753cb-787f-4857-8d08-5942f1f04255 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:32.111061 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-12e753cb-787f-4857-8d08-5942f1f04255 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:32.111500 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-12e753cb-787f-4857-8d08-5942f1f04255 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:32.112243 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-12e753cb-787f-4857-8d08-5942f1f04255 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:32.112675 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-12e753cb-787f-4857-8d08-5942f1f04255 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:32.172897 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-12e753cb-787f-4857-8d08-5942f1f04255 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:32.181559 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-12e753cb-787f-4857-8d08-5942f1f04255 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.080669 Aug 25 05:55:32.182211 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1151/2265] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:32 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:33.198406 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8f813e35-f21c-4159-9cbe-bc52368c9b64 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:33.199021 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8f813e35-f21c-4159-9cbe-bc52368c9b64 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:33.204873 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8f813e35-f21c-4159-9cbe-bc52368c9b64 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:33.205315 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8f813e35-f21c-4159-9cbe-bc52368c9b64 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:33.206109 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8f813e35-f21c-4159-9cbe-bc52368c9b64 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:33.206537 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8f813e35-f21c-4159-9cbe-bc52368c9b64 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:33.266770 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-8f813e35-f21c-4159-9cbe-bc52368c9b64 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:33.275383 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8f813e35-f21c-4159-9cbe-bc52368c9b64 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.080570 Aug 25 05:55:33.275947 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1115/2266] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:33 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:34.292327 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d9d872b2-b780-4936-907e-50a1e3bb6460 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:34.293005 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d9d872b2-b780-4936-907e-50a1e3bb6460 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:34.298859 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d9d872b2-b780-4936-907e-50a1e3bb6460 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:34.299299 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d9d872b2-b780-4936-907e-50a1e3bb6460 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:34.300048 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d9d872b2-b780-4936-907e-50a1e3bb6460 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:34.300491 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d9d872b2-b780-4936-907e-50a1e3bb6460 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:34.365771 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d9d872b2-b780-4936-907e-50a1e3bb6460 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:34.377111 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d9d872b2-b780-4936-907e-50a1e3bb6460 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.088390 Aug 25 05:55:34.377710 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1152/2267] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:34 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:35.394582 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a67902d0-c55c-4f31-8f3c-f2b98c53d796 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:35.395805 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a67902d0-c55c-4f31-8f3c-f2b98c53d796 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:35.402005 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a67902d0-c55c-4f31-8f3c-f2b98c53d796 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:35.402455 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a67902d0-c55c-4f31-8f3c-f2b98c53d796 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:35.403229 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a67902d0-c55c-4f31-8f3c-f2b98c53d796 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:35.403643 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a67902d0-c55c-4f31-8f3c-f2b98c53d796 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:35.462671 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-a67902d0-c55c-4f31-8f3c-f2b98c53d796 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:35.470744 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a67902d0-c55c-4f31-8f3c-f2b98c53d796 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.079754 Aug 25 05:55:35.471317 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1116/2268] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:35 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:36.488275 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-207815a8-b304-4800-bb43-41011767a013 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:36.488911 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-207815a8-b304-4800-bb43-41011767a013 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:36.495597 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-207815a8-b304-4800-bb43-41011767a013 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:36.496030 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-207815a8-b304-4800-bb43-41011767a013 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:36.496774 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-207815a8-b304-4800-bb43-41011767a013 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:36.497196 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-207815a8-b304-4800-bb43-41011767a013 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:36.560235 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-207815a8-b304-4800-bb43-41011767a013 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:36.568275 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-207815a8-b304-4800-bb43-41011767a013 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.083567 Aug 25 05:55:36.568949 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1153/2269] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:36 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:37.583795 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-aa5654c4-3344-448b-93f5-bf99987c5e36 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:37.584663 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-aa5654c4-3344-448b-93f5-bf99987c5e36 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:37.590468 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-aa5654c4-3344-448b-93f5-bf99987c5e36 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:37.590905 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-aa5654c4-3344-448b-93f5-bf99987c5e36 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:37.591653 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-aa5654c4-3344-448b-93f5-bf99987c5e36 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:37.592075 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-aa5654c4-3344-448b-93f5-bf99987c5e36 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:37.651759 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-aa5654c4-3344-448b-93f5-bf99987c5e36 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:37.659564 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-aa5654c4-3344-448b-93f5-bf99987c5e36 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.079477 Aug 25 05:55:37.660114 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1117/2270] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:37 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:38.674842 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ba43fe7f-69b6-4ea5-a491-a92614c674cb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:38.675570 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ba43fe7f-69b6-4ea5-a491-a92614c674cb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:38.682572 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ba43fe7f-69b6-4ea5-a491-a92614c674cb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:38.683092 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ba43fe7f-69b6-4ea5-a491-a92614c674cb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:38.683862 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ba43fe7f-69b6-4ea5-a491-a92614c674cb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:38.684295 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ba43fe7f-69b6-4ea5-a491-a92614c674cb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:38.746179 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ba43fe7f-69b6-4ea5-a491-a92614c674cb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:38.753887 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ba43fe7f-69b6-4ea5-a491-a92614c674cb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.082599 Aug 25 05:55:38.754440 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1154/2271] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:38 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:39.769924 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c8518e15-68a2-40f3-ae3b-b30ddfe46381 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:39.770522 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c8518e15-68a2-40f3-ae3b-b30ddfe46381 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:39.776968 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c8518e15-68a2-40f3-ae3b-b30ddfe46381 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:39.777411 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c8518e15-68a2-40f3-ae3b-b30ddfe46381 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:39.778186 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c8518e15-68a2-40f3-ae3b-b30ddfe46381 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:39.778708 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c8518e15-68a2-40f3-ae3b-b30ddfe46381 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:39.838439 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-c8518e15-68a2-40f3-ae3b-b30ddfe46381 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:39.846281 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c8518e15-68a2-40f3-ae3b-b30ddfe46381 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.079974 Aug 25 05:55:39.846871 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1118/2272] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:39 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:40.862711 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-bc28ba3b-63a6-43a3-8029-098f0127d59e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:40.863345 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-bc28ba3b-63a6-43a3-8029-098f0127d59e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:40.869660 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bc28ba3b-63a6-43a3-8029-098f0127d59e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:40.870110 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bc28ba3b-63a6-43a3-8029-098f0127d59e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:40.870865 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bc28ba3b-63a6-43a3-8029-098f0127d59e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:40.871291 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bc28ba3b-63a6-43a3-8029-098f0127d59e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:40.935066 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-bc28ba3b-63a6-43a3-8029-098f0127d59e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:40.942918 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-bc28ba3b-63a6-43a3-8029-098f0127d59e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.083893 Aug 25 05:55:40.943484 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1155/2273] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:40 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:41.959664 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8e76c2f5-77c5-4e8a-8c4c-977e65d866fa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:41.960453 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8e76c2f5-77c5-4e8a-8c4c-977e65d866fa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:41.967299 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8e76c2f5-77c5-4e8a-8c4c-977e65d866fa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:41.967744 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8e76c2f5-77c5-4e8a-8c4c-977e65d866fa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:41.968521 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8e76c2f5-77c5-4e8a-8c4c-977e65d866fa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:41.968957 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8e76c2f5-77c5-4e8a-8c4c-977e65d866fa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:42.119047 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-8e76c2f5-77c5-4e8a-8c4c-977e65d866fa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:42.127255 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8e76c2f5-77c5-4e8a-8c4c-977e65d866fa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.171543 Aug 25 05:55:42.127829 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1119/2274] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:41 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:43.148122 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-861ac0be-0777-4b6f-9455-aad5aac8e138 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:43.148687 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-861ac0be-0777-4b6f-9455-aad5aac8e138 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:43.155066 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-861ac0be-0777-4b6f-9455-aad5aac8e138 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:43.155536 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-861ac0be-0777-4b6f-9455-aad5aac8e138 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:43.156299 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-861ac0be-0777-4b6f-9455-aad5aac8e138 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:43.156730 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-861ac0be-0777-4b6f-9455-aad5aac8e138 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:43.216454 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-861ac0be-0777-4b6f-9455-aad5aac8e138 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:43.224177 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-861ac0be-0777-4b6f-9455-aad5aac8e138 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.079777 Aug 25 05:55:43.224737 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1156/2275] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:43 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:44.241390 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7babd596-15b5-4adf-ba10-6c4484242e3c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:44.241983 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7babd596-15b5-4adf-ba10-6c4484242e3c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:44.248458 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7babd596-15b5-4adf-ba10-6c4484242e3c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:44.248901 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7babd596-15b5-4adf-ba10-6c4484242e3c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:44.249679 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7babd596-15b5-4adf-ba10-6c4484242e3c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:44.250105 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7babd596-15b5-4adf-ba10-6c4484242e3c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:44.310717 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-7babd596-15b5-4adf-ba10-6c4484242e3c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:44.318406 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7babd596-15b5-4adf-ba10-6c4484242e3c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.080774 Aug 25 05:55:44.319133 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1120/2276] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:44 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:44.994811 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 05:55:44.995003 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: Wed Aug 25 05:55:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 05:55:45.336242 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6645cdea-46d8-484d-ad3e-53ba230ea3c9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:45.336848 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6645cdea-46d8-484d-ad3e-53ba230ea3c9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:45.343309 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6645cdea-46d8-484d-ad3e-53ba230ea3c9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:45.343750 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6645cdea-46d8-484d-ad3e-53ba230ea3c9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:45.344503 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6645cdea-46d8-484d-ad3e-53ba230ea3c9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:45.344928 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6645cdea-46d8-484d-ad3e-53ba230ea3c9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:45.406258 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-6645cdea-46d8-484d-ad3e-53ba230ea3c9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:45.413910 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6645cdea-46d8-484d-ad3e-53ba230ea3c9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.081321 Aug 25 05:55:45.414469 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1157/2277] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:45 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:46.430538 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1f859226-5915-4cfc-929b-e5a2ea0b7344 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:46.431183 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1f859226-5915-4cfc-929b-e5a2ea0b7344 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:46.437143 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1f859226-5915-4cfc-929b-e5a2ea0b7344 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:46.437616 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1f859226-5915-4cfc-929b-e5a2ea0b7344 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:46.438367 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1f859226-5915-4cfc-929b-e5a2ea0b7344 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:46.438835 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1f859226-5915-4cfc-929b-e5a2ea0b7344 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:46.500079 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-1f859226-5915-4cfc-929b-e5a2ea0b7344 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:46.507913 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1f859226-5915-4cfc-929b-e5a2ea0b7344 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.081012 Aug 25 05:55:46.508472 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1121/2278] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:46 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:55:47.524578 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-3d2edd91-e7da-4a1e-9023-ab533147e71e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:47.525469 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-3d2edd91-e7da-4a1e-9023-ab533147e71e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:47.533282 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3d2edd91-e7da-4a1e-9023-ab533147e71e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:47.533762 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3d2edd91-e7da-4a1e-9023-ab533147e71e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:47.534526 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3d2edd91-e7da-4a1e-9023-ab533147e71e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:47.534956 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3d2edd91-e7da-4a1e-9023-ab533147e71e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:47.600202 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-3d2edd91-e7da-4a1e-9023-ab533147e71e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:47.608819 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-3d2edd91-e7da-4a1e-9023-ab533147e71e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.088045 Aug 25 05:55:47.609377 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1158/2279] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:47 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:48.624697 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ee8de0e5-535e-4119-8df1-997df75b8aaa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:48.625329 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ee8de0e5-535e-4119-8df1-997df75b8aaa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:48.631104 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ee8de0e5-535e-4119-8df1-997df75b8aaa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:48.631542 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ee8de0e5-535e-4119-8df1-997df75b8aaa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:48.632287 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ee8de0e5-535e-4119-8df1-997df75b8aaa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:48.632711 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ee8de0e5-535e-4119-8df1-997df75b8aaa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:48.693870 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ee8de0e5-535e-4119-8df1-997df75b8aaa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:48.701861 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ee8de0e5-535e-4119-8df1-997df75b8aaa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.080728 Aug 25 05:55:48.702424 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1122/2280] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:48 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:49.718339 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-84ea28d7-1fb8-463b-9441-96efd51dbfd8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:49.719009 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-84ea28d7-1fb8-463b-9441-96efd51dbfd8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:49.724768 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-84ea28d7-1fb8-463b-9441-96efd51dbfd8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:49.725208 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-84ea28d7-1fb8-463b-9441-96efd51dbfd8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:49.725986 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-84ea28d7-1fb8-463b-9441-96efd51dbfd8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:49.726417 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-84ea28d7-1fb8-463b-9441-96efd51dbfd8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:49.787039 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-84ea28d7-1fb8-463b-9441-96efd51dbfd8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:49.795584 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-84ea28d7-1fb8-463b-9441-96efd51dbfd8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.080963 Aug 25 05:55:49.796142 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1159/2281] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:49 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:50.813162 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-9b1d3cf9-7923-46b7-8cde-1f493eb71221 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:50.813769 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-9b1d3cf9-7923-46b7-8cde-1f493eb71221 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:50.819601 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9b1d3cf9-7923-46b7-8cde-1f493eb71221 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:50.820045 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9b1d3cf9-7923-46b7-8cde-1f493eb71221 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:50.820802 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9b1d3cf9-7923-46b7-8cde-1f493eb71221 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:50.821232 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9b1d3cf9-7923-46b7-8cde-1f493eb71221 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:50.881518 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-9b1d3cf9-7923-46b7-8cde-1f493eb71221 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:50.890470 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-9b1d3cf9-7923-46b7-8cde-1f493eb71221 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.081984 Aug 25 05:55:50.891069 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1123/2282] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:50 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:51.907186 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-0c930ec9-61a6-4307-a5fe-5a4d2efead94 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:51.907787 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-0c930ec9-61a6-4307-a5fe-5a4d2efead94 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:51.913558 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0c930ec9-61a6-4307-a5fe-5a4d2efead94 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:51.914018 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0c930ec9-61a6-4307-a5fe-5a4d2efead94 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:51.914748 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0c930ec9-61a6-4307-a5fe-5a4d2efead94 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:51.915170 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0c930ec9-61a6-4307-a5fe-5a4d2efead94 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:51.974716 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-0c930ec9-61a6-4307-a5fe-5a4d2efead94 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:51.983667 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-0c930ec9-61a6-4307-a5fe-5a4d2efead94 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.081035 Aug 25 05:55:51.984530 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1160/2283] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:51 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:53.000951 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b7e072cb-8e66-4721-b03d-ada98af59a4c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:53.001555 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b7e072cb-8e66-4721-b03d-ada98af59a4c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:53.007581 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b7e072cb-8e66-4721-b03d-ada98af59a4c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:53.008027 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b7e072cb-8e66-4721-b03d-ada98af59a4c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:53.008785 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b7e072cb-8e66-4721-b03d-ada98af59a4c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:53.009208 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b7e072cb-8e66-4721-b03d-ada98af59a4c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:53.068807 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-b7e072cb-8e66-4721-b03d-ada98af59a4c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:53.077256 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b7e072cb-8e66-4721-b03d-ada98af59a4c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.080531 Aug 25 05:55:53.077848 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1124/2284] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:52 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:54.093913 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-165dda80-f792-432c-9832-048ba390d9e6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:54.094448 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-165dda80-f792-432c-9832-048ba390d9e6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:54.100330 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-165dda80-f792-432c-9832-048ba390d9e6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:54.100768 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-165dda80-f792-432c-9832-048ba390d9e6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:54.101518 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-165dda80-f792-432c-9832-048ba390d9e6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:54.101970 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-165dda80-f792-432c-9832-048ba390d9e6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:54.165711 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-165dda80-f792-432c-9832-048ba390d9e6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:54.174686 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-165dda80-f792-432c-9832-048ba390d9e6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.084777 Aug 25 05:55:54.175245 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1161/2285] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:54 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:55.191830 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-48458e27-857f-4b57-8b7e-1b16f9a126b7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:55.192752 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-48458e27-857f-4b57-8b7e-1b16f9a126b7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:55.198753 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-48458e27-857f-4b57-8b7e-1b16f9a126b7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:55.199188 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-48458e27-857f-4b57-8b7e-1b16f9a126b7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:55.200000 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-48458e27-857f-4b57-8b7e-1b16f9a126b7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:55.200427 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-48458e27-857f-4b57-8b7e-1b16f9a126b7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:55.259858 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-48458e27-857f-4b57-8b7e-1b16f9a126b7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:55.268387 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-48458e27-857f-4b57-8b7e-1b16f9a126b7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.080474 Aug 25 05:55:55.268952 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1125/2286] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:55 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:56.285641 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-3fd4c33b-f5a0-4696-8ec6-9ef065393317 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:56.286291 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-3fd4c33b-f5a0-4696-8ec6-9ef065393317 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:56.292122 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3fd4c33b-f5a0-4696-8ec6-9ef065393317 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:56.292564 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3fd4c33b-f5a0-4696-8ec6-9ef065393317 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:56.293345 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3fd4c33b-f5a0-4696-8ec6-9ef065393317 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:56.293791 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3fd4c33b-f5a0-4696-8ec6-9ef065393317 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:56.353881 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-3fd4c33b-f5a0-4696-8ec6-9ef065393317 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:56.362765 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-3fd4c33b-f5a0-4696-8ec6-9ef065393317 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.080790 Aug 25 05:55:56.363322 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1162/2287] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:56 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:57.379850 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8eda512f-dc94-4c17-a23b-30fc2f69762c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:57.380447 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8eda512f-dc94-4c17-a23b-30fc2f69762c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:57.386359 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8eda512f-dc94-4c17-a23b-30fc2f69762c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:57.386802 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8eda512f-dc94-4c17-a23b-30fc2f69762c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:57.387551 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8eda512f-dc94-4c17-a23b-30fc2f69762c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:57.387981 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8eda512f-dc94-4c17-a23b-30fc2f69762c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:57.447653 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-8eda512f-dc94-4c17-a23b-30fc2f69762c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:57.456042 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8eda512f-dc94-4c17-a23b-30fc2f69762c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.079781 Aug 25 05:55:57.456619 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1126/2288] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:57 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:55:58.472170 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d470322a-095b-4a76-af75-247a157b887e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:58.472814 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d470322a-095b-4a76-af75-247a157b887e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:58.478859 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d470322a-095b-4a76-af75-247a157b887e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:58.479311 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d470322a-095b-4a76-af75-247a157b887e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:58.480051 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d470322a-095b-4a76-af75-247a157b887e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:58.480515 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d470322a-095b-4a76-af75-247a157b887e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:58.543806 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d470322a-095b-4a76-af75-247a157b887e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:58.551917 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d470322a-095b-4a76-af75-247a157b887e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.083634 Aug 25 05:55:58.552471 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1163/2289] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:58 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:55:59.569447 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b660b48c-3db8-48fd-ac79-820600e63848 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:55:59.570086 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b660b48c-3db8-48fd-ac79-820600e63848 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:55:59.575980 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b660b48c-3db8-48fd-ac79-820600e63848 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:59.576952 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b660b48c-3db8-48fd-ac79-820600e63848 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:59.578003 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b660b48c-3db8-48fd-ac79-820600e63848 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:55:59.578438 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b660b48c-3db8-48fd-ac79-820600e63848 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:55:59.637609 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-b660b48c-3db8-48fd-ac79-820600e63848 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:55:59.646116 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b660b48c-3db8-48fd-ac79-820600e63848 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.080392 Aug 25 05:55:59.646678 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1127/2290] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:55:59 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:00.663755 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1471a870-9c60-4e78-bc5f-a0a4fa8320fa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:00.664554 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1471a870-9c60-4e78-bc5f-a0a4fa8320fa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:00.670557 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1471a870-9c60-4e78-bc5f-a0a4fa8320fa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:00.671041 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1471a870-9c60-4e78-bc5f-a0a4fa8320fa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:00.671798 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1471a870-9c60-4e78-bc5f-a0a4fa8320fa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:00.672230 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1471a870-9c60-4e78-bc5f-a0a4fa8320fa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:00.735495 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-1471a870-9c60-4e78-bc5f-a0a4fa8320fa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:00.743341 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1471a870-9c60-4e78-bc5f-a0a4fa8320fa tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.083238 Aug 25 05:56:00.743905 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1164/2291] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:00 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:01.760665 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-f6681dbd-584f-4689-b76f-b77521ad4a66 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:01.761273 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-f6681dbd-584f-4689-b76f-b77521ad4a66 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:01.767767 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f6681dbd-584f-4689-b76f-b77521ad4a66 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:01.768202 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f6681dbd-584f-4689-b76f-b77521ad4a66 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:01.768958 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f6681dbd-584f-4689-b76f-b77521ad4a66 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:01.769382 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f6681dbd-584f-4689-b76f-b77521ad4a66 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:01.833349 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-f6681dbd-584f-4689-b76f-b77521ad4a66 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:01.841127 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-f6681dbd-584f-4689-b76f-b77521ad4a66 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.084142 Aug 25 05:56:01.841738 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1128/2292] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:01 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:02.858714 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-52d0710c-e138-4656-8e21-dc9eb6a9113f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:02.859433 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-52d0710c-e138-4656-8e21-dc9eb6a9113f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:02.865146 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-52d0710c-e138-4656-8e21-dc9eb6a9113f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:02.865645 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-52d0710c-e138-4656-8e21-dc9eb6a9113f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:02.866407 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-52d0710c-e138-4656-8e21-dc9eb6a9113f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:02.866836 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-52d0710c-e138-4656-8e21-dc9eb6a9113f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:02.930040 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-52d0710c-e138-4656-8e21-dc9eb6a9113f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:02.938440 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-52d0710c-e138-4656-8e21-dc9eb6a9113f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.084016 Aug 25 05:56:02.939001 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1165/2293] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:02 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:03.955444 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e9cb6a4b-342d-4e77-8bdc-a95d8f5a9425 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:03.956065 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e9cb6a4b-342d-4e77-8bdc-a95d8f5a9425 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:03.961710 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e9cb6a4b-342d-4e77-8bdc-a95d8f5a9425 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:03.962144 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e9cb6a4b-342d-4e77-8bdc-a95d8f5a9425 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:03.962923 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e9cb6a4b-342d-4e77-8bdc-a95d8f5a9425 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:03.963350 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e9cb6a4b-342d-4e77-8bdc-a95d8f5a9425 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:04.024575 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e9cb6a4b-342d-4e77-8bdc-a95d8f5a9425 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:04.033275 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e9cb6a4b-342d-4e77-8bdc-a95d8f5a9425 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.082187 Aug 25 05:56:04.033948 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1129/2294] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:03 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:05.052588 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-101adc68-eae4-4522-9068-160a779e77bc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:05.053195 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-101adc68-eae4-4522-9068-160a779e77bc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:05.059023 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-101adc68-eae4-4522-9068-160a779e77bc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:05.059462 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-101adc68-eae4-4522-9068-160a779e77bc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:05.060219 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-101adc68-eae4-4522-9068-160a779e77bc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:05.060645 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-101adc68-eae4-4522-9068-160a779e77bc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:05.119899 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-101adc68-eae4-4522-9068-160a779e77bc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:05.128046 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-101adc68-eae4-4522-9068-160a779e77bc tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.079138 Aug 25 05:56:05.128608 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1166/2295] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:05 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:06.144646 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c41c6517-540e-4782-b0e8-bf18039279b7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:06.145327 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c41c6517-540e-4782-b0e8-bf18039279b7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:06.151474 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c41c6517-540e-4782-b0e8-bf18039279b7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:06.151862 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c41c6517-540e-4782-b0e8-bf18039279b7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:06.152621 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c41c6517-540e-4782-b0e8-bf18039279b7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:06.153103 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c41c6517-540e-4782-b0e8-bf18039279b7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:06.212844 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-c41c6517-540e-4782-b0e8-bf18039279b7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:06.220919 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c41c6517-540e-4782-b0e8-bf18039279b7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.080183 Aug 25 05:56:06.221485 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1130/2296] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:06 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:07.237687 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c485ccde-a95f-4a36-8294-78655764fca9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:07.238282 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c485ccde-a95f-4a36-8294-78655764fca9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:07.244179 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c485ccde-a95f-4a36-8294-78655764fca9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:07.244626 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c485ccde-a95f-4a36-8294-78655764fca9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:07.245390 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c485ccde-a95f-4a36-8294-78655764fca9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:07.245853 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c485ccde-a95f-4a36-8294-78655764fca9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:07.310046 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-c485ccde-a95f-4a36-8294-78655764fca9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:07.319334 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c485ccde-a95f-4a36-8294-78655764fca9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.085433 Aug 25 05:56:07.319901 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1167/2297] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:07 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:08.336142 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c9150415-b022-4375-a401-11cccc4deb69 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:08.336804 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c9150415-b022-4375-a401-11cccc4deb69 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:08.342606 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c9150415-b022-4375-a401-11cccc4deb69 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:08.343050 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c9150415-b022-4375-a401-11cccc4deb69 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:08.343810 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c9150415-b022-4375-a401-11cccc4deb69 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:08.344246 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c9150415-b022-4375-a401-11cccc4deb69 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:08.404456 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-c9150415-b022-4375-a401-11cccc4deb69 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:08.413135 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c9150415-b022-4375-a401-11cccc4deb69 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.080524 Aug 25 05:56:08.413648 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1131/2298] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:08 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:09.429372 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7b3a40b8-b12f-43c8-b99c-e22e4c029947 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:09.430010 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-7b3a40b8-b12f-43c8-b99c-e22e4c029947 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:09.435776 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7b3a40b8-b12f-43c8-b99c-e22e4c029947 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:09.436219 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7b3a40b8-b12f-43c8-b99c-e22e4c029947 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:09.437015 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7b3a40b8-b12f-43c8-b99c-e22e4c029947 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:09.437397 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7b3a40b8-b12f-43c8-b99c-e22e4c029947 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:09.497273 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-7b3a40b8-b12f-43c8-b99c-e22e4c029947 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:09.506106 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-7b3a40b8-b12f-43c8-b99c-e22e4c029947 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.080393 Aug 25 05:56:09.506659 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1168/2299] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:09 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:10.522695 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-26434ca1-a3b6-4be8-aa89-0ab6ebe692f4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:10.523223 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-26434ca1-a3b6-4be8-aa89-0ab6ebe692f4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:10.529646 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-26434ca1-a3b6-4be8-aa89-0ab6ebe692f4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:10.530095 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-26434ca1-a3b6-4be8-aa89-0ab6ebe692f4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:10.530855 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-26434ca1-a3b6-4be8-aa89-0ab6ebe692f4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:10.531285 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-26434ca1-a3b6-4be8-aa89-0ab6ebe692f4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:10.591673 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-26434ca1-a3b6-4be8-aa89-0ab6ebe692f4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:10.600304 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-26434ca1-a3b6-4be8-aa89-0ab6ebe692f4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.081374 Aug 25 05:56:10.600867 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1132/2300] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:10 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:11.617179 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-814e0be3-368b-4f0a-9c51-79b82d92eb1d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:11.617749 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-814e0be3-368b-4f0a-9c51-79b82d92eb1d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:11.623416 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-814e0be3-368b-4f0a-9c51-79b82d92eb1d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:11.623848 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-814e0be3-368b-4f0a-9c51-79b82d92eb1d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:11.624599 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-814e0be3-368b-4f0a-9c51-79b82d92eb1d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:11.625022 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-814e0be3-368b-4f0a-9c51-79b82d92eb1d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:11.692094 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-814e0be3-368b-4f0a-9c51-79b82d92eb1d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:11.700253 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-814e0be3-368b-4f0a-9c51-79b82d92eb1d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.086760 Aug 25 05:56:11.700869 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1169/2301] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:11 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:12.717271 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-eb1f1e50-4a93-45fc-b477-1da2fb6cdb32 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:12.717868 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-eb1f1e50-4a93-45fc-b477-1da2fb6cdb32 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:12.724490 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-eb1f1e50-4a93-45fc-b477-1da2fb6cdb32 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:12.724927 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-eb1f1e50-4a93-45fc-b477-1da2fb6cdb32 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:12.725719 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-eb1f1e50-4a93-45fc-b477-1da2fb6cdb32 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:12.726165 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-eb1f1e50-4a93-45fc-b477-1da2fb6cdb32 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:12.790497 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-eb1f1e50-4a93-45fc-b477-1da2fb6cdb32 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:12.799330 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-eb1f1e50-4a93-45fc-b477-1da2fb6cdb32 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.085775 Aug 25 05:56:12.799886 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1133/2302] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:12 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:13.820657 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1482974a-60d1-459f-bf6d-6e277dfa2b7c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:13.821794 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1482974a-60d1-459f-bf6d-6e277dfa2b7c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:13.831252 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1482974a-60d1-459f-bf6d-6e277dfa2b7c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:13.832005 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1482974a-60d1-459f-bf6d-6e277dfa2b7c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:13.833211 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1482974a-60d1-459f-bf6d-6e277dfa2b7c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:13.833938 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1482974a-60d1-459f-bf6d-6e277dfa2b7c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:13.900636 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-1482974a-60d1-459f-bf6d-6e277dfa2b7c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:13.908914 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1482974a-60d1-459f-bf6d-6e277dfa2b7c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.094082 Aug 25 05:56:13.909509 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1170/2303] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:13 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:14.925834 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-25cb7f78-278a-4479-912b-be3ee6a32ea6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:14.926431 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-25cb7f78-278a-4479-912b-be3ee6a32ea6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:14.932212 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-25cb7f78-278a-4479-912b-be3ee6a32ea6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:14.935892 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-25cb7f78-278a-4479-912b-be3ee6a32ea6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:14.935892 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-25cb7f78-278a-4479-912b-be3ee6a32ea6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:14.935892 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-25cb7f78-278a-4479-912b-be3ee6a32ea6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:14.994129 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-25cb7f78-278a-4479-912b-be3ee6a32ea6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:15.002066 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-25cb7f78-278a-4479-912b-be3ee6a32ea6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.080300 Aug 25 05:56:15.002644 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1134/2304] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:14 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:16.018065 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-bb73db53-1128-4f55-a21a-bff5485bf202 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:16.018691 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-bb73db53-1128-4f55-a21a-bff5485bf202 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:16.024538 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bb73db53-1128-4f55-a21a-bff5485bf202 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:16.024980 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bb73db53-1128-4f55-a21a-bff5485bf202 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:16.026013 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bb73db53-1128-4f55-a21a-bff5485bf202 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:16.026441 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bb73db53-1128-4f55-a21a-bff5485bf202 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:16.086764 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-bb73db53-1128-4f55-a21a-bff5485bf202 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:16.094924 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-bb73db53-1128-4f55-a21a-bff5485bf202 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.080425 Aug 25 05:56:16.095678 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1171/2305] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:16 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:17.111815 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1dc873c6-98fd-4fe2-81ea-b11972789540 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:17.112511 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1dc873c6-98fd-4fe2-81ea-b11972789540 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:17.118663 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1dc873c6-98fd-4fe2-81ea-b11972789540 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:17.119123 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1dc873c6-98fd-4fe2-81ea-b11972789540 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:17.119890 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1dc873c6-98fd-4fe2-81ea-b11972789540 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:17.120317 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1dc873c6-98fd-4fe2-81ea-b11972789540 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:17.184586 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-1dc873c6-98fd-4fe2-81ea-b11972789540 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:17.194096 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1dc873c6-98fd-4fe2-81ea-b11972789540 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.086431 Aug 25 05:56:17.194677 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1135/2306] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:17 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:18.210970 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b314a0cf-335e-46f9-ac9e-6be9e63a975a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:18.211526 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b314a0cf-335e-46f9-ac9e-6be9e63a975a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:18.217504 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b314a0cf-335e-46f9-ac9e-6be9e63a975a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:18.217988 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b314a0cf-335e-46f9-ac9e-6be9e63a975a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:18.218745 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b314a0cf-335e-46f9-ac9e-6be9e63a975a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:18.219176 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b314a0cf-335e-46f9-ac9e-6be9e63a975a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:18.279648 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-b314a0cf-335e-46f9-ac9e-6be9e63a975a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:18.289027 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b314a0cf-335e-46f9-ac9e-6be9e63a975a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.081636 Aug 25 05:56:18.289476 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1172/2307] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:18 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:19.305579 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-12164062-da07-43ca-b976-af4979975ba4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:19.306205 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-12164062-da07-43ca-b976-af4979975ba4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:19.311985 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-12164062-da07-43ca-b976-af4979975ba4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:19.312419 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-12164062-da07-43ca-b976-af4979975ba4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:19.313221 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-12164062-da07-43ca-b976-af4979975ba4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:19.313831 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-12164062-da07-43ca-b976-af4979975ba4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:19.373062 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-12164062-da07-43ca-b976-af4979975ba4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:19.380715 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-12164062-da07-43ca-b976-af4979975ba4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.078851 Aug 25 05:56:19.381266 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1136/2308] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:19 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:20.397694 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-8af0dab8-3591-4247-a85b-31c6abf655b3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:20.398288 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-8af0dab8-3591-4247-a85b-31c6abf655b3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:20.404293 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8af0dab8-3591-4247-a85b-31c6abf655b3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:20.404730 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8af0dab8-3591-4247-a85b-31c6abf655b3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:20.405480 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8af0dab8-3591-4247-a85b-31c6abf655b3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:20.405929 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8af0dab8-3591-4247-a85b-31c6abf655b3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:20.469405 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-8af0dab8-3591-4247-a85b-31c6abf655b3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:20.477309 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-8af0dab8-3591-4247-a85b-31c6abf655b3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.083347 Aug 25 05:56:20.477905 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1173/2309] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:20 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:21.494562 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-38f80c86-ca67-4899-9518-451edd8ba2d6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:21.495102 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-38f80c86-ca67-4899-9518-451edd8ba2d6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:21.501329 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-38f80c86-ca67-4899-9518-451edd8ba2d6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:21.501955 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-38f80c86-ca67-4899-9518-451edd8ba2d6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:21.502761 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-38f80c86-ca67-4899-9518-451edd8ba2d6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:21.503196 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-38f80c86-ca67-4899-9518-451edd8ba2d6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:21.563719 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-38f80c86-ca67-4899-9518-451edd8ba2d6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:21.571545 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-38f80c86-ca67-4899-9518-451edd8ba2d6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.080721 Aug 25 05:56:21.572102 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1137/2310] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:21 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:22.587965 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-57722033-b77c-468c-a514-3693899953a9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:22.588573 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-57722033-b77c-468c-a514-3693899953a9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:22.594408 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-57722033-b77c-468c-a514-3693899953a9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:22.595202 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-57722033-b77c-468c-a514-3693899953a9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:22.595610 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-57722033-b77c-468c-a514-3693899953a9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:22.596039 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-57722033-b77c-468c-a514-3693899953a9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:22.658482 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-57722033-b77c-468c-a514-3693899953a9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:22.667281 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-57722033-b77c-468c-a514-3693899953a9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.082909 Aug 25 05:56:22.667871 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1174/2311] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:22 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:23.684079 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-77151b05-aa46-4e78-bff3-92dbd0d51d2d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:23.684668 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-77151b05-aa46-4e78-bff3-92dbd0d51d2d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:23.691581 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-77151b05-aa46-4e78-bff3-92dbd0d51d2d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:23.692028 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-77151b05-aa46-4e78-bff3-92dbd0d51d2d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:23.692812 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-77151b05-aa46-4e78-bff3-92dbd0d51d2d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:23.693235 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-77151b05-aa46-4e78-bff3-92dbd0d51d2d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:23.753877 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-77151b05-aa46-4e78-bff3-92dbd0d51d2d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:23.761470 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-77151b05-aa46-4e78-bff3-92dbd0d51d2d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.081045 Aug 25 05:56:23.762294 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1138/2312] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:23 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:24.778916 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9b577d91-1bc9-4c40-9567-4e10802acf57 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:24.779483 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9b577d91-1bc9-4c40-9567-4e10802acf57 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:24.785270 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9b577d91-1bc9-4c40-9567-4e10802acf57 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:24.785738 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9b577d91-1bc9-4c40-9567-4e10802acf57 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:24.786486 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9b577d91-1bc9-4c40-9567-4e10802acf57 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:24.786909 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9b577d91-1bc9-4c40-9567-4e10802acf57 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:24.845318 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-9b577d91-1bc9-4c40-9567-4e10802acf57 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:24.852947 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9b577d91-1bc9-4c40-9567-4e10802acf57 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.078065 Aug 25 05:56:24.853502 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1175/2313] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:24 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:25.870412 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-989a9b8f-2f56-4828-af8e-bc0de10b2d5b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:25.871023 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-989a9b8f-2f56-4828-af8e-bc0de10b2d5b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:25.877424 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-989a9b8f-2f56-4828-af8e-bc0de10b2d5b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:25.877896 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-989a9b8f-2f56-4828-af8e-bc0de10b2d5b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:25.878662 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-989a9b8f-2f56-4828-af8e-bc0de10b2d5b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:25.879095 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-989a9b8f-2f56-4828-af8e-bc0de10b2d5b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:25.940980 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-989a9b8f-2f56-4828-af8e-bc0de10b2d5b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:25.948770 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-989a9b8f-2f56-4828-af8e-bc0de10b2d5b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.082080 Aug 25 05:56:25.949337 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1139/2314] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:25 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:56:26.966402 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-53dbfc93-04a1-4b65-8d06-bd32298641a3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:26.967006 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-53dbfc93-04a1-4b65-8d06-bd32298641a3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:26.972860 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-53dbfc93-04a1-4b65-8d06-bd32298641a3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:26.973307 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-53dbfc93-04a1-4b65-8d06-bd32298641a3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:26.974166 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-53dbfc93-04a1-4b65-8d06-bd32298641a3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:26.974596 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-53dbfc93-04a1-4b65-8d06-bd32298641a3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:27.036817 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-53dbfc93-04a1-4b65-8d06-bd32298641a3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:27.044500 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-53dbfc93-04a1-4b65-8d06-bd32298641a3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.081940 Aug 25 05:56:27.045058 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1176/2315] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:26 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:28.061368 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-315768af-72d1-435d-84dd-5b1386c7e83c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:28.062002 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-315768af-72d1-435d-84dd-5b1386c7e83c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:28.068623 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-315768af-72d1-435d-84dd-5b1386c7e83c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:28.068908 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-315768af-72d1-435d-84dd-5b1386c7e83c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:28.069768 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-315768af-72d1-435d-84dd-5b1386c7e83c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:28.070198 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-315768af-72d1-435d-84dd-5b1386c7e83c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:28.131122 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-315768af-72d1-435d-84dd-5b1386c7e83c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:28.138963 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-315768af-72d1-435d-84dd-5b1386c7e83c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.081256 Aug 25 05:56:28.139529 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1140/2316] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:28 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:29.156899 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5adc35a1-c1b7-43fe-91ba-8a9536085b33 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:29.157993 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5adc35a1-c1b7-43fe-91ba-8a9536085b33 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:29.163852 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5adc35a1-c1b7-43fe-91ba-8a9536085b33 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:29.164286 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5adc35a1-c1b7-43fe-91ba-8a9536085b33 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:29.165236 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5adc35a1-c1b7-43fe-91ba-8a9536085b33 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:29.165703 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5adc35a1-c1b7-43fe-91ba-8a9536085b33 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:29.227350 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-5adc35a1-c1b7-43fe-91ba-8a9536085b33 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:29.235673 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5adc35a1-c1b7-43fe-91ba-8a9536085b33 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.082731 Aug 25 05:56:29.236748 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1177/2317] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:29 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:30.253539 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-9a1b3b97-a035-43b8-803b-b7caacdedb01 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:30.254158 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-9a1b3b97-a035-43b8-803b-b7caacdedb01 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:30.259889 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9a1b3b97-a035-43b8-803b-b7caacdedb01 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:30.260334 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9a1b3b97-a035-43b8-803b-b7caacdedb01 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:30.261091 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9a1b3b97-a035-43b8-803b-b7caacdedb01 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:30.261518 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9a1b3b97-a035-43b8-803b-b7caacdedb01 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:30.327173 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-9a1b3b97-a035-43b8-803b-b7caacdedb01 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:30.335328 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-9a1b3b97-a035-43b8-803b-b7caacdedb01 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.086679 Aug 25 05:56:30.335888 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1141/2318] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:30 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:31.351809 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-fe98f724-8845-4552-92a0-26aa9e1125de tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:31.352422 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-fe98f724-8845-4552-92a0-26aa9e1125de tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:31.358351 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fe98f724-8845-4552-92a0-26aa9e1125de tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:31.358801 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fe98f724-8845-4552-92a0-26aa9e1125de tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:31.359557 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fe98f724-8845-4552-92a0-26aa9e1125de tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:31.359991 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fe98f724-8845-4552-92a0-26aa9e1125de tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:31.419813 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-fe98f724-8845-4552-92a0-26aa9e1125de tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:31.428191 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-fe98f724-8845-4552-92a0-26aa9e1125de tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.079964 Aug 25 05:56:31.428787 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1178/2319] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:31 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:32.445670 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1b275df6-e6e8-48f9-bc9a-5755940e6fee tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:32.446284 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1b275df6-e6e8-48f9-bc9a-5755940e6fee tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:32.452307 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1b275df6-e6e8-48f9-bc9a-5755940e6fee tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:32.452756 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1b275df6-e6e8-48f9-bc9a-5755940e6fee tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:32.453516 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1b275df6-e6e8-48f9-bc9a-5755940e6fee tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:32.453978 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1b275df6-e6e8-48f9-bc9a-5755940e6fee tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:32.512224 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-1b275df6-e6e8-48f9-bc9a-5755940e6fee tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:32.520949 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1b275df6-e6e8-48f9-bc9a-5755940e6fee tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.078952 Aug 25 05:56:32.521549 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1142/2320] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:32 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:33.539273 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-76852732-f817-4178-b798-f3468f757d16 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:33.539931 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-76852732-f817-4178-b798-f3468f757d16 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:33.546338 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-76852732-f817-4178-b798-f3468f757d16 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:33.546868 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-76852732-f817-4178-b798-f3468f757d16 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:33.547716 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-76852732-f817-4178-b798-f3468f757d16 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:33.548159 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-76852732-f817-4178-b798-f3468f757d16 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:33.610898 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-76852732-f817-4178-b798-f3468f757d16 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:33.619413 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-76852732-f817-4178-b798-f3468f757d16 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.084783 Aug 25 05:56:33.619969 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1179/2321] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:33 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:56:34.635806 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e515a928-da1e-4419-adab-73609efdb543 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:34.636440 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e515a928-da1e-4419-adab-73609efdb543 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:34.642298 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e515a928-da1e-4419-adab-73609efdb543 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:34.643239 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e515a928-da1e-4419-adab-73609efdb543 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:34.644100 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e515a928-da1e-4419-adab-73609efdb543 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:34.644520 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e515a928-da1e-4419-adab-73609efdb543 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:34.704123 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e515a928-da1e-4419-adab-73609efdb543 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:34.712288 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e515a928-da1e-4419-adab-73609efdb543 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.080136 Aug 25 05:56:34.712847 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1143/2322] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:34 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:35.730601 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5a852527-fcb6-48b5-8c0f-a4eabe60826d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:35.731271 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5a852527-fcb6-48b5-8c0f-a4eabe60826d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:35.738014 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5a852527-fcb6-48b5-8c0f-a4eabe60826d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:35.738529 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5a852527-fcb6-48b5-8c0f-a4eabe60826d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:35.739395 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5a852527-fcb6-48b5-8c0f-a4eabe60826d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:35.739893 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5a852527-fcb6-48b5-8c0f-a4eabe60826d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:35.803200 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-5a852527-fcb6-48b5-8c0f-a4eabe60826d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:35.810898 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5a852527-fcb6-48b5-8c0f-a4eabe60826d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.085072 Aug 25 05:56:35.811457 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1180/2323] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:35 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:36.829023 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7d5ff045-4e42-4e29-a3ad-5c294684fbbd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:36.829590 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7d5ff045-4e42-4e29-a3ad-5c294684fbbd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:36.835467 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7d5ff045-4e42-4e29-a3ad-5c294684fbbd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:36.835906 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7d5ff045-4e42-4e29-a3ad-5c294684fbbd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:36.836650 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7d5ff045-4e42-4e29-a3ad-5c294684fbbd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:36.837074 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7d5ff045-4e42-4e29-a3ad-5c294684fbbd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:36.896207 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-7d5ff045-4e42-4e29-a3ad-5c294684fbbd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:36.904235 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7d5ff045-4e42-4e29-a3ad-5c294684fbbd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.078880 Aug 25 05:56:36.904785 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1144/2324] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:36 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:38.018510 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1ebe64f2-235b-4b68-ab77-8128b88c1cf0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:38.019556 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1ebe64f2-235b-4b68-ab77-8128b88c1cf0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:38.025034 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1ebe64f2-235b-4b68-ab77-8128b88c1cf0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:38.025767 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1ebe64f2-235b-4b68-ab77-8128b88c1cf0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:38.026893 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1ebe64f2-235b-4b68-ab77-8128b88c1cf0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:38.027313 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1ebe64f2-235b-4b68-ab77-8128b88c1cf0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:38.087022 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-1ebe64f2-235b-4b68-ab77-8128b88c1cf0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:38.094788 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1ebe64f2-235b-4b68-ab77-8128b88c1cf0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.177633 Aug 25 05:56:38.095342 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1181/2325] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:37 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:39.112552 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-46b7da80-869c-4918-b17a-f16dd439bf31 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:39.113112 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-46b7da80-869c-4918-b17a-f16dd439bf31 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:39.118897 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-46b7da80-869c-4918-b17a-f16dd439bf31 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:39.119370 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-46b7da80-869c-4918-b17a-f16dd439bf31 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:39.120138 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-46b7da80-869c-4918-b17a-f16dd439bf31 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:39.120551 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-46b7da80-869c-4918-b17a-f16dd439bf31 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:39.179201 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-46b7da80-869c-4918-b17a-f16dd439bf31 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:39.186723 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-46b7da80-869c-4918-b17a-f16dd439bf31 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.078658 Aug 25 05:56:39.187286 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1145/2326] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:39 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:40.203143 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-070a41ed-d7a3-4c4a-a5aa-eb1412b02c3e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:40.203696 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-070a41ed-d7a3-4c4a-a5aa-eb1412b02c3e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:40.210242 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-070a41ed-d7a3-4c4a-a5aa-eb1412b02c3e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:40.210686 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-070a41ed-d7a3-4c4a-a5aa-eb1412b02c3e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:40.211584 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-070a41ed-d7a3-4c4a-a5aa-eb1412b02c3e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:40.212020 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-070a41ed-d7a3-4c4a-a5aa-eb1412b02c3e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:40.275180 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-070a41ed-d7a3-4c4a-a5aa-eb1412b02c3e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:40.283145 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-070a41ed-d7a3-4c4a-a5aa-eb1412b02c3e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.083755 Aug 25 05:56:40.283759 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1182/2327] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:40 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:41.300731 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5237fcf9-200c-45ab-9801-34ef8cb591c9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:41.301335 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5237fcf9-200c-45ab-9801-34ef8cb591c9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:41.307312 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5237fcf9-200c-45ab-9801-34ef8cb591c9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:41.307779 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5237fcf9-200c-45ab-9801-34ef8cb591c9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:41.308530 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5237fcf9-200c-45ab-9801-34ef8cb591c9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:41.308966 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5237fcf9-200c-45ab-9801-34ef8cb591c9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:41.375602 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-5237fcf9-200c-45ab-9801-34ef8cb591c9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:41.385226 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5237fcf9-200c-45ab-9801-34ef8cb591c9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 200 len: 1368 microversion: 2.1 time: 0.089191 Aug 25 05:56:41.385853 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1146/2328] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:41 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:42.403441 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2441c03b-114b-4c4b-9b6d-b6163b358c1b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:42.404080 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2441c03b-114b-4c4b-9b6d-b6163b358c1b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:42.410960 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2441c03b-114b-4c4b-9b6d-b6163b358c1b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:42.411404 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2441c03b-114b-4c4b-9b6d-b6163b358c1b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:42.412178 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2441c03b-114b-4c4b-9b6d-b6163b358c1b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:42.412607 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2441c03b-114b-4c4b-9b6d-b6163b358c1b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:42.428439 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.wsgi [None req-2441c03b-114b-4c4b-9b6d-b6163b358c1b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] HTTP exception thrown: Instance 4c438716-186a-4b29-b29e-e9c6a71a5a27 could not be found. Aug 25 05:56:42.429029 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2441c03b-114b-4c4b-9b6d-b6163b358c1b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Returning 404 to user: Instance 4c438716-186a-4b29-b29e-e9c6a71a5a27 could not be found. {{(pid=108885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 05:56:42.429899 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2441c03b-114b-4c4b-9b6d-b6163b358c1b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 404 len: 111 microversion: 2.1 time: 0.030776 Aug 25 05:56:42.430489 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1183/2329] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:42 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:56:42.438547 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-72b3b565-23b3-4a20-8ca0-6b5ddd7795cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '.version_select at 0x7f9106d7e940>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:42.503057 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-72b3b565-23b3-4a20-8ca0-6b5ddd7795cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1771237692" status: 202 len: 0 microversion: 2.1 time: 0.067693 Aug 25 05:56:42.503591 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1147/2330] 10.222.0.42 () {58 vars in 1221 bytes} [Wed Aug 25 05:56:42 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1771237692 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:56:43.573599 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9ace13c8-6830-4510-8b5e-507f1178d999 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'create', calling method: .version_select at 0x7f91064b6a60>, body: {"keypair": {"name": "tempest-keypair-2029268771"}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:56:43.590762 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.quota [None req-9ace13c8-6830-4510-8b5e-507f1178d999 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Getting quotas for project 5e7fcf565ddf46ac965eb3c7e878d4e5. Resources: {'key_pairs'} {{(pid=108885) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 05:56:43.594554 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.quota [None req-9ace13c8-6830-4510-8b5e-507f1178d999 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Getting quotas for user 0ef41c62efed49cf9dc642b659107e84 and project 5e7fcf565ddf46ac965eb3c7e878d4e5. Resources: {'key_pairs'} {{(pid=108885) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 05:56:44.058667 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.quota [None req-9ace13c8-6830-4510-8b5e-507f1178d999 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Getting quotas for project 5e7fcf565ddf46ac965eb3c7e878d4e5. Resources: {'key_pairs'} {{(pid=108885) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 05:56:44.063203 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.quota [None req-9ace13c8-6830-4510-8b5e-507f1178d999 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Getting quotas for user 0ef41c62efed49cf9dc642b659107e84 and project 5e7fcf565ddf46ac965eb3c7e878d4e5. Resources: {'key_pairs'} {{(pid=108885) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 05:56:44.076976 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9ace13c8-6830-4510-8b5e-507f1178d999 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.507051 Aug 25 05:56:44.077593 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1184/2331] 10.222.0.42 () {60 vars in 1158 bytes} [Wed Aug 25 05:56:43 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:46.480841 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5894496b-a7ca-4cac-92cc-36fdf983ed68 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-208373547", "imageRef": "05da2439-78f2-405c-b60a-89671b21a373", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b5e51dad-4162-4f64-b535-7085041e4335"}], "security_groups": [{"name": "tempest-securitygroup--477197871"}], "key_name": "tempest-keypair-2029268771", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:56:46.575513 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.network.neutron [None req-5894496b-a7ca-4cac-92cc-36fdf983ed68 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] validate_networks() for [('b5e51dad-4162-4f64-b535-7085041e4335', None, None, None, None, None)] {{(pid=108884) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 25 05:56:47.009812 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-5894496b-a7ca-4cac-92cc-36fdf983ed68 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Flavor limits 0:0:0 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 05:56:47.010236 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-5894496b-a7ca-4cac-92cc-36fdf983ed68 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Image limits 0:0:0 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 05:56:47.010709 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-5894496b-a7ca-4cac-92cc-36fdf983ed68 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Flavor pref 0:0:0 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 05:56:47.011114 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-5894496b-a7ca-4cac-92cc-36fdf983ed68 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Image pref 0:0:0 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 05:56:47.011527 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-5894496b-a7ca-4cac-92cc-36fdf983ed68 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 05:56:47.021173 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5894496b-a7ca-4cac-92cc-36fdf983ed68 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:47.022089 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5894496b-a7ca-4cac-92cc-36fdf983ed68 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:47.022431 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5894496b-a7ca-4cac-92cc-36fdf983ed68 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:47.022860 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5894496b-a7ca-4cac-92cc-36fdf983ed68 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:47.039683 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.quota [None req-5894496b-a7ca-4cac-92cc-36fdf983ed68 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Getting quotas for project 5e7fcf565ddf46ac965eb3c7e878d4e5. Resources: {'ram', 'cores', 'instances'} {{(pid=108884) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 05:56:47.043883 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.quota [None req-5894496b-a7ca-4cac-92cc-36fdf983ed68 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Getting quotas for user 0ef41c62efed49cf9dc642b659107e84 and project 5e7fcf565ddf46ac965eb3c7e878d4e5. Resources: {'ram', 'cores', 'instances'} {{(pid=108884) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 05:56:47.054844 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5894496b-a7ca-4cac-92cc-36fdf983ed68 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Going to run 1 instances... {{(pid=108884) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 25 05:56:47.057150 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5894496b-a7ca-4cac-92cc-36fdf983ed68 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05da2439-78f2-405c-b60a-89671b21a373',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 25 05:56:47.203197 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5894496b-a7ca-4cac-92cc-36fdf983ed68 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.726411 Aug 25 05:56:47.204058 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1148/2332] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 25 05:56:46 2021] POST /compute/v2.1/servers => generated 401 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 05:56:47.214291 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b99db78e-1109-495f-befd-66c6cb95ea7b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:47.214941 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b99db78e-1109-495f-befd-66c6cb95ea7b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:47.267332 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-b99db78e-1109-495f-befd-66c6cb95ea7b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:47.274655 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b99db78e-1109-495f-befd-66c6cb95ea7b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a" status: 200 len: 1237 microversion: 2.1 time: 0.064131 Aug 25 05:56:47.275575 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1185/2333] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:47 2021] GET /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a => generated 1237 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:48.291314 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c4e2eb42-a416-47ec-a254-b4bc5efe7c55 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:48.291909 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c4e2eb42-a416-47ec-a254-b4bc5efe7c55 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:48.298412 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c4e2eb42-a416-47ec-a254-b4bc5efe7c55 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:48.298866 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c4e2eb42-a416-47ec-a254-b4bc5efe7c55 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:48.299717 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c4e2eb42-a416-47ec-a254-b4bc5efe7c55 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:48.300074 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c4e2eb42-a416-47ec-a254-b4bc5efe7c55 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:48.362361 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-c4e2eb42-a416-47ec-a254-b4bc5efe7c55 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:48.370784 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c4e2eb42-a416-47ec-a254-b4bc5efe7c55 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a" status: 200 len: 1233 microversion: 2.1 time: 0.083083 Aug 25 05:56:48.371344 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1149/2334] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:48 2021] GET /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a => generated 1233 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:49.389353 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f2f7f56b-9bc9-4a9b-be3d-9190156fcba1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:49.389938 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f2f7f56b-9bc9-4a9b-be3d-9190156fcba1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:49.396160 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f2f7f56b-9bc9-4a9b-be3d-9190156fcba1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:49.396597 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f2f7f56b-9bc9-4a9b-be3d-9190156fcba1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:49.397360 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f2f7f56b-9bc9-4a9b-be3d-9190156fcba1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:49.397814 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f2f7f56b-9bc9-4a9b-be3d-9190156fcba1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:49.468642 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-f2f7f56b-9bc9-4a9b-be3d-9190156fcba1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:49.477627 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f2f7f56b-9bc9-4a9b-be3d-9190156fcba1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a" status: 200 len: 1295 microversion: 2.1 time: 0.092016 Aug 25 05:56:49.478205 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1186/2335] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:49 2021] GET /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a => generated 1295 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:50.498200 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a20a28f8-4aff-4d02-9ad4-ed323822ed19 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:50.499632 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a20a28f8-4aff-4d02-9ad4-ed323822ed19 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:50.506546 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a20a28f8-4aff-4d02-9ad4-ed323822ed19 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:50.507251 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a20a28f8-4aff-4d02-9ad4-ed323822ed19 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:50.508106 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a20a28f8-4aff-4d02-9ad4-ed323822ed19 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:50.508611 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a20a28f8-4aff-4d02-9ad4-ed323822ed19 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:50.647634 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-a20a28f8-4aff-4d02-9ad4-ed323822ed19 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:50.655278 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a20a28f8-4aff-4d02-9ad4-ed323822ed19 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a" status: 200 len: 1362 microversion: 2.1 time: 0.160738 Aug 25 05:56:50.655903 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1150/2336] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:50 2021] GET /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:50.803429 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [req-1211044a-0aa5-44dd-95e4-6e69434b48e5 req-956c07ce-0a3e-4fbb-aa44-3a0457df6335 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af3477ab-3996-4299-9889-f42b71879b8a", "tag": "e282640b-6cde-4c16-a0c5-bd69056f7593"}]} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:56:50.805122 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:56:50.805122 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: warnings.warn(msg) Aug 25 05:56:50.812534 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-1211044a-0aa5-44dd-95e4-6e69434b48e5 req-956c07ce-0a3e-4fbb-aa44-3a0457df6335 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:50.813063 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-1211044a-0aa5-44dd-95e4-6e69434b48e5 req-956c07ce-0a3e-4fbb-aa44-3a0457df6335 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:50.838982 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.compute.server_external_events [req-1211044a-0aa5-44dd-95e4-6e69434b48e5 req-956c07ce-0a3e-4fbb-aa44-3a0457df6335 service nova] Creating event network-changed:e282640b-6cde-4c16-a0c5-bd69056f7593 for instance af3477ab-3996-4299-9889-f42b71879b8a on hv-cinder-78662 Aug 25 05:56:50.845496 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [req-1211044a-0aa5-44dd-95e4-6e69434b48e5 req-956c07ce-0a3e-4fbb-aa44-3a0457df6335 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104482 Aug 25 05:56:50.847452 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1187/2337] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:56:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:56:51.671902 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-abc5bbf3-fb98-4d0b-a707-1bb651eb78b1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:51.672528 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-abc5bbf3-fb98-4d0b-a707-1bb651eb78b1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:51.678601 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-abc5bbf3-fb98-4d0b-a707-1bb651eb78b1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:51.679045 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-abc5bbf3-fb98-4d0b-a707-1bb651eb78b1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:51.679822 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-abc5bbf3-fb98-4d0b-a707-1bb651eb78b1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:51.680260 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-abc5bbf3-fb98-4d0b-a707-1bb651eb78b1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:51.799634 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-abc5bbf3-fb98-4d0b-a707-1bb651eb78b1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:51.807584 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-abc5bbf3-fb98-4d0b-a707-1bb651eb78b1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a" status: 200 len: 1362 microversion: 2.1 time: 0.139330 Aug 25 05:56:51.808149 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1151/2338] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:51 2021] GET /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a => generated 1362 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:52.825084 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e999ae08-ece2-408d-aff6-20d26f97e4fb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:52.825730 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e999ae08-ece2-408d-aff6-20d26f97e4fb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:52.831686 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e999ae08-ece2-408d-aff6-20d26f97e4fb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:52.832123 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e999ae08-ece2-408d-aff6-20d26f97e4fb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:52.832866 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e999ae08-ece2-408d-aff6-20d26f97e4fb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:52.833297 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e999ae08-ece2-408d-aff6-20d26f97e4fb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:52.953443 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-e999ae08-ece2-408d-aff6-20d26f97e4fb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:52.960842 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e999ae08-ece2-408d-aff6-20d26f97e4fb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a" status: 200 len: 1362 microversion: 2.1 time: 0.139853 Aug 25 05:56:52.961391 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1188/2339] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:52 2021] GET /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a => generated 1362 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:53.978023 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ea7ea5c9-1f29-498e-abbc-3ec98c71bb18 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:53.978574 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ea7ea5c9-1f29-498e-abbc-3ec98c71bb18 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:53.984445 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ea7ea5c9-1f29-498e-abbc-3ec98c71bb18 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:53.984893 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ea7ea5c9-1f29-498e-abbc-3ec98c71bb18 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:53.985707 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ea7ea5c9-1f29-498e-abbc-3ec98c71bb18 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:53.986161 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ea7ea5c9-1f29-498e-abbc-3ec98c71bb18 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:54.111111 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ea7ea5c9-1f29-498e-abbc-3ec98c71bb18 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:54.118250 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ea7ea5c9-1f29-498e-abbc-3ec98c71bb18 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a" status: 200 len: 1362 microversion: 2.1 time: 0.144578 Aug 25 05:56:54.118812 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1152/2340] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:53 2021] GET /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:55.134559 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-067aeac5-c7dd-4cd2-aaee-73710599152e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:55.135153 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-067aeac5-c7dd-4cd2-aaee-73710599152e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:55.141596 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-067aeac5-c7dd-4cd2-aaee-73710599152e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:55.142035 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-067aeac5-c7dd-4cd2-aaee-73710599152e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:55.142805 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-067aeac5-c7dd-4cd2-aaee-73710599152e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:55.143226 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-067aeac5-c7dd-4cd2-aaee-73710599152e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:55.267024 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-067aeac5-c7dd-4cd2-aaee-73710599152e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:55.274271 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-067aeac5-c7dd-4cd2-aaee-73710599152e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a" status: 200 len: 1362 microversion: 2.1 time: 0.143449 Aug 25 05:56:55.274833 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1189/2341] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:55 2021] GET /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a => generated 1362 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:55.924585 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [req-28a0cc0c-7b3c-4571-a747-bec94c628e02 req-bc3e374d-d683-447e-90a6-361c83c3bf4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af3477ab-3996-4299-9889-f42b71879b8a", "name": "network-vif-plugged", "status": "completed", "tag": "e282640b-6cde-4c16-a0c5-bd69056f7593"}]} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:56:55.926319 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:56:55.926319 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: warnings.warn(msg) Aug 25 05:56:55.933960 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-28a0cc0c-7b3c-4571-a747-bec94c628e02 req-bc3e374d-d683-447e-90a6-361c83c3bf4a service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:55.934403 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-28a0cc0c-7b3c-4571-a747-bec94c628e02 req-bc3e374d-d683-447e-90a6-361c83c3bf4a service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:55.946866 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.compute.server_external_events [req-28a0cc0c-7b3c-4571-a747-bec94c628e02 req-bc3e374d-d683-447e-90a6-361c83c3bf4a service nova] Creating event network-vif-plugged:e282640b-6cde-4c16-a0c5-bd69056f7593 for instance af3477ab-3996-4299-9889-f42b71879b8a on hv-cinder-78662 Aug 25 05:56:55.952082 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [req-28a0cc0c-7b3c-4571-a747-bec94c628e02 req-bc3e374d-d683-447e-90a6-361c83c3bf4a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080483 Aug 25 05:56:55.952860 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1153/2342] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:56:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:56:56.292169 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-00cd57b1-2c5f-4ec4-a84c-a7874a4bd9c3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:56.292778 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-00cd57b1-2c5f-4ec4-a84c-a7874a4bd9c3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:56.298528 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-00cd57b1-2c5f-4ec4-a84c-a7874a4bd9c3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:56.298967 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-00cd57b1-2c5f-4ec4-a84c-a7874a4bd9c3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:56.299728 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-00cd57b1-2c5f-4ec4-a84c-a7874a4bd9c3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:56.300148 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-00cd57b1-2c5f-4ec4-a84c-a7874a4bd9c3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:56.420037 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-00cd57b1-2c5f-4ec4-a84c-a7874a4bd9c3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:56.427532 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-00cd57b1-2c5f-4ec4-a84c-a7874a4bd9c3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a" status: 200 len: 1362 microversion: 2.1 time: 0.138581 Aug 25 05:56:56.428100 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1190/2343] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:56 2021] GET /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a => generated 1362 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:57.444742 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e0736cc1-fa42-404c-8acb-b4b3619b2270 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:57.445474 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e0736cc1-fa42-404c-8acb-b4b3619b2270 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:57.451979 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e0736cc1-fa42-404c-8acb-b4b3619b2270 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:57.452419 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e0736cc1-fa42-404c-8acb-b4b3619b2270 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:57.453190 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e0736cc1-fa42-404c-8acb-b4b3619b2270 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:57.453649 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e0736cc1-fa42-404c-8acb-b4b3619b2270 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:57.584261 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e0736cc1-fa42-404c-8acb-b4b3619b2270 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:57.594965 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e0736cc1-fa42-404c-8acb-b4b3619b2270 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a" status: 200 len: 1362 microversion: 2.1 time: 0.151506 Aug 25 05:56:57.594965 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1154/2344] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:57 2021] GET /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:58.609167 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-119b147f-1ee1-44b0-971b-af1ce0dcced0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:58.609803 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-119b147f-1ee1-44b0-971b-af1ce0dcced0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:58.612259 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: ERROR oslo.messaging._drivers.impl_rabbit [-] [024c7946-b47b-4a06-aa5e-7d5b6a13301d] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 25 05:56:58.617395 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-119b147f-1ee1-44b0-971b-af1ce0dcced0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:58.617912 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-119b147f-1ee1-44b0-971b-af1ce0dcced0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:58.618641 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-119b147f-1ee1-44b0-971b-af1ce0dcced0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:58.619181 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-119b147f-1ee1-44b0-971b-af1ce0dcced0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:58.757685 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-119b147f-1ee1-44b0-971b-af1ce0dcced0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:56:58.764818 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-119b147f-1ee1-44b0-971b-af1ce0dcced0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a" status: 200 len: 1548 microversion: 2.1 time: 0.159378 Aug 25 05:56:58.765372 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1191/2345] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 05:56:58 2021] GET /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:56:58.780932 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-24432294-ece2-4907-8807-2d0d84ddcc15 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:56:58.781453 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-24432294-ece2-4907-8807-2d0d84ddcc15 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:56:58.787492 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-24432294-ece2-4907-8807-2d0d84ddcc15 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:58.787870 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-24432294-ece2-4907-8807-2d0d84ddcc15 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:58.788662 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-24432294-ece2-4907-8807-2d0d84ddcc15 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:56:58.789092 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-24432294-ece2-4907-8807-2d0d84ddcc15 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:56:58.868157 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-24432294-ece2-4907-8807-2d0d84ddcc15 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090799 Aug 25 05:56:58.868746 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1155/2346] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Aug 25 05:56:58 2021] GET /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:57:00.120559 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [req-797d61e8-795e-44b3-90fb-098e3da1cd08 req-c127e54c-c0da-4b2a-b7f7-aab69db18264 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af3477ab-3996-4299-9889-f42b71879b8a", "tag": "e282640b-6cde-4c16-a0c5-bd69056f7593"}]} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:00.124123 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c3f730a0-b8e3-466c-9339-862d938e3aff tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:00.125024 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c3f730a0-b8e3-466c-9339-862d938e3aff tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:00.127749 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:57:00.127749 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: warnings.warn(msg) Aug 25 05:57:00.135979 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-797d61e8-795e-44b3-90fb-098e3da1cd08 req-c127e54c-c0da-4b2a-b7f7-aab69db18264 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:00.136516 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-797d61e8-795e-44b3-90fb-098e3da1cd08 req-c127e54c-c0da-4b2a-b7f7-aab69db18264 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:00.145768 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c3f730a0-b8e3-466c-9339-862d938e3aff tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:00.146249 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c3f730a0-b8e3-466c-9339-862d938e3aff tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:00.147317 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c3f730a0-b8e3-466c-9339-862d938e3aff tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:00.147750 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c3f730a0-b8e3-466c-9339-862d938e3aff tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:00.152434 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.compute.server_external_events [req-797d61e8-795e-44b3-90fb-098e3da1cd08 req-c127e54c-c0da-4b2a-b7f7-aab69db18264 service nova] Creating event network-changed:e282640b-6cde-4c16-a0c5-bd69056f7593 for instance af3477ab-3996-4299-9889-f42b71879b8a on hv-cinder-78662 Aug 25 05:57:00.153821 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO oslo.messaging._drivers.impl_rabbit [-] [024c7946-b47b-4a06-aa5e-7d5b6a13301d] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 41732. Aug 25 05:57:00.158283 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [req-797d61e8-795e-44b3-90fb-098e3da1cd08 req-c127e54c-c0da-4b2a-b7f7-aab69db18264 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041210 Aug 25 05:57:00.159153 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1156/2347] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:57:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:57:00.213160 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c3f730a0-b8e3-466c-9339-862d938e3aff tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 14 microversion: 2.1 time: 0.099019 Aug 25 05:57:00.214296 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1192/2348] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:00 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 05:57:01.225544 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-72e8838e-4a23-43ac-bb66-64acb0b2d9f6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:01.226614 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-72e8838e-4a23-43ac-bb66-64acb0b2d9f6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:01.233003 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-72e8838e-4a23-43ac-bb66-64acb0b2d9f6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:01.233453 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-72e8838e-4a23-43ac-bb66-64acb0b2d9f6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:01.234260 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-72e8838e-4a23-43ac-bb66-64acb0b2d9f6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:01.234699 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-72e8838e-4a23-43ac-bb66-64acb0b2d9f6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:01.299344 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-72e8838e-4a23-43ac-bb66-64acb0b2d9f6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 14 microversion: 2.1 time: 0.078118 Aug 25 05:57:01.300069 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1157/2349] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:01 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 05:57:02.310827 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e7dbc527-143f-4f95-90fa-0688553b3cd3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:02.311767 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e7dbc527-143f-4f95-90fa-0688553b3cd3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:02.319366 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e7dbc527-143f-4f95-90fa-0688553b3cd3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:02.319831 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e7dbc527-143f-4f95-90fa-0688553b3cd3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:02.320596 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e7dbc527-143f-4f95-90fa-0688553b3cd3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:02.321029 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e7dbc527-143f-4f95-90fa-0688553b3cd3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:02.376942 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e7dbc527-143f-4f95-90fa-0688553b3cd3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 14 microversion: 2.1 time: 0.070071 Aug 25 05:57:02.377728 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1193/2350] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:02 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 05:57:03.389130 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-143c7603-a3e6-4814-82f5-89c5f76c8abe tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:03.390165 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-143c7603-a3e6-4814-82f5-89c5f76c8abe tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:03.397697 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-143c7603-a3e6-4814-82f5-89c5f76c8abe tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:03.398109 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-143c7603-a3e6-4814-82f5-89c5f76c8abe tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:03.398895 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-143c7603-a3e6-4814-82f5-89c5f76c8abe tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:03.399333 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-143c7603-a3e6-4814-82f5-89c5f76c8abe tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:03.459058 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-143c7603-a3e6-4814-82f5-89c5f76c8abe tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 14 microversion: 2.1 time: 0.073870 Aug 25 05:57:03.460487 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1158/2351] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:03 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 25 05:57:04.471696 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-18c2195a-5646-477c-8a46-d327ed7157b3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:04.472691 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-18c2195a-5646-477c-8a46-d327ed7157b3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:04.479798 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-18c2195a-5646-477c-8a46-d327ed7157b3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:04.480246 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-18c2195a-5646-477c-8a46-d327ed7157b3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:04.481038 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-18c2195a-5646-477c-8a46-d327ed7157b3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:04.481472 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-18c2195a-5646-477c-8a46-d327ed7157b3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:04.536585 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-18c2195a-5646-477c-8a46-d327ed7157b3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 14 microversion: 2.1 time: 0.068734 Aug 25 05:57:04.537214 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1194/2352] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:04 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 14 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 05:57:05.548929 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e621a730-dd82-4077-be6b-0761a2e39459 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:05.549952 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e621a730-dd82-4077-be6b-0761a2e39459 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:05.557018 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e621a730-dd82-4077-be6b-0761a2e39459 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:05.557461 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e621a730-dd82-4077-be6b-0761a2e39459 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:05.558256 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e621a730-dd82-4077-be6b-0761a2e39459 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:05.558686 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e621a730-dd82-4077-be6b-0761a2e39459 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:05.615406 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e621a730-dd82-4077-be6b-0761a2e39459 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 14 microversion: 2.1 time: 0.070378 Aug 25 05:57:05.616169 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1159/2353] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:05 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 05:57:06.626821 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-79acecb0-70e8-4da5-8937-13db020ff4bb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:06.627807 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-79acecb0-70e8-4da5-8937-13db020ff4bb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:06.635285 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-79acecb0-70e8-4da5-8937-13db020ff4bb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:06.635724 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-79acecb0-70e8-4da5-8937-13db020ff4bb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:06.636486 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-79acecb0-70e8-4da5-8937-13db020ff4bb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:06.636922 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-79acecb0-70e8-4da5-8937-13db020ff4bb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:06.700765 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-79acecb0-70e8-4da5-8937-13db020ff4bb tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 14 microversion: 2.1 time: 0.077749 Aug 25 05:57:06.701406 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1195/2354] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:06 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 05:57:07.713122 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-349e91c2-f9b3-48e3-ac34-790d812c0a51 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:07.714074 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-349e91c2-f9b3-48e3-ac34-790d812c0a51 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:07.720507 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-349e91c2-f9b3-48e3-ac34-790d812c0a51 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:07.720954 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-349e91c2-f9b3-48e3-ac34-790d812c0a51 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:07.721756 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-349e91c2-f9b3-48e3-ac34-790d812c0a51 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:07.722197 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-349e91c2-f9b3-48e3-ac34-790d812c0a51 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:07.779632 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-349e91c2-f9b3-48e3-ac34-790d812c0a51 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 14 microversion: 2.1 time: 0.071118 Aug 25 05:57:07.780265 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1160/2355] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:07 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 05:57:08.790745 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6b67457e-c6b8-4bd9-8852-6af68ee728c5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:08.791672 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6b67457e-c6b8-4bd9-8852-6af68ee728c5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:08.798076 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6b67457e-c6b8-4bd9-8852-6af68ee728c5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:08.798513 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6b67457e-c6b8-4bd9-8852-6af68ee728c5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:08.799264 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6b67457e-c6b8-4bd9-8852-6af68ee728c5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:08.799687 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6b67457e-c6b8-4bd9-8852-6af68ee728c5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:08.858873 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6b67457e-c6b8-4bd9-8852-6af68ee728c5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 14 microversion: 2.1 time: 0.072164 Aug 25 05:57:08.859481 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1196/2356] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:08 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 05:57:09.873750 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-62711344-eb93-4925-9cf3-37f6e89be7f4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:09.875400 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-62711344-eb93-4925-9cf3-37f6e89be7f4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:09.883367 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-62711344-eb93-4925-9cf3-37f6e89be7f4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:09.883806 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-62711344-eb93-4925-9cf3-37f6e89be7f4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:09.884556 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-62711344-eb93-4925-9cf3-37f6e89be7f4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:09.884986 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-62711344-eb93-4925-9cf3-37f6e89be7f4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:09.958364 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-62711344-eb93-4925-9cf3-37f6e89be7f4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 7043 microversion: 2.1 time: 0.092216 Aug 25 05:57:09.958997 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1161/2357] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:09 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 7043 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:57:10.970949 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-3647c685-ead7-437e-8c73-f5deae6e794f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:10.971897 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-3647c685-ead7-437e-8c73-f5deae6e794f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:10.979079 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3647c685-ead7-437e-8c73-f5deae6e794f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:10.979527 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3647c685-ead7-437e-8c73-f5deae6e794f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:10.980375 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3647c685-ead7-437e-8c73-f5deae6e794f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:10.980820 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3647c685-ead7-437e-8c73-f5deae6e794f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:11.049545 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-3647c685-ead7-437e-8c73-f5deae6e794f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 15145 microversion: 2.1 time: 0.082587 Aug 25 05:57:11.050179 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1197/2358] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:10 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 15145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:57:12.061327 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b0564380-0861-463b-ac2f-dfacdab22171 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:12.062349 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b0564380-0861-463b-ac2f-dfacdab22171 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:12.069107 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b0564380-0861-463b-ac2f-dfacdab22171 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:12.069570 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b0564380-0861-463b-ac2f-dfacdab22171 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:12.071058 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b0564380-0861-463b-ac2f-dfacdab22171 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:12.071486 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b0564380-0861-463b-ac2f-dfacdab22171 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:12.157080 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b0564380-0861-463b-ac2f-dfacdab22171 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 18561 microversion: 2.1 time: 0.100081 Aug 25 05:57:12.157950 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1162/2359] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:12 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 18561 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:57:13.168270 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-54be7a32-c0e6-4bd3-b4a1-fe4a1000e268 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:13.169258 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-54be7a32-c0e6-4bd3-b4a1-fe4a1000e268 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:13.175730 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-54be7a32-c0e6-4bd3-b4a1-fe4a1000e268 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:13.176171 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-54be7a32-c0e6-4bd3-b4a1-fe4a1000e268 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:13.176927 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-54be7a32-c0e6-4bd3-b4a1-fe4a1000e268 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:13.177356 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-54be7a32-c0e6-4bd3-b4a1-fe4a1000e268 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:13.251560 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-54be7a32-c0e6-4bd3-b4a1-fe4a1000e268 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 20675 microversion: 2.1 time: 0.087413 Aug 25 05:57:13.252184 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1198/2360] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:13 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 20675 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:57:14.263837 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-893f21a0-de70-4b53-98a1-dde14f58bddf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:14.264771 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-893f21a0-de70-4b53-98a1-dde14f58bddf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:14.271253 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-893f21a0-de70-4b53-98a1-dde14f58bddf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:14.271691 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-893f21a0-de70-4b53-98a1-dde14f58bddf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:14.279581 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-893f21a0-de70-4b53-98a1-dde14f58bddf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:14.279581 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-893f21a0-de70-4b53-98a1-dde14f58bddf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:14.344685 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-893f21a0-de70-4b53-98a1-dde14f58bddf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 22852 microversion: 2.1 time: 0.084717 Aug 25 05:57:14.345379 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1163/2361] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:14 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 22852 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:57:15.357825 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-cfaad434-6aa8-4a06-8f84-2dacb254ca9a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:15.358803 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-cfaad434-6aa8-4a06-8f84-2dacb254ca9a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:15.365268 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cfaad434-6aa8-4a06-8f84-2dacb254ca9a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:15.365732 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cfaad434-6aa8-4a06-8f84-2dacb254ca9a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:15.366483 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cfaad434-6aa8-4a06-8f84-2dacb254ca9a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:15.366914 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cfaad434-6aa8-4a06-8f84-2dacb254ca9a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:15.436732 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-cfaad434-6aa8-4a06-8f84-2dacb254ca9a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 23880 microversion: 2.1 time: 0.082706 Aug 25 05:57:15.437382 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1199/2362] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:15 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 23880 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:57:16.449190 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-db7e3d2c-6be5-46fd-baf8-c893da24ecba tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:16.450215 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-db7e3d2c-6be5-46fd-baf8-c893da24ecba tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:16.456706 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-db7e3d2c-6be5-46fd-baf8-c893da24ecba tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:16.457154 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-db7e3d2c-6be5-46fd-baf8-c893da24ecba tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:16.457956 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-db7e3d2c-6be5-46fd-baf8-c893da24ecba tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:16.458392 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-db7e3d2c-6be5-46fd-baf8-c893da24ecba tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:16.528204 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-db7e3d2c-6be5-46fd-baf8-c893da24ecba tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 25656 microversion: 2.1 time: 0.083140 Aug 25 05:57:16.531940 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1164/2363] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:16 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 25656 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:57:17.540637 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-403e8c14-1ca5-4700-9660-1a7cce83dbe6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:17.541678 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-403e8c14-1ca5-4700-9660-1a7cce83dbe6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:17.548244 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-403e8c14-1ca5-4700-9660-1a7cce83dbe6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:17.548681 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-403e8c14-1ca5-4700-9660-1a7cce83dbe6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:17.549441 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-403e8c14-1ca5-4700-9660-1a7cce83dbe6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:17.549897 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-403e8c14-1ca5-4700-9660-1a7cce83dbe6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:17.625168 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-403e8c14-1ca5-4700-9660-1a7cce83dbe6 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 27029 microversion: 2.1 time: 0.088819 Aug 25 05:57:17.626392 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1200/2364] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:17 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 27029 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:57:18.638814 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-4a861c73-4156-4822-9e2a-0cd84767b7d2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:18.639844 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-4a861c73-4156-4822-9e2a-0cd84767b7d2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:18.646313 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4a861c73-4156-4822-9e2a-0cd84767b7d2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:18.646766 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4a861c73-4156-4822-9e2a-0cd84767b7d2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:18.647537 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4a861c73-4156-4822-9e2a-0cd84767b7d2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:18.647974 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4a861c73-4156-4822-9e2a-0cd84767b7d2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:18.721231 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-4a861c73-4156-4822-9e2a-0cd84767b7d2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 27735 microversion: 2.1 time: 0.086214 Aug 25 05:57:18.721954 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1165/2365] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:18 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 27735 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:57:19.733120 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1179808d-e9c4-422f-87ae-d6abfa7a29f7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:19.734347 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1179808d-e9c4-422f-87ae-d6abfa7a29f7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:19.741014 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1179808d-e9c4-422f-87ae-d6abfa7a29f7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:19.741408 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1179808d-e9c4-422f-87ae-d6abfa7a29f7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:19.742719 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1179808d-e9c4-422f-87ae-d6abfa7a29f7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:19.743371 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1179808d-e9c4-422f-87ae-d6abfa7a29f7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:19.817333 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1179808d-e9c4-422f-87ae-d6abfa7a29f7 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 28138 microversion: 2.1 time: 0.088112 Aug 25 05:57:19.817981 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1201/2366] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:19 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 28138 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:57:20.828900 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3edcebba-f81a-4f31-8d2c-27ec6e91e1e2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:20.829918 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3edcebba-f81a-4f31-8d2c-27ec6e91e1e2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:20.836378 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3edcebba-f81a-4f31-8d2c-27ec6e91e1e2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:20.836818 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3edcebba-f81a-4f31-8d2c-27ec6e91e1e2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:20.837600 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3edcebba-f81a-4f31-8d2c-27ec6e91e1e2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:20.838034 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3edcebba-f81a-4f31-8d2c-27ec6e91e1e2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:20.919144 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3edcebba-f81a-4f31-8d2c-27ec6e91e1e2 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 28197 microversion: 2.1 time: 0.094057 Aug 25 05:57:20.919782 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1166/2367] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:20 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 28197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:57:21.931948 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-98068151-51fe-49a6-84f3-0ec1e6c78a37 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:21.936282 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-98068151-51fe-49a6-84f3-0ec1e6c78a37 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:21.939395 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-98068151-51fe-49a6-84f3-0ec1e6c78a37 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:21.940312 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-98068151-51fe-49a6-84f3-0ec1e6c78a37 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:21.940588 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-98068151-51fe-49a6-84f3-0ec1e6c78a37 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:21.941018 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-98068151-51fe-49a6-84f3-0ec1e6c78a37 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:22.002180 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-98068151-51fe-49a6-84f3-0ec1e6c78a37 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 28197 microversion: 2.1 time: 0.074765 Aug 25 05:57:22.003052 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1202/2368] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:21 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 28197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:57:23.015716 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-06aecc3b-cffe-4e53-a13d-d80675686d2a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:23.016727 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-06aecc3b-cffe-4e53-a13d-d80675686d2a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:23.024647 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-06aecc3b-cffe-4e53-a13d-d80675686d2a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:23.025254 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-06aecc3b-cffe-4e53-a13d-d80675686d2a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:23.026411 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-06aecc3b-cffe-4e53-a13d-d80675686d2a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:23.026824 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-06aecc3b-cffe-4e53-a13d-d80675686d2a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:23.092165 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-06aecc3b-cffe-4e53-a13d-d80675686d2a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 28197 microversion: 2.1 time: 0.080602 Aug 25 05:57:23.093256 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1167/2369] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:23 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 28197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:57:24.105194 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-37c94880-108e-4944-a50f-7201c824d8ee tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:24.106350 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-37c94880-108e-4944-a50f-7201c824d8ee tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:24.112831 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-37c94880-108e-4944-a50f-7201c824d8ee tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:24.113278 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-37c94880-108e-4944-a50f-7201c824d8ee tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:24.114081 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-37c94880-108e-4944-a50f-7201c824d8ee tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:24.114522 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-37c94880-108e-4944-a50f-7201c824d8ee tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:24.174481 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-37c94880-108e-4944-a50f-7201c824d8ee tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 28197 microversion: 2.1 time: 0.074153 Aug 25 05:57:24.175282 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1203/2370] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:24 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 28197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:57:25.187385 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a6f7d719-3283-47f5-a9b2-cf1c5fa7b5cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:25.189124 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a6f7d719-3283-47f5-a9b2-cf1c5fa7b5cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:25.194812 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a6f7d719-3283-47f5-a9b2-cf1c5fa7b5cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:25.195249 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a6f7d719-3283-47f5-a9b2-cf1c5fa7b5cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:25.196137 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a6f7d719-3283-47f5-a9b2-cf1c5fa7b5cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:25.196559 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a6f7d719-3283-47f5-a9b2-cf1c5fa7b5cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:25.259242 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a6f7d719-3283-47f5-a9b2-cf1c5fa7b5cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 28197 microversion: 2.1 time: 0.075586 Aug 25 05:57:25.260032 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1168/2371] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:25 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 28197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:57:26.271205 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b3878f99-ad0c-4da3-861d-21cb47572cb4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:26.273333 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b3878f99-ad0c-4da3-861d-21cb47572cb4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:26.279331 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b3878f99-ad0c-4da3-861d-21cb47572cb4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:26.279774 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b3878f99-ad0c-4da3-861d-21cb47572cb4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:26.280542 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b3878f99-ad0c-4da3-861d-21cb47572cb4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:26.280972 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b3878f99-ad0c-4da3-861d-21cb47572cb4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:26.340052 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b3878f99-ad0c-4da3-861d-21cb47572cb4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 28197 microversion: 2.1 time: 0.072745 Aug 25 05:57:26.340706 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1204/2372] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:26 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 28197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:57:27.352487 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5ff23f63-75f0-497b-b928-df54ee081232 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:27.353404 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5ff23f63-75f0-497b-b928-df54ee081232 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:27.359958 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5ff23f63-75f0-497b-b928-df54ee081232 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:27.360403 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5ff23f63-75f0-497b-b928-df54ee081232 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:27.361157 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5ff23f63-75f0-497b-b928-df54ee081232 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:27.361685 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5ff23f63-75f0-497b-b928-df54ee081232 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:27.425942 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5ff23f63-75f0-497b-b928-df54ee081232 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 28197 microversion: 2.1 time: 0.077235 Aug 25 05:57:27.426631 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1169/2373] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:27 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 28197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:57:28.439361 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f51324ad-baa8-4aaa-8b93-254986cb77bd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:28.440340 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f51324ad-baa8-4aaa-8b93-254986cb77bd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:28.447988 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f51324ad-baa8-4aaa-8b93-254986cb77bd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:28.448436 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f51324ad-baa8-4aaa-8b93-254986cb77bd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:28.449188 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f51324ad-baa8-4aaa-8b93-254986cb77bd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:28.449655 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f51324ad-baa8-4aaa-8b93-254986cb77bd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:28.511698 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f51324ad-baa8-4aaa-8b93-254986cb77bd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 28197 microversion: 2.1 time: 0.076380 Aug 25 05:57:28.512332 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1205/2374] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:28 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 28197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:57:29.524559 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-df9ec8ff-92a7-48d5-ac3e-46fa912717ff tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:29.525858 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-df9ec8ff-92a7-48d5-ac3e-46fa912717ff tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:29.532401 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-df9ec8ff-92a7-48d5-ac3e-46fa912717ff tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:29.532845 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-df9ec8ff-92a7-48d5-ac3e-46fa912717ff tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:29.533638 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-df9ec8ff-92a7-48d5-ac3e-46fa912717ff tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:29.534076 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-df9ec8ff-92a7-48d5-ac3e-46fa912717ff tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:29.619707 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-df9ec8ff-92a7-48d5-ac3e-46fa912717ff tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 28197 microversion: 2.1 time: 0.099857 Aug 25 05:57:29.620388 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1170/2375] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:29 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 28197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:57:30.631565 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ddb86fd2-2f2f-447d-8ee8-bb8bfe3575d1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:30.634632 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ddb86fd2-2f2f-447d-8ee8-bb8bfe3575d1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:30.639293 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ddb86fd2-2f2f-447d-8ee8-bb8bfe3575d1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:30.639779 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ddb86fd2-2f2f-447d-8ee8-bb8bfe3575d1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:30.640557 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ddb86fd2-2f2f-447d-8ee8-bb8bfe3575d1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:30.640993 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ddb86fd2-2f2f-447d-8ee8-bb8bfe3575d1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:30.701191 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ddb86fd2-2f2f-447d-8ee8-bb8bfe3575d1 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 28197 microversion: 2.1 time: 0.073637 Aug 25 05:57:30.701891 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1206/2376] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:30 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 28197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:57:31.713470 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-15cf4690-bc93-4619-860f-df4dc723340f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:31.714395 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-15cf4690-bc93-4619-860f-df4dc723340f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:31.721104 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-15cf4690-bc93-4619-860f-df4dc723340f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:31.721563 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-15cf4690-bc93-4619-860f-df4dc723340f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:31.722321 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-15cf4690-bc93-4619-860f-df4dc723340f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:31.722746 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-15cf4690-bc93-4619-860f-df4dc723340f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:31.794013 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-15cf4690-bc93-4619-860f-df4dc723340f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 28486 microversion: 2.1 time: 0.084510 Aug 25 05:57:31.794688 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1171/2377] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:31 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 28486 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:57:32.806396 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5322d460-2830-47ea-b61d-760c878069ec tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:32.807582 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5322d460-2830-47ea-b61d-760c878069ec tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:32.814697 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5322d460-2830-47ea-b61d-760c878069ec tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:32.815141 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5322d460-2830-47ea-b61d-760c878069ec tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:32.815898 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5322d460-2830-47ea-b61d-760c878069ec tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:32.816328 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5322d460-2830-47ea-b61d-760c878069ec tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:32.891466 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5322d460-2830-47ea-b61d-760c878069ec tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 28488 microversion: 2.1 time: 0.089104 Aug 25 05:57:32.892350 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1207/2378] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:32 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 28488 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:57:33.904406 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a8cfa151-1589-410f-8852-0d14130779b5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:33.905399 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a8cfa151-1589-410f-8852-0d14130779b5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:33.911932 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a8cfa151-1589-410f-8852-0d14130779b5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:33.912384 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a8cfa151-1589-410f-8852-0d14130779b5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:33.913143 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a8cfa151-1589-410f-8852-0d14130779b5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:33.913599 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a8cfa151-1589-410f-8852-0d14130779b5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:33.992375 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a8cfa151-1589-410f-8852-0d14130779b5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 28656 microversion: 2.1 time: 0.092477 Aug 25 05:57:33.993030 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1172/2379] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:33 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 28656 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:57:35.005404 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-fc518170-573d-4354-8c1d-d839506cbe3c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:35.006366 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-fc518170-573d-4354-8c1d-d839506cbe3c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:35.013610 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fc518170-573d-4354-8c1d-d839506cbe3c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:35.014059 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fc518170-573d-4354-8c1d-d839506cbe3c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:35.014830 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fc518170-573d-4354-8c1d-d839506cbe3c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:35.015300 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fc518170-573d-4354-8c1d-d839506cbe3c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:35.081915 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-fc518170-573d-4354-8c1d-d839506cbe3c tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 28656 microversion: 2.1 time: 0.080482 Aug 25 05:57:35.082795 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1208/2380] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:34 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 28656 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:57:36.094161 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-2d695cd0-c3f1-4674-b3b7-d906be8f4be8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:36.095177 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-2d695cd0-c3f1-4674-b3b7-d906be8f4be8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:36.101627 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2d695cd0-c3f1-4674-b3b7-d906be8f4be8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:36.102069 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2d695cd0-c3f1-4674-b3b7-d906be8f4be8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:36.102820 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2d695cd0-c3f1-4674-b3b7-d906be8f4be8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:36.103247 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2d695cd0-c3f1-4674-b3b7-d906be8f4be8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:36.163838 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-2d695cd0-c3f1-4674-b3b7-d906be8f4be8 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 28656 microversion: 2.1 time: 0.073901 Aug 25 05:57:36.164711 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1173/2381] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:36 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 28656 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:57:37.176394 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f92c23f0-a289-4f07-a662-5d80a6026c5f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:37.177375 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f92c23f0-a289-4f07-a662-5d80a6026c5f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:37.184626 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f92c23f0-a289-4f07-a662-5d80a6026c5f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:37.185064 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f92c23f0-a289-4f07-a662-5d80a6026c5f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:37.185907 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f92c23f0-a289-4f07-a662-5d80a6026c5f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:37.186272 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f92c23f0-a289-4f07-a662-5d80a6026c5f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:37.248181 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f92c23f0-a289-4f07-a662-5d80a6026c5f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 28656 microversion: 2.1 time: 0.075708 Aug 25 05:57:37.248803 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1209/2382] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:37 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 28656 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:57:38.260382 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b60cc553-9cfb-4706-ab4c-0ad76f8e0d12 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:38.261277 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b60cc553-9cfb-4706-ab4c-0ad76f8e0d12 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:38.268340 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b60cc553-9cfb-4706-ab4c-0ad76f8e0d12 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:38.268780 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b60cc553-9cfb-4706-ab4c-0ad76f8e0d12 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:38.269543 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b60cc553-9cfb-4706-ab4c-0ad76f8e0d12 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:38.269980 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b60cc553-9cfb-4706-ab4c-0ad76f8e0d12 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:38.333243 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b60cc553-9cfb-4706-ab4c-0ad76f8e0d12 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 28656 microversion: 2.1 time: 0.076733 Aug 25 05:57:38.334238 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1174/2383] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:38 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 28656 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:57:39.346166 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-841c8d9e-ce7e-4d6b-a03a-7fbb2708ec0e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:39.347148 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-841c8d9e-ce7e-4d6b-a03a-7fbb2708ec0e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:39.353676 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-841c8d9e-ce7e-4d6b-a03a-7fbb2708ec0e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:39.354114 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-841c8d9e-ce7e-4d6b-a03a-7fbb2708ec0e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:39.354861 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-841c8d9e-ce7e-4d6b-a03a-7fbb2708ec0e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:39.355282 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-841c8d9e-ce7e-4d6b-a03a-7fbb2708ec0e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:39.420606 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-841c8d9e-ce7e-4d6b-a03a-7fbb2708ec0e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 28656 microversion: 2.1 time: 0.078419 Aug 25 05:57:39.421294 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1210/2384] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:39 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 28656 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:57:40.432938 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a7b1a759-d981-48b3-ad3c-21240753d494 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:40.434498 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a7b1a759-d981-48b3-ad3c-21240753d494 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:40.440999 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a7b1a759-d981-48b3-ad3c-21240753d494 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:40.441449 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a7b1a759-d981-48b3-ad3c-21240753d494 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:40.442236 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a7b1a759-d981-48b3-ad3c-21240753d494 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:40.442673 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a7b1a759-d981-48b3-ad3c-21240753d494 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:40.503702 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a7b1a759-d981-48b3-ad3c-21240753d494 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 28656 microversion: 2.1 time: 0.074784 Aug 25 05:57:40.504351 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1175/2385] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:40 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 28656 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:57:41.516581 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-232c8a58-fbeb-4650-8821-9184b90d33a0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:41.517627 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-232c8a58-fbeb-4650-8821-9184b90d33a0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:41.524053 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-232c8a58-fbeb-4650-8821-9184b90d33a0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:41.524486 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-232c8a58-fbeb-4650-8821-9184b90d33a0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:41.525238 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-232c8a58-fbeb-4650-8821-9184b90d33a0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:41.525690 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-232c8a58-fbeb-4650-8821-9184b90d33a0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:41.583968 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-232c8a58-fbeb-4650-8821-9184b90d33a0 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 28656 microversion: 2.1 time: 0.071928 Aug 25 05:57:41.584847 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1211/2386] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:41 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 28656 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:57:42.596870 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c5748f42-0ed3-4b39-b532-4281202346ff tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:42.597913 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c5748f42-0ed3-4b39-b532-4281202346ff tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:42.604427 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c5748f42-0ed3-4b39-b532-4281202346ff tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:42.604875 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c5748f42-0ed3-4b39-b532-4281202346ff tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:42.606346 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c5748f42-0ed3-4b39-b532-4281202346ff tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:42.606787 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c5748f42-0ed3-4b39-b532-4281202346ff tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:42.670814 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c5748f42-0ed3-4b39-b532-4281202346ff tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 28656 microversion: 2.1 time: 0.077826 Aug 25 05:57:42.671703 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1176/2387] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:42 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 28656 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:57:43.683457 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-14c6ccc6-2757-45d4-a261-6fe676224b8e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:43.685143 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-14c6ccc6-2757-45d4-a261-6fe676224b8e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:43.691933 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-14c6ccc6-2757-45d4-a261-6fe676224b8e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:43.692374 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-14c6ccc6-2757-45d4-a261-6fe676224b8e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:43.693141 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-14c6ccc6-2757-45d4-a261-6fe676224b8e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:43.693742 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-14c6ccc6-2757-45d4-a261-6fe676224b8e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:43.756421 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-14c6ccc6-2757-45d4-a261-6fe676224b8e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 28656 microversion: 2.1 time: 0.077091 Aug 25 05:57:43.757095 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1212/2388] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:43 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 28656 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:57:44.769106 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5cf51e0f-f507-4228-8d19-1112d1d59c5d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:44.770160 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5cf51e0f-f507-4228-8d19-1112d1d59c5d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:44.776936 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5cf51e0f-f507-4228-8d19-1112d1d59c5d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:44.777393 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5cf51e0f-f507-4228-8d19-1112d1d59c5d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:44.778961 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5cf51e0f-f507-4228-8d19-1112d1d59c5d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:44.779394 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5cf51e0f-f507-4228-8d19-1112d1d59c5d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:44.839622 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5cf51e0f-f507-4228-8d19-1112d1d59c5d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 28656 microversion: 2.1 time: 0.074317 Aug 25 05:57:44.840271 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1177/2389] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:44 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 28656 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:57:45.852066 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-83429403-a336-4a35-ba6f-aa0e3e37b776 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:45.852983 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-83429403-a336-4a35-ba6f-aa0e3e37b776 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:45.860168 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-83429403-a336-4a35-ba6f-aa0e3e37b776 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:45.860610 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-83429403-a336-4a35-ba6f-aa0e3e37b776 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:45.861381 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-83429403-a336-4a35-ba6f-aa0e3e37b776 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:45.861845 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-83429403-a336-4a35-ba6f-aa0e3e37b776 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:45.921148 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-83429403-a336-4a35-ba6f-aa0e3e37b776 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 28656 microversion: 2.1 time: 0.073122 Aug 25 05:57:45.921846 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1213/2390] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:45 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 28656 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:57:46.933388 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-fc9a88bc-5ab6-4877-852c-6b5e830c540e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:46.935113 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-fc9a88bc-5ab6-4877-852c-6b5e830c540e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:46.941595 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fc9a88bc-5ab6-4877-852c-6b5e830c540e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:46.942037 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fc9a88bc-5ab6-4877-852c-6b5e830c540e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:46.942786 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fc9a88bc-5ab6-4877-852c-6b5e830c540e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:46.943211 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fc9a88bc-5ab6-4877-852c-6b5e830c540e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:47.004097 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-fc9a88bc-5ab6-4877-852c-6b5e830c540e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 28656 microversion: 2.1 time: 0.074665 Aug 25 05:57:47.004737 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1178/2391] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:46 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 28656 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:57:48.016836 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-0f60a03d-3cb8-4234-901a-10428341fee5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:48.017836 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-0f60a03d-3cb8-4234-901a-10428341fee5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:48.024356 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0f60a03d-3cb8-4234-901a-10428341fee5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:48.024864 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0f60a03d-3cb8-4234-901a-10428341fee5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:48.026096 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0f60a03d-3cb8-4234-901a-10428341fee5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:48.026527 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0f60a03d-3cb8-4234-901a-10428341fee5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:48.083948 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-0f60a03d-3cb8-4234-901a-10428341fee5 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 28656 microversion: 2.1 time: 0.071631 Aug 25 05:57:48.084584 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1214/2392] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:48 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 28656 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:57:48.425436 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 05:57:48.425692 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: Wed Aug 25 05:57:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 05:57:49.096265 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-33ca8593-d7f6-44e2-8fe5-b70314d7629b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:49.097269 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-33ca8593-d7f6-44e2-8fe5-b70314d7629b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:49.103777 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-33ca8593-d7f6-44e2-8fe5-b70314d7629b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:49.104222 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-33ca8593-d7f6-44e2-8fe5-b70314d7629b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:49.105127 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-33ca8593-d7f6-44e2-8fe5-b70314d7629b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:49.106147 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-33ca8593-d7f6-44e2-8fe5-b70314d7629b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:49.165689 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-33ca8593-d7f6-44e2-8fe5-b70314d7629b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 28656 microversion: 2.1 time: 0.073354 Aug 25 05:57:49.166507 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1179/2393] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:49 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 28656 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:57:50.178533 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-4a6ca06c-a239-456f-99f9-89d187fc391e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:50.179547 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-4a6ca06c-a239-456f-99f9-89d187fc391e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:50.186711 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4a6ca06c-a239-456f-99f9-89d187fc391e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:50.187150 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4a6ca06c-a239-456f-99f9-89d187fc391e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:50.187897 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4a6ca06c-a239-456f-99f9-89d187fc391e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:50.188323 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4a6ca06c-a239-456f-99f9-89d187fc391e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:50.260007 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-4a6ca06c-a239-456f-99f9-89d187fc391e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 28656 microversion: 2.1 time: 0.085295 Aug 25 05:57:50.260841 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1215/2394] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:50 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 28656 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:57:51.272218 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-30fc53f0-45e6-4b56-b3e3-6b5109b58774 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:51.273666 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-30fc53f0-45e6-4b56-b3e3-6b5109b58774 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:51.280127 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-30fc53f0-45e6-4b56-b3e3-6b5109b58774 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:51.280568 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-30fc53f0-45e6-4b56-b3e3-6b5109b58774 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:51.281321 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-30fc53f0-45e6-4b56-b3e3-6b5109b58774 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:51.281786 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-30fc53f0-45e6-4b56-b3e3-6b5109b58774 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:51.339576 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-30fc53f0-45e6-4b56-b3e3-6b5109b58774 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 28656 microversion: 2.1 time: 0.071358 Aug 25 05:57:51.340585 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1180/2395] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:51 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 28656 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:57:52.352283 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d08a8187-eaf2-47c3-b6a2-741f035f9ce9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:52.353297 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d08a8187-eaf2-47c3-b6a2-741f035f9ce9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:52.360090 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d08a8187-eaf2-47c3-b6a2-741f035f9ce9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:52.360520 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d08a8187-eaf2-47c3-b6a2-741f035f9ce9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:52.361284 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d08a8187-eaf2-47c3-b6a2-741f035f9ce9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:52.361746 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d08a8187-eaf2-47c3-b6a2-741f035f9ce9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:52.430371 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d08a8187-eaf2-47c3-b6a2-741f035f9ce9 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 28656 microversion: 2.1 time: 0.081948 Aug 25 05:57:52.431213 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1216/2396] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:52 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 28656 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:57:53.442386 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-fdda6ad7-5ba4-494c-a949-77d30e02efa4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:53.443369 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-fdda6ad7-5ba4-494c-a949-77d30e02efa4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:53.450548 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fdda6ad7-5ba4-494c-a949-77d30e02efa4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:53.450986 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fdda6ad7-5ba4-494c-a949-77d30e02efa4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:53.451736 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fdda6ad7-5ba4-494c-a949-77d30e02efa4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:53.452161 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fdda6ad7-5ba4-494c-a949-77d30e02efa4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:53.512363 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-fdda6ad7-5ba4-494c-a949-77d30e02efa4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 28656 microversion: 2.1 time: 0.073275 Aug 25 05:57:53.513543 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1181/2397] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:53 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 28656 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:57:54.524985 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5db280a1-98f5-4de9-a01e-f16bfeb3ffb3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:54.526273 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5db280a1-98f5-4de9-a01e-f16bfeb3ffb3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:54.533920 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5db280a1-98f5-4de9-a01e-f16bfeb3ffb3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:54.534360 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5db280a1-98f5-4de9-a01e-f16bfeb3ffb3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:54.535124 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5db280a1-98f5-4de9-a01e-f16bfeb3ffb3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:54.535555 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5db280a1-98f5-4de9-a01e-f16bfeb3ffb3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:54.595413 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5db280a1-98f5-4de9-a01e-f16bfeb3ffb3 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 28656 microversion: 2.1 time: 0.074310 Aug 25 05:57:54.596082 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1217/2398] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:54 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 28656 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:57:55.608680 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-16f73eb1-e267-4616-aa94-8d3f9bb5bace tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:55.609697 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-16f73eb1-e267-4616-aa94-8d3f9bb5bace tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:55.616160 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-16f73eb1-e267-4616-aa94-8d3f9bb5bace tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:55.616669 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-16f73eb1-e267-4616-aa94-8d3f9bb5bace tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:55.617431 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-16f73eb1-e267-4616-aa94-8d3f9bb5bace tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:55.618013 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-16f73eb1-e267-4616-aa94-8d3f9bb5bace tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:55.677271 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-16f73eb1-e267-4616-aa94-8d3f9bb5bace tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 28656 microversion: 2.1 time: 0.073108 Aug 25 05:57:55.678004 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1182/2399] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:55 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 28656 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:57:56.690562 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d147bda7-4cfc-42c8-9146-c1c4f9b03232 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:56.691556 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d147bda7-4cfc-42c8-9146-c1c4f9b03232 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:56.698270 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d147bda7-4cfc-42c8-9146-c1c4f9b03232 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:56.698780 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d147bda7-4cfc-42c8-9146-c1c4f9b03232 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:56.699751 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d147bda7-4cfc-42c8-9146-c1c4f9b03232 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:56.700182 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d147bda7-4cfc-42c8-9146-c1c4f9b03232 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:56.759529 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d147bda7-4cfc-42c8-9146-c1c4f9b03232 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 28656 microversion: 2.1 time: 0.072997 Aug 25 05:57:56.760170 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1218/2400] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:56 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 28656 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:57:57.771379 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-835a8251-c069-4c6e-a8d5-70d017d856bf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:57.772366 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-835a8251-c069-4c6e-a8d5-70d017d856bf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:57.779272 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-835a8251-c069-4c6e-a8d5-70d017d856bf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:57.779728 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-835a8251-c069-4c6e-a8d5-70d017d856bf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:57.780490 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-835a8251-c069-4c6e-a8d5-70d017d856bf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:57.780925 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-835a8251-c069-4c6e-a8d5-70d017d856bf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:57.842206 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-835a8251-c069-4c6e-a8d5-70d017d856bf tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 28656 microversion: 2.1 time: 0.074577 Aug 25 05:57:57.843159 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1183/2401] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:57 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 28656 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:57:58.854556 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d6673569-a77d-4919-857b-f13b2ca72558 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:58.855626 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d6673569-a77d-4919-857b-f13b2ca72558 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:58.863059 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d6673569-a77d-4919-857b-f13b2ca72558 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:58.863502 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d6673569-a77d-4919-857b-f13b2ca72558 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:58.864269 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d6673569-a77d-4919-857b-f13b2ca72558 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:58.864695 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d6673569-a77d-4919-857b-f13b2ca72558 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:58.925680 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d6673569-a77d-4919-857b-f13b2ca72558 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 28656 microversion: 2.1 time: 0.075027 Aug 25 05:57:58.926390 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1219/2402] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:58 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 28656 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:57:59.938131 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d6b2d3f1-f41d-4fa2-8977-46b32834b863 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:57:59.939119 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-d6b2d3f1-f41d-4fa2-8977-46b32834b863 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:57:59.945549 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d6b2d3f1-f41d-4fa2-8977-46b32834b863 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:59.946005 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d6b2d3f1-f41d-4fa2-8977-46b32834b863 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:57:59.946754 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d6b2d3f1-f41d-4fa2-8977-46b32834b863 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:57:59.947184 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d6b2d3f1-f41d-4fa2-8977-46b32834b863 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:58:00.009726 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d6b2d3f1-f41d-4fa2-8977-46b32834b863 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 28656 microversion: 2.1 time: 0.076037 Aug 25 05:58:00.011206 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1184/2403] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:57:59 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 28656 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:58:01.022116 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-88534947-f4c9-40ff-922e-682af06ee132 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:58:01.023111 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-88534947-f4c9-40ff-922e-682af06ee132 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:58:01.031850 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-88534947-f4c9-40ff-922e-682af06ee132 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:58:01.032295 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-88534947-f4c9-40ff-922e-682af06ee132 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:58:01.033057 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-88534947-f4c9-40ff-922e-682af06ee132 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:58:01.033485 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-88534947-f4c9-40ff-922e-682af06ee132 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:58:01.112398 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-88534947-f4c9-40ff-922e-682af06ee132 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 30377 microversion: 2.1 time: 0.094218 Aug 25 05:58:01.113056 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1220/2404] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:58:01 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 30377 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:58:02.125128 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-dbeb1d16-2b09-4a6b-8937-c7dc6e38009d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:58:02.126207 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-dbeb1d16-2b09-4a6b-8937-c7dc6e38009d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:58:02.132812 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dbeb1d16-2b09-4a6b-8937-c7dc6e38009d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:58:02.133255 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dbeb1d16-2b09-4a6b-8937-c7dc6e38009d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:58:02.134051 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dbeb1d16-2b09-4a6b-8937-c7dc6e38009d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:58:02.134523 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dbeb1d16-2b09-4a6b-8937-c7dc6e38009d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:58:02.209459 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-dbeb1d16-2b09-4a6b-8937-c7dc6e38009d tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 32417 microversion: 2.1 time: 0.088719 Aug 25 05:58:02.210128 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1185/2405] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:58:02 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 32417 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:58:03.221880 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-49ce3bcd-7f55-4bc3-9b93-9e4273b1942b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:58:03.222779 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-49ce3bcd-7f55-4bc3-9b93-9e4273b1942b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:58:03.229332 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-49ce3bcd-7f55-4bc3-9b93-9e4273b1942b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:58:03.229807 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-49ce3bcd-7f55-4bc3-9b93-9e4273b1942b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:58:03.230567 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-49ce3bcd-7f55-4bc3-9b93-9e4273b1942b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:58:03.230994 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-49ce3bcd-7f55-4bc3-9b93-9e4273b1942b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:58:03.301240 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-49ce3bcd-7f55-4bc3-9b93-9e4273b1942b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 33630 microversion: 2.1 time: 0.083493 Aug 25 05:58:03.301898 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1221/2406] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:58:03 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 33630 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:58:04.314220 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c3440b9e-9ef7-4c26-af95-0beed87b42da tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:58:04.315398 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c3440b9e-9ef7-4c26-af95-0beed87b42da tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:58:04.322115 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c3440b9e-9ef7-4c26-af95-0beed87b42da tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:58:04.322565 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c3440b9e-9ef7-4c26-af95-0beed87b42da tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:58:04.323356 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c3440b9e-9ef7-4c26-af95-0beed87b42da tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:58:04.323788 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c3440b9e-9ef7-4c26-af95-0beed87b42da tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:58:04.398116 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c3440b9e-9ef7-4c26-af95-0beed87b42da tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 34699 microversion: 2.1 time: 0.088304 Aug 25 05:58:04.398768 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1186/2407] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:58:04 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 34699 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:58:05.411724 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-cd1443b3-4164-4a89-a2a7-f93e23d8c348 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:58:05.412634 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-cd1443b3-4164-4a89-a2a7-f93e23d8c348 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:58:05.419358 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cd1443b3-4164-4a89-a2a7-f93e23d8c348 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:58:05.419823 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cd1443b3-4164-4a89-a2a7-f93e23d8c348 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:58:05.420586 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cd1443b3-4164-4a89-a2a7-f93e23d8c348 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:58:05.421022 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cd1443b3-4164-4a89-a2a7-f93e23d8c348 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:58:05.492306 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-cd1443b3-4164-4a89-a2a7-f93e23d8c348 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 35816 microversion: 2.1 time: 0.085552 Aug 25 05:58:05.492951 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1222/2408] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:58:05 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 35816 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:58:06.505186 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-647b033b-4c23-4780-845d-fbbbb54d2494 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:58:06.506135 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-647b033b-4c23-4780-845d-fbbbb54d2494 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:58:06.513510 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-647b033b-4c23-4780-845d-fbbbb54d2494 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:58:06.514154 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-647b033b-4c23-4780-845d-fbbbb54d2494 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:58:06.515267 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-647b033b-4c23-4780-845d-fbbbb54d2494 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:58:06.515962 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-647b033b-4c23-4780-845d-fbbbb54d2494 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:58:06.594168 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-647b033b-4c23-4780-845d-fbbbb54d2494 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 37572 microversion: 2.1 time: 0.093692 Aug 25 05:58:06.594815 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1187/2409] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:58:06 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 37572 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:58:07.606656 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2c5965ac-ede9-45bf-8bbd-11fcc009f610 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:58:07.607697 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2c5965ac-ede9-45bf-8bbd-11fcc009f610 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:58:07.614986 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2c5965ac-ede9-45bf-8bbd-11fcc009f610 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:58:07.615426 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2c5965ac-ede9-45bf-8bbd-11fcc009f610 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:58:07.616192 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2c5965ac-ede9-45bf-8bbd-11fcc009f610 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:58:07.616615 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2c5965ac-ede9-45bf-8bbd-11fcc009f610 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:58:07.691102 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2c5965ac-ede9-45bf-8bbd-11fcc009f610 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 38186 microversion: 2.1 time: 0.087187 Aug 25 05:58:07.691738 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1223/2410] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:58:07 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 38186 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:58:08.703748 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-db0f8510-3c41-4302-9c11-3a56508f7c3a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:58:08.704744 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-db0f8510-3c41-4302-9c11-3a56508f7c3a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:58:08.713303 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-db0f8510-3c41-4302-9c11-3a56508f7c3a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:58:08.714633 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-db0f8510-3c41-4302-9c11-3a56508f7c3a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:58:08.714633 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-db0f8510-3c41-4302-9c11-3a56508f7c3a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:58:08.716417 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-db0f8510-3c41-4302-9c11-3a56508f7c3a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:58:08.780383 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-db0f8510-3c41-4302-9c11-3a56508f7c3a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 38186 microversion: 2.1 time: 0.080544 Aug 25 05:58:08.781214 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1188/2411] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:58:08 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 38186 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:58:09.792787 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-8d4357a9-7241-4461-a397-8cd573a612cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:58:09.793735 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-8d4357a9-7241-4461-a397-8cd573a612cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:58:09.800978 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8d4357a9-7241-4461-a397-8cd573a612cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:58:09.801708 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8d4357a9-7241-4461-a397-8cd573a612cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:58:09.803068 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8d4357a9-7241-4461-a397-8cd573a612cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:58:09.803820 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8d4357a9-7241-4461-a397-8cd573a612cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:58:09.867166 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-8d4357a9-7241-4461-a397-8cd573a612cd tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 38186 microversion: 2.1 time: 0.078272 Aug 25 05:58:09.867825 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1224/2412] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:58:09 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 38186 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:58:10.879692 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b5c4a629-b03f-46d8-9d24-a9f5ffa9c84f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:58:10.880584 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b5c4a629-b03f-46d8-9d24-a9f5ffa9c84f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:58:10.887105 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b5c4a629-b03f-46d8-9d24-a9f5ffa9c84f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:58:10.887547 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b5c4a629-b03f-46d8-9d24-a9f5ffa9c84f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:58:10.888402 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b5c4a629-b03f-46d8-9d24-a9f5ffa9c84f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:58:10.888833 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b5c4a629-b03f-46d8-9d24-a9f5ffa9c84f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:58:10.949456 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b5c4a629-b03f-46d8-9d24-a9f5ffa9c84f tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 38186 microversion: 2.1 time: 0.073710 Aug 25 05:58:10.950151 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1189/2413] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:58:10 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 38186 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:58:11.962728 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-88e4b65d-6400-4fa3-83d7-dec8051ae429 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:58:11.964449 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-88e4b65d-6400-4fa3-83d7-dec8051ae429 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:58:11.975998 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-88e4b65d-6400-4fa3-83d7-dec8051ae429 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:58:11.976788 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-88e4b65d-6400-4fa3-83d7-dec8051ae429 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:58:11.978203 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-88e4b65d-6400-4fa3-83d7-dec8051ae429 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:58:11.978990 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-88e4b65d-6400-4fa3-83d7-dec8051ae429 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:58:12.051401 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-88e4b65d-6400-4fa3-83d7-dec8051ae429 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action" status: 200 len: 38315 microversion: 2.1 time: 0.092751 Aug 25 05:58:12.052072 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1225/2414] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 05:58:11 2021] POST /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/action => generated 38315 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:58:12.062370 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-57212824-445b-4d1e-9787-3ee4bb46658e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:58:12.063071 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-57212824-445b-4d1e-9787-3ee4bb46658e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:58:12.070098 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-57212824-445b-4d1e-9787-3ee4bb46658e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:58:12.070552 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-57212824-445b-4d1e-9787-3ee4bb46658e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:58:12.071322 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-57212824-445b-4d1e-9787-3ee4bb46658e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:58:12.071756 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-57212824-445b-4d1e-9787-3ee4bb46658e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:58:12.095412 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-57212824-445b-4d1e-9787-3ee4bb46658e tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/ips" status: 200 len: 146 microversion: 2.1 time: 0.037076 Aug 25 05:58:12.097189 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1190/2415] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Aug 25 05:58:12 2021] GET /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:58:49.414047 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6c3b3baf-76e0-4bbb-b747-364044336750 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:58:49.414662 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6c3b3baf-76e0-4bbb-b747-364044336750 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:58:49.421446 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6c3b3baf-76e0-4bbb-b747-364044336750 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:58:49.421923 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6c3b3baf-76e0-4bbb-b747-364044336750 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:58:49.422682 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6c3b3baf-76e0-4bbb-b747-364044336750 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:58:49.423116 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6c3b3baf-76e0-4bbb-b747-364044336750 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:58:49.448367 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6c3b3baf-76e0-4bbb-b747-364044336750 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Going to try to terminate instance {{(pid=108885) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 25 05:58:49.707284 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6c3b3baf-76e0-4bbb-b747-364044336750 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "DELETE /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1" status: 204 len: 0 microversion: 2.20 time: 0.297074 Aug 25 05:58:49.707868 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1226/2416] 10.222.0.42 () {60 vars in 1280 bytes} [Wed Aug 25 05:58:49 2021] DELETE /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 05:58:49.716250 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-86c1852c-ea83-4f9d-94bc-4b46d2e1d759 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:58:49.716859 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-86c1852c-ea83-4f9d-94bc-4b46d2e1d759 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:58:49.723406 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-86c1852c-ea83-4f9d-94bc-4b46d2e1d759 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:58:49.723844 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-86c1852c-ea83-4f9d-94bc-4b46d2e1d759 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:58:49.724628 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-86c1852c-ea83-4f9d-94bc-4b46d2e1d759 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:58:49.725052 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-86c1852c-ea83-4f9d-94bc-4b46d2e1d759 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:58:49.860238 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-86c1852c-ea83-4f9d-94bc-4b46d2e1d759 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:58:49.868593 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-86c1852c-ea83-4f9d-94bc-4b46d2e1d759 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:58:49.870684 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-86c1852c-ea83-4f9d-94bc-4b46d2e1d759 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:58:49.873753 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-86c1852c-ea83-4f9d-94bc-4b46d2e1d759 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1" status: 200 len: 1721 microversion: 2.20 time: 0.159656 Aug 25 05:58:49.873753 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1191/2417] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:58:49 2021] GET /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:58:50.891499 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f7b1842c-e14d-427d-8b3d-c1601f34fd27 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:58:50.892149 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f7b1842c-e14d-427d-8b3d-c1601f34fd27 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:58:50.898704 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f7b1842c-e14d-427d-8b3d-c1601f34fd27 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:58:50.899147 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f7b1842c-e14d-427d-8b3d-c1601f34fd27 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:58:50.900012 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f7b1842c-e14d-427d-8b3d-c1601f34fd27 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:58:50.900506 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f7b1842c-e14d-427d-8b3d-c1601f34fd27 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:58:51.030643 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-f7b1842c-e14d-427d-8b3d-c1601f34fd27 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:58:51.040732 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-f7b1842c-e14d-427d-8b3d-c1601f34fd27 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:58:51.042512 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-f7b1842c-e14d-427d-8b3d-c1601f34fd27 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:58:51.043764 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f7b1842c-e14d-427d-8b3d-c1601f34fd27 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1" status: 200 len: 1721 microversion: 2.20 time: 0.156668 Aug 25 05:58:51.058448 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1227/2418] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:58:50 2021] GET /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:58:51.327485 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [req-15eba519-499a-42a4-a4f8-a5877fe7d7fb req-75154197-8796-42aa-865a-86d13c7eb685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33e42717-0f3f-48eb-b4ba-78bcdc85dca1", "name": "network-vif-deleted", "tag": "c9434a00-cf73-4905-8e81-82fdd59b276f"}]} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:58:51.329328 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:58:51.329328 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: warnings.warn(msg) Aug 25 05:58:51.336784 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-15eba519-499a-42a4-a4f8-a5877fe7d7fb req-75154197-8796-42aa-865a-86d13c7eb685 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:58:51.339214 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-15eba519-499a-42a4-a4f8-a5877fe7d7fb req-75154197-8796-42aa-865a-86d13c7eb685 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:58:51.351042 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.compute.server_external_events [req-15eba519-499a-42a4-a4f8-a5877fe7d7fb req-75154197-8796-42aa-865a-86d13c7eb685 service nova] Creating event network-vif-deleted:c9434a00-cf73-4905-8e81-82fdd59b276f for instance 33e42717-0f3f-48eb-b4ba-78bcdc85dca1 on hv-cinder-78662 Aug 25 05:58:51.360973 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [req-15eba519-499a-42a4-a4f8-a5877fe7d7fb req-75154197-8796-42aa-865a-86d13c7eb685 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036497 Aug 25 05:58:51.362302 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1192/2419] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 05:58:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:58:52.062667 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9f4e6c36-85ab-4bac-8466-dd2fd7dbeac0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:58:52.063272 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9f4e6c36-85ab-4bac-8466-dd2fd7dbeac0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:58:52.069734 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9f4e6c36-85ab-4bac-8466-dd2fd7dbeac0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:58:52.070464 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9f4e6c36-85ab-4bac-8466-dd2fd7dbeac0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:58:52.071312 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9f4e6c36-85ab-4bac-8466-dd2fd7dbeac0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:58:52.071907 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9f4e6c36-85ab-4bac-8466-dd2fd7dbeac0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:58:52.110869 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9f4e6c36-85ab-4bac-8466-dd2fd7dbeac0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:58:52.111299 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9f4e6c36-85ab-4bac-8466-dd2fd7dbeac0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:58:52.111741 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.objects.instance [None req-9f4e6c36-85ab-4bac-8466-dd2fd7dbeac0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lazy-loading 'fault' on Instance uuid 33e42717-0f3f-48eb-b4ba-78bcdc85dca1 {{(pid=108885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 05:58:52.154949 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-9f4e6c36-85ab-4bac-8466-dd2fd7dbeac0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:58:52.163394 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-9f4e6c36-85ab-4bac-8466-dd2fd7dbeac0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:58:52.164884 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-9f4e6c36-85ab-4bac-8466-dd2fd7dbeac0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '416c753d158d492aba49e3e71db337f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f18a68581ee4e5aa24440a7fd0389e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:58:52.166112 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9f4e6c36-85ab-4bac-8466-dd2fd7dbeac0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1" status: 200 len: 1371 microversion: 2.20 time: 0.107248 Aug 25 05:58:52.166701 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1228/2420] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:58:52 2021] GET /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1 => generated 1371 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:58:53.186149 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-251678c3-90b1-4667-a3c9-233be889a6b1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:58:53.186835 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-251678c3-90b1-4667-a3c9-233be889a6b1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 05:58:53.193247 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-251678c3-90b1-4667-a3c9-233be889a6b1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:58:53.193719 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-251678c3-90b1-4667-a3c9-233be889a6b1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:58:53.194469 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-251678c3-90b1-4667-a3c9-233be889a6b1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 05:58:53.194894 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-251678c3-90b1-4667-a3c9-233be889a6b1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 05:58:53.208046 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.wsgi [None req-251678c3-90b1-4667-a3c9-233be889a6b1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] HTTP exception thrown: Instance 33e42717-0f3f-48eb-b4ba-78bcdc85dca1 could not be found. Aug 25 05:58:53.208616 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-251678c3-90b1-4667-a3c9-233be889a6b1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Returning 404 to user: Instance 33e42717-0f3f-48eb-b4ba-78bcdc85dca1 could not be found. {{(pid=108884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 05:58:53.209425 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-251678c3-90b1-4667-a3c9-233be889a6b1 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1" status: 404 len: 111 microversion: 2.20 time: 0.028330 Aug 25 05:58:53.209976 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1193/2421] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 25 05:58:53 2021] GET /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 05:58:53.218517 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c234ddae-4b6b-43fc-9cfc-d749a89e6663 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '.version_select at 0x7f91066930d0>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:58:53.324253 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c234ddae-4b6b-43fc-9cfc-d749a89e6663 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-726273703" status: 204 len: 0 microversion: 2.20 time: 0.108870 Aug 25 05:58:53.325347 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1229/2422] 10.222.0.42 () {60 vars in 1259 bytes} [Wed Aug 25 05:58:53 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-726273703 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 05:59:15.894675 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 05:59:15.895205 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: Wed Aug 25 05:59:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 06:01:08.443490 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 06:01:08.444226 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: Wed Aug 25 06:01:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 06:01:20.219742 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 06:01:20.220328 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: Wed Aug 25 06:01:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 06:02:25.014882 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 06:02:25.015606 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: Wed Aug 25 06:02:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 06:02:35.913057 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 06:02:35.913781 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: Wed Aug 25 06:02:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 06:04:12.844167 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4945947b-868a-4594-a167-64b475d876a3] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 25 06:04:12.848344 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-216cde90-a59f-44d7-ae7a-c1381633a73a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:04:12.849640 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-216cde90-a59f-44d7-ae7a-c1381633a73a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:04:12.855416 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-216cde90-a59f-44d7-ae7a-c1381633a73a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:04:12.855863 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-216cde90-a59f-44d7-ae7a-c1381633a73a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:04:12.856618 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-216cde90-a59f-44d7-ae7a-c1381633a73a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:04:12.857049 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-216cde90-a59f-44d7-ae7a-c1381633a73a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:04:12.880173 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-216cde90-a59f-44d7-ae7a-c1381633a73a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Going to try to terminate instance {{(pid=108884) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 25 06:04:13.120112 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-216cde90-a59f-44d7-ae7a-c1381633a73a tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "DELETE /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a" status: 204 len: 0 microversion: 2.1 time: 0.277527 Aug 25 06:04:13.120642 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1194/2423] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 25 06:04:12 2021] DELETE /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 06:04:13.127917 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: ERROR oslo.messaging._drivers.impl_rabbit [-] [024c7946-b47b-4a06-aa5e-7d5b6a13301d] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 06:04:13.131720 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7b136ee4-ad21-4abb-a249-4932bb3c23d4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:04:13.132326 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-7b136ee4-ad21-4abb-a249-4932bb3c23d4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:04:13.138804 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7b136ee4-ad21-4abb-a249-4932bb3c23d4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:04:13.139247 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7b136ee4-ad21-4abb-a249-4932bb3c23d4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:04:13.140002 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7b136ee4-ad21-4abb-a249-4932bb3c23d4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:04:13.140510 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7b136ee4-ad21-4abb-a249-4932bb3c23d4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:04:13.380535 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-7b136ee4-ad21-4abb-a249-4932bb3c23d4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:04:13.387786 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-7b136ee4-ad21-4abb-a249-4932bb3c23d4 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a" status: 200 len: 1673 microversion: 2.1 time: 0.262985 Aug 25 06:04:13.388341 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1230/2424] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:04:13 2021] GET /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a => generated 1673 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:04:14.404436 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-bec41120-b69d-40ee-8e32-9874c9836857 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:04:14.405412 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-bec41120-b69d-40ee-8e32-9874c9836857 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:04:14.423092 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bec41120-b69d-40ee-8e32-9874c9836857 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:04:14.423538 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bec41120-b69d-40ee-8e32-9874c9836857 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:04:14.424975 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bec41120-b69d-40ee-8e32-9874c9836857 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:04:14.425401 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bec41120-b69d-40ee-8e32-9874c9836857 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:04:14.431318 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [-] [4945947b-868a-4594-a167-64b475d876a3] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 44356. Aug 25 06:04:14.540763 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-bec41120-b69d-40ee-8e32-9874c9836857 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:04:14.550411 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-bec41120-b69d-40ee-8e32-9874c9836857 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a" status: 200 len: 1606 microversion: 2.1 time: 0.149723 Aug 25 06:04:14.551181 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1195/2425] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:04:14 2021] GET /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a => generated 1606 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:04:14.850663 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO oslo.messaging._drivers.impl_rabbit [-] [024c7946-b47b-4a06-aa5e-7d5b6a13301d] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 44366. Aug 25 06:04:14.902274 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [req-90c51aeb-4a78-4fa9-92ff-6b2c1490ba32 req-45c47385-5ff1-4a32-9963-004d9732dd77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af3477ab-3996-4299-9889-f42b71879b8a", "name": "network-vif-deleted", "tag": "e282640b-6cde-4c16-a0c5-bd69056f7593"}]} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:04:14.903873 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 06:04:14.903873 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: warnings.warn(msg) Aug 25 06:04:14.911986 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-90c51aeb-4a78-4fa9-92ff-6b2c1490ba32 req-45c47385-5ff1-4a32-9963-004d9732dd77 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:04:14.912508 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-90c51aeb-4a78-4fa9-92ff-6b2c1490ba32 req-45c47385-5ff1-4a32-9963-004d9732dd77 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:04:14.924491 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.compute.server_external_events [req-90c51aeb-4a78-4fa9-92ff-6b2c1490ba32 req-45c47385-5ff1-4a32-9963-004d9732dd77 service nova] Creating event network-vif-deleted:e282640b-6cde-4c16-a0c5-bd69056f7593 for instance af3477ab-3996-4299-9889-f42b71879b8a on hv-cinder-78662 Aug 25 06:04:14.928434 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: ERROR oslo.messaging._drivers.impl_rabbit [req-90c51aeb-4a78-4fa9-92ff-6b2c1490ba32 req-45c47385-5ff1-4a32-9963-004d9732dd77 service nova] [da404304-81c2-48ef-8271-5a002b2af397] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 06:04:15.567082 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3b2a8bad-b82f-43c3-936c-a610ae74bc95 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:04:15.567805 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3b2a8bad-b82f-43c3-936c-a610ae74bc95 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:04:15.574059 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3b2a8bad-b82f-43c3-936c-a610ae74bc95 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:04:15.574425 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3b2a8bad-b82f-43c3-936c-a610ae74bc95 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:04:15.575220 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3b2a8bad-b82f-43c3-936c-a610ae74bc95 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:04:15.575648 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3b2a8bad-b82f-43c3-936c-a610ae74bc95 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:04:15.607322 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3b2a8bad-b82f-43c3-936c-a610ae74bc95 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:04:15.607765 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3b2a8bad-b82f-43c3-936c-a610ae74bc95 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:04:15.608207 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.objects.instance [None req-3b2a8bad-b82f-43c3-936c-a610ae74bc95 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lazy-loading 'fault' on Instance uuid af3477ab-3996-4299-9889-f42b71879b8a {{(pid=108884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 06:04:15.652617 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-3b2a8bad-b82f-43c3-936c-a610ae74bc95 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef41c62efed49cf9dc642b659107e84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7fcf565ddf46ac965eb3c7e878d4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:04:15.661644 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3b2a8bad-b82f-43c3-936c-a610ae74bc95 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a" status: 200 len: 1327 microversion: 2.1 time: 0.098227 Aug 25 06:04:15.662226 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1196/2426] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:04:15 2021] GET /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a => generated 1327 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 06:04:15.946826 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO oslo.messaging._drivers.impl_rabbit [req-90c51aeb-4a78-4fa9-92ff-6b2c1490ba32 req-45c47385-5ff1-4a32-9963-004d9732dd77 service nova] [da404304-81c2-48ef-8271-5a002b2af397] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 44376. Aug 25 06:04:15.950685 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [req-90c51aeb-4a78-4fa9-92ff-6b2c1490ba32 req-45c47385-5ff1-4a32-9963-004d9732dd77 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.122351 Aug 25 06:04:15.951162 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1231/2427] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 06:04:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:04:16.678732 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c7a314ef-14eb-4859-a2db-34911687f86b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:04:16.679342 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c7a314ef-14eb-4859-a2db-34911687f86b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:04:16.685217 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c7a314ef-14eb-4859-a2db-34911687f86b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:04:16.685635 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c7a314ef-14eb-4859-a2db-34911687f86b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:04:16.686391 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c7a314ef-14eb-4859-a2db-34911687f86b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:04:16.686819 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c7a314ef-14eb-4859-a2db-34911687f86b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:04:16.699975 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.wsgi [None req-c7a314ef-14eb-4859-a2db-34911687f86b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] HTTP exception thrown: Instance af3477ab-3996-4299-9889-f42b71879b8a could not be found. Aug 25 06:04:16.700560 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c7a314ef-14eb-4859-a2db-34911687f86b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Returning 404 to user: Instance af3477ab-3996-4299-9889-f42b71879b8a could not be found. {{(pid=108884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 06:04:16.701373 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c7a314ef-14eb-4859-a2db-34911687f86b tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a" status: 404 len: 111 microversion: 2.1 time: 0.026451 Aug 25 06:04:16.701916 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1197/2428] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:04:16 2021] GET /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 06:04:16.711014 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c7e88a2e-47cd-4179-8b70-7aa60a0a4045 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '.version_select at 0x7f91066273a0>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:04:16.714193 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c7e88a2e-47cd-4179-8b70-7aa60a0a4045 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [d1221057-99ff-4cf2-b4f3-40991337c8a9] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 06:04:17.730855 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO oslo.messaging._drivers.impl_rabbit [None req-c7e88a2e-47cd-4179-8b70-7aa60a0a4045 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [d1221057-99ff-4cf2-b4f3-40991337c8a9] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 44388. Aug 25 06:04:17.841441 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c7e88a2e-47cd-4179-8b70-7aa60a0a4045 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2029268771" status: 202 len: 0 microversion: 2.1 time: 1.134328 Aug 25 06:04:17.842081 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1232/2429] 10.222.0.42 () {58 vars in 1221 bytes} [Wed Aug 25 06:04:16 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2029268771 => generated 0 bytes in 1136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 06:04:28.461674 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 06:04:28.462381 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: Wed Aug 25 06:04:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 06:04:54.369771 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a5b40cd8-f765-4766-b7e0-22e614de3fd0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:04:54.370359 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a5b40cd8-f765-4766-b7e0-22e614de3fd0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:04:54.376206 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a5b40cd8-f765-4766-b7e0-22e614de3fd0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:04:54.376651 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a5b40cd8-f765-4766-b7e0-22e614de3fd0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:04:54.377404 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a5b40cd8-f765-4766-b7e0-22e614de3fd0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:04:54.377871 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a5b40cd8-f765-4766-b7e0-22e614de3fd0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:04:54.391661 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.wsgi [None req-a5b40cd8-f765-4766-b7e0-22e614de3fd0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] HTTP exception thrown: Instance 33e42717-0f3f-48eb-b4ba-78bcdc85dca1 could not be found. Aug 25 06:04:54.392243 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a5b40cd8-f765-4766-b7e0-22e614de3fd0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Returning 404 to user: Instance 33e42717-0f3f-48eb-b4ba-78bcdc85dca1 could not be found. {{(pid=108884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 06:04:54.393094 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a5b40cd8-f765-4766-b7e0-22e614de3fd0 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "DELETE /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1" status: 404 len: 111 microversion: 2.1 time: 0.027256 Aug 25 06:04:54.393698 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1198/2430] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 25 06:04:54 2021] DELETE /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 06:04:54.402267 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7eb375f4-e888-41e5-99f4-8d3564db9953 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:04:54.403449 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-7eb375f4-e888-41e5-99f4-8d3564db9953 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 33e42717-0f3f-48eb-b4ba-78bcdc85dca1] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:04:54.409655 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7eb375f4-e888-41e5-99f4-8d3564db9953 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:04:54.410092 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7eb375f4-e888-41e5-99f4-8d3564db9953 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:04:54.411064 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7eb375f4-e888-41e5-99f4-8d3564db9953 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:04:54.411500 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7eb375f4-e888-41e5-99f4-8d3564db9953 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:04:54.424045 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.wsgi [None req-7eb375f4-e888-41e5-99f4-8d3564db9953 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] HTTP exception thrown: Instance 33e42717-0f3f-48eb-b4ba-78bcdc85dca1 could not be found. Aug 25 06:04:54.424628 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7eb375f4-e888-41e5-99f4-8d3564db9953 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Returning 404 to user: Instance 33e42717-0f3f-48eb-b4ba-78bcdc85dca1 could not be found. {{(pid=108885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 06:04:54.425436 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-7eb375f4-e888-41e5-99f4-8d3564db9953 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1" status: 404 len: 111 microversion: 2.1 time: 0.027366 Aug 25 06:04:54.425982 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1233/2431] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:04:54 2021] GET /compute/v2.1/servers/33e42717-0f3f-48eb-b4ba-78bcdc85dca1 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 06:05:45.032815 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 06:05:45.033444 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: Wed Aug 25 06:05:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 06:05:55.930407 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 06:05:55.931605 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: Wed Aug 25 06:05:55 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 06:06:20.238542 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 06:06:20.238542 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: Wed Aug 25 06:06:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 06:07:48.479598 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 06:07:48.480199 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: Wed Aug 25 06:07:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 06:09:05.051289 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 06:09:05.051854 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: Wed Aug 25 06:09:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 06:09:15.948545 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 06:09:15.949236 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: Wed Aug 25 06:09:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 06:09:23.269625 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 06:09:23.270242 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: Wed Aug 25 06:09:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 06:09:29.789010 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 06:09:29.789010 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: Wed Aug 25 06:09:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 06:09:40.257430 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 06:09:40.258078 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: Wed Aug 25 06:09:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 06:10:18.667688 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4945947b-868a-4594-a167-64b475d876a3] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 25 06:10:18.671459 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-15e87180-f6d3-473d-b8c9-59b58e43c690 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:10:18.671947 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-15e87180-f6d3-473d-b8c9-59b58e43c690 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:10:18.677754 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-15e87180-f6d3-473d-b8c9-59b58e43c690 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:10:18.678202 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-15e87180-f6d3-473d-b8c9-59b58e43c690 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:10:18.678958 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-15e87180-f6d3-473d-b8c9-59b58e43c690 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:10:18.679389 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-15e87180-f6d3-473d-b8c9-59b58e43c690 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:10:18.692242 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.wsgi [None req-15e87180-f6d3-473d-b8c9-59b58e43c690 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] HTTP exception thrown: Instance af3477ab-3996-4299-9889-f42b71879b8a could not be found. Aug 25 06:10:18.692826 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-15e87180-f6d3-473d-b8c9-59b58e43c690 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Returning 404 to user: Instance af3477ab-3996-4299-9889-f42b71879b8a could not be found. {{(pid=108884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 06:10:18.693753 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-15e87180-f6d3-473d-b8c9-59b58e43c690 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "DELETE /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a" status: 404 len: 111 microversion: 2.1 time: 0.030508 Aug 25 06:10:18.694276 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1199/2432] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 25 06:10:18 2021] DELETE /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 06:10:18.700129 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: ERROR oslo.messaging._drivers.impl_rabbit [-] [024c7946-b47b-4a06-aa5e-7d5b6a13301d] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 25 06:10:18.706905 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-8bf5dcdd-89d4-4c05-901a-aaa56047ebad tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:10:18.707512 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-8bf5dcdd-89d4-4c05-901a-aaa56047ebad tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: af3477ab-3996-4299-9889-f42b71879b8a] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:10:18.714207 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8bf5dcdd-89d4-4c05-901a-aaa56047ebad tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:10:18.714654 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8bf5dcdd-89d4-4c05-901a-aaa56047ebad tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:10:18.715418 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8bf5dcdd-89d4-4c05-901a-aaa56047ebad tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:10:18.715857 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8bf5dcdd-89d4-4c05-901a-aaa56047ebad tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:10:18.728346 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.wsgi [None req-8bf5dcdd-89d4-4c05-901a-aaa56047ebad tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] HTTP exception thrown: Instance af3477ab-3996-4299-9889-f42b71879b8a could not be found. Aug 25 06:10:18.730111 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-8bf5dcdd-89d4-4c05-901a-aaa56047ebad tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Returning 404 to user: Instance af3477ab-3996-4299-9889-f42b71879b8a could not be found. {{(pid=108885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 06:10:18.730935 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-8bf5dcdd-89d4-4c05-901a-aaa56047ebad tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a" status: 404 len: 111 microversion: 2.1 time: 0.032616 Aug 25 06:10:18.731492 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1234/2433] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:10:18 2021] GET /compute/v2.1/servers/af3477ab-3996-4299-9889-f42b71879b8a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 06:10:19.985559 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6718a1b9-ba8e-4213-9f80-15a0b5ef5657 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:10:19.986152 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6718a1b9-ba8e-4213-9f80-15a0b5ef5657 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:10:20.006718 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [-] [4945947b-868a-4594-a167-64b475d876a3] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 46304. Aug 25 06:10:20.008905 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6718a1b9-ba8e-4213-9f80-15a0b5ef5657 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:10:20.009343 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6718a1b9-ba8e-4213-9f80-15a0b5ef5657 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:10:20.010235 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6718a1b9-ba8e-4213-9f80-15a0b5ef5657 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:10:20.010657 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6718a1b9-ba8e-4213-9f80-15a0b5ef5657 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:10:20.024219 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.wsgi [None req-6718a1b9-ba8e-4213-9f80-15a0b5ef5657 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] HTTP exception thrown: Instance 4c438716-186a-4b29-b29e-e9c6a71a5a27 could not be found. Aug 25 06:10:20.024801 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6718a1b9-ba8e-4213-9f80-15a0b5ef5657 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Returning 404 to user: Instance 4c438716-186a-4b29-b29e-e9c6a71a5a27 could not be found. {{(pid=108884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 06:10:20.026808 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6718a1b9-ba8e-4213-9f80-15a0b5ef5657 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 404 len: 111 microversion: 2.1 time: 0.043798 Aug 25 06:10:20.027359 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1200/2434] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 25 06:10:19 2021] DELETE /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 06:10:20.036906 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1c264664-5d49-41ce-9ccc-2330ff4c3762 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:10:20.037508 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1c264664-5d49-41ce-9ccc-2330ff4c3762 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] [instance: 4c438716-186a-4b29-b29e-e9c6a71a5a27] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:10:20.056064 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1c264664-5d49-41ce-9ccc-2330ff4c3762 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:10:20.056507 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1c264664-5d49-41ce-9ccc-2330ff4c3762 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:10:20.057957 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1c264664-5d49-41ce-9ccc-2330ff4c3762 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:10:20.058383 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1c264664-5d49-41ce-9ccc-2330ff4c3762 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:10:20.065723 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO oslo.messaging._drivers.impl_rabbit [-] [024c7946-b47b-4a06-aa5e-7d5b6a13301d] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 46308. Aug 25 06:10:20.075350 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.wsgi [None req-1c264664-5d49-41ce-9ccc-2330ff4c3762 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] HTTP exception thrown: Instance 4c438716-186a-4b29-b29e-e9c6a71a5a27 could not be found. Aug 25 06:10:20.075943 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1c264664-5d49-41ce-9ccc-2330ff4c3762 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] Returning 404 to user: Instance 4c438716-186a-4b29-b29e-e9c6a71a5a27 could not be found. {{(pid=108885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 06:10:20.076784 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1c264664-5d49-41ce-9ccc-2330ff4c3762 tempest-AttachVolumeTestJSON-33472876 tempest-AttachVolumeTestJSON-33472876-project] 10.222.0.42 "GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27" status: 404 len: 111 microversion: 2.1 time: 0.043863 Aug 25 06:10:20.077317 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1235/2435] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:10:20 2021] GET /compute/v2.1/servers/4c438716-186a-4b29-b29e-e9c6a71a5a27 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 06:10:54.261491 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-f58e901e-300f-4039-9ec5-b6d0c6ba121d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:10:54.262021 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-f58e901e-300f-4039-9ec5-b6d0c6ba121d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:10:54.268101 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f58e901e-300f-4039-9ec5-b6d0c6ba121d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:10:54.268553 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f58e901e-300f-4039-9ec5-b6d0c6ba121d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:10:54.269308 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f58e901e-300f-4039-9ec5-b6d0c6ba121d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:10:54.270409 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f58e901e-300f-4039-9ec5-b6d0c6ba121d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:10:54.286423 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.wsgi [None req-f58e901e-300f-4039-9ec5-b6d0c6ba121d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] HTTP exception thrown: Instance 4cb635d4-76ba-4143-8f4d-a64c720966da could not be found. Aug 25 06:10:54.287015 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-f58e901e-300f-4039-9ec5-b6d0c6ba121d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Returning 404 to user: Instance 4cb635d4-76ba-4143-8f4d-a64c720966da could not be found. {{(pid=108884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 06:10:54.287843 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-f58e901e-300f-4039-9ec5-b6d0c6ba121d tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 404 len: 111 microversion: 2.1 time: 0.030133 Aug 25 06:10:54.288372 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1201/2436] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 25 06:10:54 2021] DELETE /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 06:10:54.297604 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-91a2d84b-d9e6-4d00-b634-ca63e4da6653 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:10:54.298353 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-91a2d84b-d9e6-4d00-b634-ca63e4da6653 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] [instance: 4cb635d4-76ba-4143-8f4d-a64c720966da] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:10:54.303989 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-91a2d84b-d9e6-4d00-b634-ca63e4da6653 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:10:54.304429 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-91a2d84b-d9e6-4d00-b634-ca63e4da6653 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:10:54.308442 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-91a2d84b-d9e6-4d00-b634-ca63e4da6653 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:10:54.308442 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-91a2d84b-d9e6-4d00-b634-ca63e4da6653 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:10:54.318865 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.wsgi [None req-91a2d84b-d9e6-4d00-b634-ca63e4da6653 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] HTTP exception thrown: Instance 4cb635d4-76ba-4143-8f4d-a64c720966da could not be found. Aug 25 06:10:54.319391 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-91a2d84b-d9e6-4d00-b634-ca63e4da6653 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] Returning 404 to user: Instance 4cb635d4-76ba-4143-8f4d-a64c720966da could not be found. {{(pid=108885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 06:10:54.320247 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-91a2d84b-d9e6-4d00-b634-ca63e4da6653 tempest-AttachVolumeShelveTestJSON-802514300 tempest-AttachVolumeShelveTestJSON-802514300-project] 10.222.0.42 "GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da" status: 404 len: 111 microversion: 2.1 time: 0.027748 Aug 25 06:10:54.320774 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1236/2437] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:10:54 2021] GET /compute/v2.1/servers/4cb635d4-76ba-4143-8f4d-a64c720966da => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 06:11:01.888134 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-9b5d8931-b539-4a05-a82e-7b392877db0a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-284394379", "imageRef": "05da2439-78f2-405c-b60a-89671b21a373", "flavorRef": "452", "networks": [{"uuid": "d0d72ee8-5c74-49ab-aa11-cdff3f2fe3a5"}]}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:11:02.071084 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.network.neutron [None req-9b5d8931-b539-4a05-a82e-7b392877db0a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] validate_networks() for [('d0d72ee8-5c74-49ab-aa11-cdff3f2fe3a5', None, None, None, None, None)] {{(pid=108884) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 25 06:11:02.485231 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-9b5d8931-b539-4a05-a82e-7b392877db0a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Flavor limits 0:0:0 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 06:11:02.485755 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-9b5d8931-b539-4a05-a82e-7b392877db0a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Image limits 0:0:0 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 06:11:02.486234 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-9b5d8931-b539-4a05-a82e-7b392877db0a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Flavor pref 0:0:0 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 06:11:02.488698 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-9b5d8931-b539-4a05-a82e-7b392877db0a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Image pref 0:0:0 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 06:11:02.488698 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-9b5d8931-b539-4a05-a82e-7b392877db0a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 06:11:02.496019 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9b5d8931-b539-4a05-a82e-7b392877db0a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:02.496467 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9b5d8931-b539-4a05-a82e-7b392877db0a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:02.497259 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9b5d8931-b539-4a05-a82e-7b392877db0a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:02.498277 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9b5d8931-b539-4a05-a82e-7b392877db0a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:02.519450 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.quota [None req-9b5d8931-b539-4a05-a82e-7b392877db0a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Getting quotas for project 71c35350b81f4cc4a4866e75cf5e2a01. Resources: {'ram', 'cores', 'instances'} {{(pid=108884) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 06:11:02.520416 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.quota [None req-9b5d8931-b539-4a05-a82e-7b392877db0a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Getting quotas for user 5458184857ec4b7aace9b054355c5f9d and project 71c35350b81f4cc4a4866e75cf5e2a01. Resources: {'ram', 'cores', 'instances'} {{(pid=108884) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 06:11:02.531751 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-9b5d8931-b539-4a05-a82e-7b392877db0a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Going to run 1 instances... {{(pid=108884) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 25 06:11:02.534163 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-9b5d8931-b539-4a05-a82e-7b392877db0a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4fee06df-2121-4b1f-af52-6b9ecd1a6eb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05da2439-78f2-405c-b60a-89671b21a373',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 25 06:11:02.632947 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-9b5d8931-b539-4a05-a82e-7b392877db0a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.889760 Aug 25 06:11:02.634487 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1202/2438] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 25 06:11:01 2021] POST /compute/v2.1/servers => generated 380 bytes in 891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 06:11:02.646925 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-47a6f6a0-3736-4239-a438-23ebb288ada9 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:02.648873 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-47a6f6a0-3736-4239-a438-23ebb288ada9 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4fee06df-2121-4b1f-af52-6b9ecd1a6eb9] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:02.767772 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-47a6f6a0-3736-4239-a438-23ebb288ada9 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:11:02.774379 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-47a6f6a0-3736-4239-a438-23ebb288ada9 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9" status: 200 len: 1217 microversion: 2.1 time: 0.131350 Aug 25 06:11:02.774942 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1237/2439] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:11:02 2021] GET /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9 => generated 1217 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:11:03.792540 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-f15da2e9-6dc1-4531-b9f8-68b715389275 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:03.793386 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-f15da2e9-6dc1-4531-b9f8-68b715389275 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4fee06df-2121-4b1f-af52-6b9ecd1a6eb9] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:03.800738 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f15da2e9-6dc1-4531-b9f8-68b715389275 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:03.801394 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f15da2e9-6dc1-4531-b9f8-68b715389275 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:03.802564 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f15da2e9-6dc1-4531-b9f8-68b715389275 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:03.803159 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f15da2e9-6dc1-4531-b9f8-68b715389275 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:03.864320 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-f15da2e9-6dc1-4531-b9f8-68b715389275 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:11:03.871512 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-f15da2e9-6dc1-4531-b9f8-68b715389275 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9" status: 200 len: 1221 microversion: 2.1 time: 0.083733 Aug 25 06:11:03.872064 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1203/2440] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:11:03 2021] GET /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9 => generated 1221 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:11:04.889128 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-aa1518d0-73c3-404f-bf9f-a7f4a2c8c5d1 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:04.889691 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-aa1518d0-73c3-404f-bf9f-a7f4a2c8c5d1 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4fee06df-2121-4b1f-af52-6b9ecd1a6eb9] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:04.895731 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-aa1518d0-73c3-404f-bf9f-a7f4a2c8c5d1 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:04.896169 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-aa1518d0-73c3-404f-bf9f-a7f4a2c8c5d1 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:04.896957 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-aa1518d0-73c3-404f-bf9f-a7f4a2c8c5d1 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:04.897386 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-aa1518d0-73c3-404f-bf9f-a7f4a2c8c5d1 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:04.957292 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-aa1518d0-73c3-404f-bf9f-a7f4a2c8c5d1 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:11:04.964798 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-aa1518d0-73c3-404f-bf9f-a7f4a2c8c5d1 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9" status: 200 len: 1221 microversion: 2.1 time: 0.080142 Aug 25 06:11:04.965370 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1238/2441] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:11:04 2021] GET /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9 => generated 1221 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:11:05.981556 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ede9be9f-db17-4568-95ff-fdae932d4f9f tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:05.982192 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ede9be9f-db17-4568-95ff-fdae932d4f9f tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4fee06df-2121-4b1f-af52-6b9ecd1a6eb9] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:05.988132 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ede9be9f-db17-4568-95ff-fdae932d4f9f tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:05.988583 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ede9be9f-db17-4568-95ff-fdae932d4f9f tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:05.989338 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ede9be9f-db17-4568-95ff-fdae932d4f9f tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:05.989810 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ede9be9f-db17-4568-95ff-fdae932d4f9f tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:06.048116 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ede9be9f-db17-4568-95ff-fdae932d4f9f tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:11:06.055187 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ede9be9f-db17-4568-95ff-fdae932d4f9f tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9" status: 200 len: 1221 microversion: 2.1 time: 0.077361 Aug 25 06:11:06.055737 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1204/2442] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:11:05 2021] GET /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9 => generated 1221 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:11:07.070610 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-52fcfb2b-0023-40ef-8f86-0e4b7d1c31a6 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:07.071274 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-52fcfb2b-0023-40ef-8f86-0e4b7d1c31a6 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4fee06df-2121-4b1f-af52-6b9ecd1a6eb9] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:07.077144 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-52fcfb2b-0023-40ef-8f86-0e4b7d1c31a6 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:07.077639 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-52fcfb2b-0023-40ef-8f86-0e4b7d1c31a6 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:07.078393 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-52fcfb2b-0023-40ef-8f86-0e4b7d1c31a6 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:07.078817 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-52fcfb2b-0023-40ef-8f86-0e4b7d1c31a6 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:07.137343 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-52fcfb2b-0023-40ef-8f86-0e4b7d1c31a6 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:11:07.145464 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-52fcfb2b-0023-40ef-8f86-0e4b7d1c31a6 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9" status: 200 len: 1269 microversion: 2.1 time: 0.078480 Aug 25 06:11:07.146056 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1239/2443] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:11:07 2021] GET /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9 => generated 1269 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:11:08.163428 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-109794e6-801e-4426-a201-2bc0e88423fa tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:08.164691 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-109794e6-801e-4426-a201-2bc0e88423fa tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4fee06df-2121-4b1f-af52-6b9ecd1a6eb9] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:08.171039 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-109794e6-801e-4426-a201-2bc0e88423fa tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:08.171482 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-109794e6-801e-4426-a201-2bc0e88423fa tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:08.172247 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-109794e6-801e-4426-a201-2bc0e88423fa tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:08.172679 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-109794e6-801e-4426-a201-2bc0e88423fa tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:08.232473 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-109794e6-801e-4426-a201-2bc0e88423fa tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:11:08.239937 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-109794e6-801e-4426-a201-2bc0e88423fa tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9" status: 200 len: 1275 microversion: 2.1 time: 0.080208 Aug 25 06:11:08.241016 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1205/2444] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:11:08 2021] GET /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9 => generated 1275 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:11:08.500366 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 06:11:08.500845 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: Wed Aug 25 06:11:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 06:11:09.257692 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-27ef2a4c-1401-4d11-873b-2f1ace53af8f tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:09.258285 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-27ef2a4c-1401-4d11-873b-2f1ace53af8f tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4fee06df-2121-4b1f-af52-6b9ecd1a6eb9] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:09.264240 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-27ef2a4c-1401-4d11-873b-2f1ace53af8f tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:09.264697 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-27ef2a4c-1401-4d11-873b-2f1ace53af8f tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:09.265777 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-27ef2a4c-1401-4d11-873b-2f1ace53af8f tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:09.266210 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-27ef2a4c-1401-4d11-873b-2f1ace53af8f tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:09.274713 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [req-85082218-03c4-4692-807d-604c8aa2f537 req-554f8366-a964-4929-b7fc-49456657d524 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fee06df-2121-4b1f-af52-6b9ecd1a6eb9", "tag": "050b165f-ad55-4b03-b336-51856973c15c"}]} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:11:09.276264 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 06:11:09.276264 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: warnings.warn(msg) Aug 25 06:11:09.283899 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-85082218-03c4-4692-807d-604c8aa2f537 req-554f8366-a964-4929-b7fc-49456657d524 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:09.284348 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-85082218-03c4-4692-807d-604c8aa2f537 req-554f8366-a964-4929-b7fc-49456657d524 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:09.298547 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.compute.server_external_events [req-85082218-03c4-4692-807d-604c8aa2f537 req-554f8366-a964-4929-b7fc-49456657d524 service nova] Creating event network-changed:050b165f-ad55-4b03-b336-51856973c15c for instance 4fee06df-2121-4b1f-af52-6b9ecd1a6eb9 on hv-cinder-78662 Aug 25 06:11:09.304796 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [req-85082218-03c4-4692-807d-604c8aa2f537 req-554f8366-a964-4929-b7fc-49456657d524 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093996 Aug 25 06:11:09.305740 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1240/2445] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 06:11:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:11:09.403001 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-27ef2a4c-1401-4d11-873b-2f1ace53af8f tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:11:09.411447 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-27ef2a4c-1401-4d11-873b-2f1ace53af8f tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9" status: 200 len: 1317 microversion: 2.1 time: 0.157550 Aug 25 06:11:09.412334 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1206/2446] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:11:09 2021] GET /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:11:10.429239 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-4c47c1c2-4e5b-4993-8bb7-57b789ff7d2e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:10.429975 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-4c47c1c2-4e5b-4993-8bb7-57b789ff7d2e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4fee06df-2121-4b1f-af52-6b9ecd1a6eb9] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:10.436458 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4c47c1c2-4e5b-4993-8bb7-57b789ff7d2e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:10.436906 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4c47c1c2-4e5b-4993-8bb7-57b789ff7d2e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:10.437754 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4c47c1c2-4e5b-4993-8bb7-57b789ff7d2e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:10.438190 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4c47c1c2-4e5b-4993-8bb7-57b789ff7d2e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:10.562314 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-4c47c1c2-4e5b-4993-8bb7-57b789ff7d2e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:11:10.569950 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-4c47c1c2-4e5b-4993-8bb7-57b789ff7d2e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9" status: 200 len: 1317 microversion: 2.1 time: 0.144678 Aug 25 06:11:10.570488 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1241/2447] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:11:10 2021] GET /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9 => generated 1317 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:11:11.587348 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-dbc0e898-86c7-493a-a410-e1e05e55ea06 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:11.587957 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-dbc0e898-86c7-493a-a410-e1e05e55ea06 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4fee06df-2121-4b1f-af52-6b9ecd1a6eb9] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:11.595206 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dbc0e898-86c7-493a-a410-e1e05e55ea06 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:11.595648 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dbc0e898-86c7-493a-a410-e1e05e55ea06 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:11.596411 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dbc0e898-86c7-493a-a410-e1e05e55ea06 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:11.596823 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dbc0e898-86c7-493a-a410-e1e05e55ea06 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:11.722686 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-dbc0e898-86c7-493a-a410-e1e05e55ea06 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:11:11.729836 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-dbc0e898-86c7-493a-a410-e1e05e55ea06 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9" status: 200 len: 1317 microversion: 2.1 time: 0.146204 Aug 25 06:11:11.730393 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1207/2448] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:11:11 2021] GET /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9 => generated 1317 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:11:12.745730 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b7caffb9-1a71-42f3-bcaf-35894c388181 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:12.746255 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b7caffb9-1a71-42f3-bcaf-35894c388181 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4fee06df-2121-4b1f-af52-6b9ecd1a6eb9] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:12.753105 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b7caffb9-1a71-42f3-bcaf-35894c388181 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:12.753574 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b7caffb9-1a71-42f3-bcaf-35894c388181 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:12.754331 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b7caffb9-1a71-42f3-bcaf-35894c388181 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:12.754759 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b7caffb9-1a71-42f3-bcaf-35894c388181 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:12.880234 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-b7caffb9-1a71-42f3-bcaf-35894c388181 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:11:12.887497 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b7caffb9-1a71-42f3-bcaf-35894c388181 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9" status: 200 len: 1317 microversion: 2.1 time: 0.145602 Aug 25 06:11:12.888047 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1242/2449] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:11:12 2021] GET /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9 => generated 1317 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:11:13.904368 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b959f2ad-02c3-4b01-9896-6936cc3a5444 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:13.904962 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b959f2ad-02c3-4b01-9896-6936cc3a5444 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4fee06df-2121-4b1f-af52-6b9ecd1a6eb9] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:13.911457 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b959f2ad-02c3-4b01-9896-6936cc3a5444 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:13.911993 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b959f2ad-02c3-4b01-9896-6936cc3a5444 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:13.912750 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b959f2ad-02c3-4b01-9896-6936cc3a5444 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:13.913183 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b959f2ad-02c3-4b01-9896-6936cc3a5444 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:14.038416 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-b959f2ad-02c3-4b01-9896-6936cc3a5444 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:11:14.045768 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b959f2ad-02c3-4b01-9896-6936cc3a5444 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9" status: 200 len: 1317 microversion: 2.1 time: 0.145186 Aug 25 06:11:14.046338 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1208/2450] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:11:13 2021] GET /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9 => generated 1317 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:11:14.561377 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [req-910aaa48-386e-4e2d-a055-d84583f6011f req-6491b326-4c91-4f29-891c-4e4b03ff2c3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fee06df-2121-4b1f-af52-6b9ecd1a6eb9", "name": "network-vif-plugged", "status": "completed", "tag": "050b165f-ad55-4b03-b336-51856973c15c"}]} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:11:14.563535 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 06:11:14.563535 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: warnings.warn(msg) Aug 25 06:11:14.570369 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-910aaa48-386e-4e2d-a055-d84583f6011f req-6491b326-4c91-4f29-891c-4e4b03ff2c3c service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:14.570815 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-910aaa48-386e-4e2d-a055-d84583f6011f req-6491b326-4c91-4f29-891c-4e4b03ff2c3c service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:14.582281 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.compute.server_external_events [req-910aaa48-386e-4e2d-a055-d84583f6011f req-6491b326-4c91-4f29-891c-4e4b03ff2c3c service nova] Creating event network-vif-plugged:050b165f-ad55-4b03-b336-51856973c15c for instance 4fee06df-2121-4b1f-af52-6b9ecd1a6eb9 on hv-cinder-78662 Aug 25 06:11:14.587842 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [req-910aaa48-386e-4e2d-a055-d84583f6011f req-6491b326-4c91-4f29-891c-4e4b03ff2c3c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089447 Aug 25 06:11:14.588735 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1243/2451] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 06:11:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:11:15.063021 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-29aac8ad-3b90-4cc0-a95f-45a974fadc64 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:15.063625 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-29aac8ad-3b90-4cc0-a95f-45a974fadc64 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4fee06df-2121-4b1f-af52-6b9ecd1a6eb9] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:15.069761 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-29aac8ad-3b90-4cc0-a95f-45a974fadc64 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:15.070213 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-29aac8ad-3b90-4cc0-a95f-45a974fadc64 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:15.070981 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-29aac8ad-3b90-4cc0-a95f-45a974fadc64 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:15.071419 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-29aac8ad-3b90-4cc0-a95f-45a974fadc64 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:15.205586 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-29aac8ad-3b90-4cc0-a95f-45a974fadc64 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:11:15.212592 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-29aac8ad-3b90-4cc0-a95f-45a974fadc64 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9" status: 200 len: 1317 microversion: 2.1 time: 0.153311 Aug 25 06:11:15.213137 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1209/2452] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:11:15 2021] GET /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:11:16.231737 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-bfc0028d-1fb5-4ad7-87db-de226e1aa7c9 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:16.232467 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-bfc0028d-1fb5-4ad7-87db-de226e1aa7c9 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4fee06df-2121-4b1f-af52-6b9ecd1a6eb9] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:16.239990 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bfc0028d-1fb5-4ad7-87db-de226e1aa7c9 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:16.240437 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bfc0028d-1fb5-4ad7-87db-de226e1aa7c9 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:16.241215 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bfc0028d-1fb5-4ad7-87db-de226e1aa7c9 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:16.241671 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bfc0028d-1fb5-4ad7-87db-de226e1aa7c9 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:16.371293 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-bfc0028d-1fb5-4ad7-87db-de226e1aa7c9 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:11:16.379829 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-bfc0028d-1fb5-4ad7-87db-de226e1aa7c9 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9" status: 200 len: 1317 microversion: 2.1 time: 0.152199 Aug 25 06:11:16.380391 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1244/2453] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:11:16 2021] GET /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:11:17.396827 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d2ebf4df-3a1c-4d3a-8c70-2dfd1cd285a6 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:17.397465 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-d2ebf4df-3a1c-4d3a-8c70-2dfd1cd285a6 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4fee06df-2121-4b1f-af52-6b9ecd1a6eb9] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:17.403347 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d2ebf4df-3a1c-4d3a-8c70-2dfd1cd285a6 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:17.403794 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d2ebf4df-3a1c-4d3a-8c70-2dfd1cd285a6 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:17.404553 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d2ebf4df-3a1c-4d3a-8c70-2dfd1cd285a6 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:17.404987 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d2ebf4df-3a1c-4d3a-8c70-2dfd1cd285a6 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:17.545823 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-d2ebf4df-3a1c-4d3a-8c70-2dfd1cd285a6 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:11:17.553473 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d2ebf4df-3a1c-4d3a-8c70-2dfd1cd285a6 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9" status: 200 len: 1507 microversion: 2.1 time: 0.160203 Aug 25 06:11:17.554071 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1210/2454] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:11:17 2021] GET /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:11:19.228235 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9ca05166-bbc2-43b5-8fc8-939f82e6d18a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33aa49e7-ce94-44b2-adad-306b6253d8a3"}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:11:19.229288 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9ca05166-bbc2-43b5-8fc8-939f82e6d18a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4fee06df-2121-4b1f-af52-6b9ecd1a6eb9] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:19.235853 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9ca05166-bbc2-43b5-8fc8-939f82e6d18a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:19.236000 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9ca05166-bbc2-43b5-8fc8-939f82e6d18a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:19.236777 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9ca05166-bbc2-43b5-8fc8-939f82e6d18a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:19.237379 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9ca05166-bbc2-43b5-8fc8-939f82e6d18a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:20.011384 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9ca05166-bbc2-43b5-8fc8-939f82e6d18a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "POST /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.786736 Aug 25 06:11:20.012327 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1245/2455] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 25 06:11:19 2021] POST /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9/os-volume_attachments => generated 194 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:11:28.641652 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5a47bfde-c0a0-40af-ab59-c76e69f9f978 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-89865413", "imageRef": "05da2439-78f2-405c-b60a-89671b21a373", "flavorRef": "452", "networks": [{"uuid": "d0d72ee8-5c74-49ab-aa11-cdff3f2fe3a5"}]}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:11:28.692932 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.network.neutron [None req-5a47bfde-c0a0-40af-ab59-c76e69f9f978 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] validate_networks() for [('d0d72ee8-5c74-49ab-aa11-cdff3f2fe3a5', None, None, None, None, None)] {{(pid=108884) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 25 06:11:29.054330 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-5a47bfde-c0a0-40af-ab59-c76e69f9f978 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Flavor limits 0:0:0 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 06:11:29.054751 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-5a47bfde-c0a0-40af-ab59-c76e69f9f978 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Image limits 0:0:0 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 06:11:29.055226 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-5a47bfde-c0a0-40af-ab59-c76e69f9f978 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Flavor pref 0:0:0 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 06:11:29.055631 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-5a47bfde-c0a0-40af-ab59-c76e69f9f978 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Image pref 0:0:0 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 06:11:29.056073 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-5a47bfde-c0a0-40af-ab59-c76e69f9f978 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 06:11:29.065743 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5a47bfde-c0a0-40af-ab59-c76e69f9f978 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:29.066231 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5a47bfde-c0a0-40af-ab59-c76e69f9f978 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:29.067054 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5a47bfde-c0a0-40af-ab59-c76e69f9f978 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:29.067744 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5a47bfde-c0a0-40af-ab59-c76e69f9f978 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:29.084642 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.quota [None req-5a47bfde-c0a0-40af-ab59-c76e69f9f978 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Getting quotas for project 71c35350b81f4cc4a4866e75cf5e2a01. Resources: {'ram', 'cores', 'instances'} {{(pid=108884) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 06:11:29.088287 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.quota [None req-5a47bfde-c0a0-40af-ab59-c76e69f9f978 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Getting quotas for user 5458184857ec4b7aace9b054355c5f9d and project 71c35350b81f4cc4a4866e75cf5e2a01. Resources: {'ram', 'cores', 'instances'} {{(pid=108884) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 06:11:29.098420 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5a47bfde-c0a0-40af-ab59-c76e69f9f978 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Going to run 1 instances... {{(pid=108884) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 25 06:11:29.100542 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5a47bfde-c0a0-40af-ab59-c76e69f9f978 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 68d57b0b-4d9e-415d-8f2a-96f25c3f19af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05da2439-78f2-405c-b60a-89671b21a373',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 25 06:11:29.205252 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5a47bfde-c0a0-40af-ab59-c76e69f9f978 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.568105 Aug 25 06:11:29.205932 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1211/2456] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 25 06:11:28 2021] POST /compute/v2.1/servers => generated 380 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 06:11:29.216560 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d5a41977-64f8-4e39-a58f-2bbb3d87f324 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:29.217186 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d5a41977-64f8-4e39-a58f-2bbb3d87f324 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 68d57b0b-4d9e-415d-8f2a-96f25c3f19af] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:29.271349 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d5a41977-64f8-4e39-a58f-2bbb3d87f324 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:11:29.278763 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d5a41977-64f8-4e39-a58f-2bbb3d87f324 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/68d57b0b-4d9e-415d-8f2a-96f25c3f19af" status: 200 len: 1216 microversion: 2.1 time: 0.066713 Aug 25 06:11:29.279424 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1246/2457] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:11:29 2021] GET /compute/v2.1/servers/68d57b0b-4d9e-415d-8f2a-96f25c3f19af => generated 1216 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:11:30.296010 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b9239f8b-179d-4cad-9e8f-3e5d520a994c tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:30.297276 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b9239f8b-179d-4cad-9e8f-3e5d520a994c tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 68d57b0b-4d9e-415d-8f2a-96f25c3f19af] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:30.303214 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b9239f8b-179d-4cad-9e8f-3e5d520a994c tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:30.303690 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b9239f8b-179d-4cad-9e8f-3e5d520a994c tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:30.304478 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b9239f8b-179d-4cad-9e8f-3e5d520a994c tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:30.304960 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b9239f8b-179d-4cad-9e8f-3e5d520a994c tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:30.365331 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-b9239f8b-179d-4cad-9e8f-3e5d520a994c tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:11:30.373379 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b9239f8b-179d-4cad-9e8f-3e5d520a994c tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/68d57b0b-4d9e-415d-8f2a-96f25c3f19af" status: 200 len: 1212 microversion: 2.1 time: 0.081007 Aug 25 06:11:30.373989 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1212/2458] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:11:30 2021] GET /compute/v2.1/servers/68d57b0b-4d9e-415d-8f2a-96f25c3f19af => generated 1212 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:11:31.390424 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9fbc9b03-9056-4040-863c-641261aa9a87 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:31.391661 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9fbc9b03-9056-4040-863c-641261aa9a87 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 68d57b0b-4d9e-415d-8f2a-96f25c3f19af] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:31.398276 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9fbc9b03-9056-4040-863c-641261aa9a87 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:31.398718 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9fbc9b03-9056-4040-863c-641261aa9a87 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:31.399480 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9fbc9b03-9056-4040-863c-641261aa9a87 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:31.399907 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9fbc9b03-9056-4040-863c-641261aa9a87 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:31.461711 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-9fbc9b03-9056-4040-863c-641261aa9a87 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:11:31.469788 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9fbc9b03-9056-4040-863c-641261aa9a87 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/68d57b0b-4d9e-415d-8f2a-96f25c3f19af" status: 200 len: 1274 microversion: 2.1 time: 0.083422 Aug 25 06:11:31.473103 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1247/2459] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:11:31 2021] GET /compute/v2.1/servers/68d57b0b-4d9e-415d-8f2a-96f25c3f19af => generated 1274 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:11:32.485863 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ef9b55e6-c6b7-485a-bce5-0f5802ab3cc4 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:32.486512 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ef9b55e6-c6b7-485a-bce5-0f5802ab3cc4 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 68d57b0b-4d9e-415d-8f2a-96f25c3f19af] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:32.492532 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ef9b55e6-c6b7-485a-bce5-0f5802ab3cc4 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:32.493035 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ef9b55e6-c6b7-485a-bce5-0f5802ab3cc4 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:32.493827 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ef9b55e6-c6b7-485a-bce5-0f5802ab3cc4 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:32.494262 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ef9b55e6-c6b7-485a-bce5-0f5802ab3cc4 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:32.603018 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [req-721a5768-8841-47f6-b145-5778814d373a req-09f73817-6326-434f-90bb-9a81b4724f01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68d57b0b-4d9e-415d-8f2a-96f25c3f19af", "tag": "b3ffe0c7-ba8e-43ea-96a7-818803c5542c"}]} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:11:32.608234 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 06:11:32.608234 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: warnings.warn(msg) Aug 25 06:11:32.613624 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-721a5768-8841-47f6-b145-5778814d373a req-09f73817-6326-434f-90bb-9a81b4724f01 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:32.614482 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-721a5768-8841-47f6-b145-5778814d373a req-09f73817-6326-434f-90bb-9a81b4724f01 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:32.626598 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.compute.server_external_events [req-721a5768-8841-47f6-b145-5778814d373a req-09f73817-6326-434f-90bb-9a81b4724f01 service nova] Creating event network-changed:b3ffe0c7-ba8e-43ea-96a7-818803c5542c for instance 68d57b0b-4d9e-415d-8f2a-96f25c3f19af on hv-cinder-78662 Aug 25 06:11:32.632935 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ef9b55e6-c6b7-485a-bce5-0f5802ab3cc4 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:11:32.633082 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [req-721a5768-8841-47f6-b145-5778814d373a req-09f73817-6326-434f-90bb-9a81b4724f01 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034713 Aug 25 06:11:32.636713 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1248/2460] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 06:11:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 06:11:32.643597 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ef9b55e6-c6b7-485a-bce5-0f5802ab3cc4 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/68d57b0b-4d9e-415d-8f2a-96f25c3f19af" status: 200 len: 1316 microversion: 2.1 time: 0.161368 Aug 25 06:11:32.644228 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1213/2461] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:11:32 2021] GET /compute/v2.1/servers/68d57b0b-4d9e-415d-8f2a-96f25c3f19af => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:11:33.662039 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-11d7d218-ce70-4641-b250-216da9161f75 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:33.662642 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-11d7d218-ce70-4641-b250-216da9161f75 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 68d57b0b-4d9e-415d-8f2a-96f25c3f19af] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:33.668784 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-11d7d218-ce70-4641-b250-216da9161f75 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:33.669220 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-11d7d218-ce70-4641-b250-216da9161f75 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:33.670021 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-11d7d218-ce70-4641-b250-216da9161f75 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:33.670451 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-11d7d218-ce70-4641-b250-216da9161f75 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:33.794791 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-11d7d218-ce70-4641-b250-216da9161f75 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:11:33.802532 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-11d7d218-ce70-4641-b250-216da9161f75 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/68d57b0b-4d9e-415d-8f2a-96f25c3f19af" status: 200 len: 1316 microversion: 2.1 time: 0.144587 Aug 25 06:11:33.803095 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1249/2462] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:11:33 2021] GET /compute/v2.1/servers/68d57b0b-4d9e-415d-8f2a-96f25c3f19af => generated 1316 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:11:34.819017 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-53f2d4fa-b242-4d60-b7cb-caa8ea61b9c0 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:34.819626 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-53f2d4fa-b242-4d60-b7cb-caa8ea61b9c0 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 68d57b0b-4d9e-415d-8f2a-96f25c3f19af] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:34.825636 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-53f2d4fa-b242-4d60-b7cb-caa8ea61b9c0 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:34.826108 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-53f2d4fa-b242-4d60-b7cb-caa8ea61b9c0 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:34.826842 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-53f2d4fa-b242-4d60-b7cb-caa8ea61b9c0 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:34.827270 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-53f2d4fa-b242-4d60-b7cb-caa8ea61b9c0 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:34.956136 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-53f2d4fa-b242-4d60-b7cb-caa8ea61b9c0 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:11:34.965633 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-53f2d4fa-b242-4d60-b7cb-caa8ea61b9c0 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/68d57b0b-4d9e-415d-8f2a-96f25c3f19af" status: 200 len: 1316 microversion: 2.1 time: 0.150126 Aug 25 06:11:34.966229 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1214/2463] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:11:34 2021] GET /compute/v2.1/servers/68d57b0b-4d9e-415d-8f2a-96f25c3f19af => generated 1316 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:11:35.983508 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-76e4da1c-a449-490c-8e16-2bcc96287088 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:35.984076 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-76e4da1c-a449-490c-8e16-2bcc96287088 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 68d57b0b-4d9e-415d-8f2a-96f25c3f19af] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:35.990774 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-76e4da1c-a449-490c-8e16-2bcc96287088 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:35.991213 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-76e4da1c-a449-490c-8e16-2bcc96287088 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:35.991950 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-76e4da1c-a449-490c-8e16-2bcc96287088 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:35.992373 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-76e4da1c-a449-490c-8e16-2bcc96287088 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:36.116442 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-76e4da1c-a449-490c-8e16-2bcc96287088 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:11:36.124037 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-76e4da1c-a449-490c-8e16-2bcc96287088 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/68d57b0b-4d9e-415d-8f2a-96f25c3f19af" status: 200 len: 1316 microversion: 2.1 time: 0.144161 Aug 25 06:11:36.124670 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1250/2464] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:11:35 2021] GET /compute/v2.1/servers/68d57b0b-4d9e-415d-8f2a-96f25c3f19af => generated 1316 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:11:37.141371 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-2f6716db-6ad9-4c07-9526-d37e3ced8a3f tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:37.142050 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-2f6716db-6ad9-4c07-9526-d37e3ced8a3f tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 68d57b0b-4d9e-415d-8f2a-96f25c3f19af] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:37.147890 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2f6716db-6ad9-4c07-9526-d37e3ced8a3f tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:37.148340 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2f6716db-6ad9-4c07-9526-d37e3ced8a3f tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:37.149103 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2f6716db-6ad9-4c07-9526-d37e3ced8a3f tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:37.149561 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2f6716db-6ad9-4c07-9526-d37e3ced8a3f tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:37.298175 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-2f6716db-6ad9-4c07-9526-d37e3ced8a3f tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:11:37.305601 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-2f6716db-6ad9-4c07-9526-d37e3ced8a3f tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/68d57b0b-4d9e-415d-8f2a-96f25c3f19af" status: 200 len: 1316 microversion: 2.1 time: 0.168413 Aug 25 06:11:37.306168 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1215/2465] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:11:37 2021] GET /compute/v2.1/servers/68d57b0b-4d9e-415d-8f2a-96f25c3f19af => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:11:38.322718 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2e4bc408-4f41-4c3c-b20d-e894fe3325b9 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:38.323326 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2e4bc408-4f41-4c3c-b20d-e894fe3325b9 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 68d57b0b-4d9e-415d-8f2a-96f25c3f19af] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:38.330258 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2e4bc408-4f41-4c3c-b20d-e894fe3325b9 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:38.330699 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2e4bc408-4f41-4c3c-b20d-e894fe3325b9 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:38.331451 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2e4bc408-4f41-4c3c-b20d-e894fe3325b9 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:38.331879 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2e4bc408-4f41-4c3c-b20d-e894fe3325b9 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:38.461612 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-2e4bc408-4f41-4c3c-b20d-e894fe3325b9 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:11:38.470356 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2e4bc408-4f41-4c3c-b20d-e894fe3325b9 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/68d57b0b-4d9e-415d-8f2a-96f25c3f19af" status: 200 len: 1316 microversion: 2.1 time: 0.151246 Aug 25 06:11:38.471247 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1251/2466] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:11:38 2021] GET /compute/v2.1/servers/68d57b0b-4d9e-415d-8f2a-96f25c3f19af => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:11:39.489719 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-4f5f5130-3ea5-4e62-93bd-7f6aa4149b08 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:39.490332 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-4f5f5130-3ea5-4e62-93bd-7f6aa4149b08 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 68d57b0b-4d9e-415d-8f2a-96f25c3f19af] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:39.496347 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4f5f5130-3ea5-4e62-93bd-7f6aa4149b08 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:39.496794 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4f5f5130-3ea5-4e62-93bd-7f6aa4149b08 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:39.497575 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4f5f5130-3ea5-4e62-93bd-7f6aa4149b08 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:39.498011 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4f5f5130-3ea5-4e62-93bd-7f6aa4149b08 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:39.622976 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-4f5f5130-3ea5-4e62-93bd-7f6aa4149b08 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:11:39.630869 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-4f5f5130-3ea5-4e62-93bd-7f6aa4149b08 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/68d57b0b-4d9e-415d-8f2a-96f25c3f19af" status: 200 len: 1316 microversion: 2.1 time: 0.144741 Aug 25 06:11:39.631473 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1216/2467] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:11:39 2021] GET /compute/v2.1/servers/68d57b0b-4d9e-415d-8f2a-96f25c3f19af => generated 1316 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:11:40.648067 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a413157a-a4ae-4b4e-84b9-fae09b014678 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:40.648675 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a413157a-a4ae-4b4e-84b9-fae09b014678 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 68d57b0b-4d9e-415d-8f2a-96f25c3f19af] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:40.654613 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a413157a-a4ae-4b4e-84b9-fae09b014678 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:40.654989 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a413157a-a4ae-4b4e-84b9-fae09b014678 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:40.656288 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a413157a-a4ae-4b4e-84b9-fae09b014678 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:40.656750 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a413157a-a4ae-4b4e-84b9-fae09b014678 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:40.677224 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [req-0e990534-7502-4203-ab91-cd159be4bbfc req-7275e740-3f87-4dce-a9b9-cc8bd4e39e50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68d57b0b-4d9e-415d-8f2a-96f25c3f19af", "name": "network-vif-plugged", "status": "completed", "tag": "b3ffe0c7-ba8e-43ea-96a7-818803c5542c"}]} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:11:40.681918 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 06:11:40.681918 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: warnings.warn(msg) Aug 25 06:11:40.689711 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-0e990534-7502-4203-ab91-cd159be4bbfc req-7275e740-3f87-4dce-a9b9-cc8bd4e39e50 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:40.690155 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-0e990534-7502-4203-ab91-cd159be4bbfc req-7275e740-3f87-4dce-a9b9-cc8bd4e39e50 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:40.706323 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.compute.server_external_events [req-0e990534-7502-4203-ab91-cd159be4bbfc req-7275e740-3f87-4dce-a9b9-cc8bd4e39e50 service nova] Creating event network-vif-plugged:b3ffe0c7-ba8e-43ea-96a7-818803c5542c for instance 68d57b0b-4d9e-415d-8f2a-96f25c3f19af on hv-cinder-78662 Aug 25 06:11:40.714327 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [req-0e990534-7502-4203-ab91-cd159be4bbfc req-7275e740-3f87-4dce-a9b9-cc8bd4e39e50 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042192 Aug 25 06:11:40.715399 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1217/2468] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 06:11:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:11:40.808706 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-a413157a-a4ae-4b4e-84b9-fae09b014678 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:11:40.820690 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a413157a-a4ae-4b4e-84b9-fae09b014678 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/68d57b0b-4d9e-415d-8f2a-96f25c3f19af" status: 200 len: 1316 microversion: 2.1 time: 0.176293 Aug 25 06:11:40.821495 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1252/2469] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:11:40 2021] GET /compute/v2.1/servers/68d57b0b-4d9e-415d-8f2a-96f25c3f19af => generated 1316 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 06:11:41.838665 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5b5acdde-0680-46f1-9bb8-a5eff845f5c5 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:41.839267 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5b5acdde-0680-46f1-9bb8-a5eff845f5c5 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 68d57b0b-4d9e-415d-8f2a-96f25c3f19af] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:41.845568 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5b5acdde-0680-46f1-9bb8-a5eff845f5c5 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:41.846014 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5b5acdde-0680-46f1-9bb8-a5eff845f5c5 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:41.846775 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5b5acdde-0680-46f1-9bb8-a5eff845f5c5 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:41.847225 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5b5acdde-0680-46f1-9bb8-a5eff845f5c5 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:41.972042 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-5b5acdde-0680-46f1-9bb8-a5eff845f5c5 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:11:41.979636 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5b5acdde-0680-46f1-9bb8-a5eff845f5c5 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/68d57b0b-4d9e-415d-8f2a-96f25c3f19af" status: 200 len: 1316 microversion: 2.1 time: 0.144978 Aug 25 06:11:41.980205 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1218/2470] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:11:41 2021] GET /compute/v2.1/servers/68d57b0b-4d9e-415d-8f2a-96f25c3f19af => generated 1316 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:11:42.996734 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-da73f264-ddb0-4c39-9962-3651d805295d tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:42.997294 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-da73f264-ddb0-4c39-9962-3651d805295d tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 68d57b0b-4d9e-415d-8f2a-96f25c3f19af] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:43.004021 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-da73f264-ddb0-4c39-9962-3651d805295d tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:43.004461 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-da73f264-ddb0-4c39-9962-3651d805295d tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:43.005233 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-da73f264-ddb0-4c39-9962-3651d805295d tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:43.005695 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-da73f264-ddb0-4c39-9962-3651d805295d tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:43.136345 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-da73f264-ddb0-4c39-9962-3651d805295d tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:11:43.144063 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-da73f264-ddb0-4c39-9962-3651d805295d tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/68d57b0b-4d9e-415d-8f2a-96f25c3f19af" status: 200 len: 1506 microversion: 2.1 time: 0.151209 Aug 25 06:11:43.144632 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1253/2471] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:11:42 2021] GET /compute/v2.1/servers/68d57b0b-4d9e-415d-8f2a-96f25c3f19af => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:11:43.160709 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1e96598f-226f-4ad8-a715-67f055ceb353 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33aa49e7-ce94-44b2-adad-306b6253d8a3"}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:11:43.161786 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1e96598f-226f-4ad8-a715-67f055ceb353 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 68d57b0b-4d9e-415d-8f2a-96f25c3f19af] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:43.167939 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1e96598f-226f-4ad8-a715-67f055ceb353 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:43.168389 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1e96598f-226f-4ad8-a715-67f055ceb353 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:43.169166 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1e96598f-226f-4ad8-a715-67f055ceb353 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:43.169634 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1e96598f-226f-4ad8-a715-67f055ceb353 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:43.257297 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.wsgi [None req-1e96598f-226f-4ad8-a715-67f055ceb353 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] HTTP exception thrown: Invalid volume: volume 33aa49e7-ce94-44b2-adad-306b6253d8a3 is already attached to instances: 4fee06df-2121-4b1f-af52-6b9ecd1a6eb9 Aug 25 06:11:43.257935 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1e96598f-226f-4ad8-a715-67f055ceb353 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Returning 400 to user: Invalid volume: volume 33aa49e7-ce94-44b2-adad-306b6253d8a3 is already attached to instances: 4fee06df-2121-4b1f-af52-6b9ecd1a6eb9 {{(pid=108884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 06:11:43.258809 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1e96598f-226f-4ad8-a715-67f055ceb353 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "POST /compute/v2.1/servers/68d57b0b-4d9e-415d-8f2a-96f25c3f19af/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102110 Aug 25 06:11:43.259349 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1219/2472] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 25 06:11:43 2021] POST /compute/v2.1/servers/68d57b0b-4d9e-415d-8f2a-96f25c3f19af/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 25 06:11:43.324646 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b01d21b8-14f9-4eed-ad4c-02723ed89025 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:43.325137 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b01d21b8-14f9-4eed-ad4c-02723ed89025 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4fee06df-2121-4b1f-af52-6b9ecd1a6eb9] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:43.331347 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b01d21b8-14f9-4eed-ad4c-02723ed89025 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:43.331817 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b01d21b8-14f9-4eed-ad4c-02723ed89025 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:43.332571 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b01d21b8-14f9-4eed-ad4c-02723ed89025 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:43.333002 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b01d21b8-14f9-4eed-ad4c-02723ed89025 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:43.416708 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.objects.instance [None req-b01d21b8-14f9-4eed-ad4c-02723ed89025 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lazy-loading 'services' on Instance uuid 4fee06df-2121-4b1f-af52-6b9ecd1a6eb9 {{(pid=108885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 06:11:43.602676 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b01d21b8-14f9-4eed-ad4c-02723ed89025 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9/os-volume_attachments/33aa49e7-ce94-44b2-adad-306b6253d8a3" status: 202 len: 0 microversion: 2.1 time: 0.281595 Aug 25 06:11:43.603262 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1254/2473] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 25 06:11:43 2021] DELETE /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9/os-volume_attachments/33aa49e7-ce94-44b2-adad-306b6253d8a3 => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 06:11:43.613273 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-df7f2326-a303-4836-8fba-f7f2a7625bce tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:43.614473 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-df7f2326-a303-4836-8fba-f7f2a7625bce tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4fee06df-2121-4b1f-af52-6b9ecd1a6eb9] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:43.621558 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-df7f2326-a303-4836-8fba-f7f2a7625bce tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:43.622226 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-df7f2326-a303-4836-8fba-f7f2a7625bce tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:43.623085 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-df7f2326-a303-4836-8fba-f7f2a7625bce tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:43.623626 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-df7f2326-a303-4836-8fba-f7f2a7625bce tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:43.653638 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-df7f2326-a303-4836-8fba-f7f2a7625bce tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045664 Aug 25 06:11:43.654199 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1220/2474] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 06:11:43 2021] GET /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 06:11:44.667344 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b76c310b-2b71-4714-9c0d-7a2434a87345 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:44.669456 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b76c310b-2b71-4714-9c0d-7a2434a87345 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4fee06df-2121-4b1f-af52-6b9ecd1a6eb9] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:44.676938 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b76c310b-2b71-4714-9c0d-7a2434a87345 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:44.677373 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b76c310b-2b71-4714-9c0d-7a2434a87345 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:44.678244 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b76c310b-2b71-4714-9c0d-7a2434a87345 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:44.678672 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b76c310b-2b71-4714-9c0d-7a2434a87345 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:44.710047 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b76c310b-2b71-4714-9c0d-7a2434a87345 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047712 Aug 25 06:11:44.710593 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1255/2475] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 06:11:44 2021] GET /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:11:45.721901 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6bf4c438-4844-4cf8-8ffd-4024a34e49bf tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:45.722813 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6bf4c438-4844-4cf8-8ffd-4024a34e49bf tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4fee06df-2121-4b1f-af52-6b9ecd1a6eb9] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:45.728796 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6bf4c438-4844-4cf8-8ffd-4024a34e49bf tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:45.729241 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6bf4c438-4844-4cf8-8ffd-4024a34e49bf tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:45.730028 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6bf4c438-4844-4cf8-8ffd-4024a34e49bf tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:45.730460 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6bf4c438-4844-4cf8-8ffd-4024a34e49bf tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:45.759151 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6bf4c438-4844-4cf8-8ffd-4024a34e49bf tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042026 Aug 25 06:11:45.759723 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1221/2476] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 06:11:45 2021] GET /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 06:11:45.866886 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6a34aa2c-9e3e-46cf-a51b-d43817796387 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-851968597", "imageRef": "05da2439-78f2-405c-b60a-89671b21a373", "flavorRef": "452", "networks": [{"uuid": "d0d72ee8-5c74-49ab-aa11-cdff3f2fe3a5"}]}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:11:45.918394 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.network.neutron [None req-6a34aa2c-9e3e-46cf-a51b-d43817796387 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] validate_networks() for [('d0d72ee8-5c74-49ab-aa11-cdff3f2fe3a5', None, None, None, None, None)] {{(pid=108885) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 25 06:11:46.363750 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-6a34aa2c-9e3e-46cf-a51b-d43817796387 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Flavor limits 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 06:11:46.364166 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-6a34aa2c-9e3e-46cf-a51b-d43817796387 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Image limits 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 06:11:46.364633 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-6a34aa2c-9e3e-46cf-a51b-d43817796387 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Flavor pref 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 06:11:46.365042 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-6a34aa2c-9e3e-46cf-a51b-d43817796387 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Image pref 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 06:11:46.365483 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-6a34aa2c-9e3e-46cf-a51b-d43817796387 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 06:11:46.374012 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6a34aa2c-9e3e-46cf-a51b-d43817796387 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:46.385364 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6a34aa2c-9e3e-46cf-a51b-d43817796387 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:46.385364 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6a34aa2c-9e3e-46cf-a51b-d43817796387 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:46.385364 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6a34aa2c-9e3e-46cf-a51b-d43817796387 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:46.393385 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.quota [None req-6a34aa2c-9e3e-46cf-a51b-d43817796387 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Getting quotas for project 71c35350b81f4cc4a4866e75cf5e2a01. Resources: {'ram', 'cores', 'instances'} {{(pid=108885) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 06:11:46.397276 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.quota [None req-6a34aa2c-9e3e-46cf-a51b-d43817796387 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Getting quotas for user 5458184857ec4b7aace9b054355c5f9d and project 71c35350b81f4cc4a4866e75cf5e2a01. Resources: {'ram', 'cores', 'instances'} {{(pid=108885) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 06:11:46.408411 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6a34aa2c-9e3e-46cf-a51b-d43817796387 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Going to run 1 instances... {{(pid=108885) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 25 06:11:46.410717 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6a34aa2c-9e3e-46cf-a51b-d43817796387 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4c22fa01-c624-4f0c-89ba-d1c30eee7c39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05da2439-78f2-405c-b60a-89671b21a373',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 25 06:11:46.555343 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6a34aa2c-9e3e-46cf-a51b-d43817796387 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.691887 Aug 25 06:11:46.556011 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1256/2477] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 25 06:11:45 2021] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 06:11:46.566398 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-370ae10b-c04f-4864-89e7-e568cad67a7a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:46.569990 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-370ae10b-c04f-4864-89e7-e568cad67a7a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4c22fa01-c624-4f0c-89ba-d1c30eee7c39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:46.630324 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-370ae10b-c04f-4864-89e7-e568cad67a7a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:11:46.637804 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-370ae10b-c04f-4864-89e7-e568cad67a7a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39" status: 200 len: 1217 microversion: 2.1 time: 0.075470 Aug 25 06:11:46.638479 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1222/2478] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:11:46 2021] GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39 => generated 1217 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:11:47.655943 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-344aa5f7-3b25-49db-959d-0c0aa7317929 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:47.657443 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-344aa5f7-3b25-49db-959d-0c0aa7317929 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4c22fa01-c624-4f0c-89ba-d1c30eee7c39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:47.663426 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-344aa5f7-3b25-49db-959d-0c0aa7317929 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:47.663870 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-344aa5f7-3b25-49db-959d-0c0aa7317929 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:47.664662 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-344aa5f7-3b25-49db-959d-0c0aa7317929 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:47.665099 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-344aa5f7-3b25-49db-959d-0c0aa7317929 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:47.736161 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-344aa5f7-3b25-49db-959d-0c0aa7317929 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:11:47.743226 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-344aa5f7-3b25-49db-959d-0c0aa7317929 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39" status: 200 len: 1221 microversion: 2.1 time: 0.091016 Aug 25 06:11:47.743806 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1257/2479] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:11:47 2021] GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39 => generated 1221 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:11:48.759127 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-4b07dded-b489-4b80-8d54-95eadc5159aa tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:48.759775 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-4b07dded-b489-4b80-8d54-95eadc5159aa tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4c22fa01-c624-4f0c-89ba-d1c30eee7c39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:48.769669 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4b07dded-b489-4b80-8d54-95eadc5159aa tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:48.773315 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4b07dded-b489-4b80-8d54-95eadc5159aa tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:48.773315 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4b07dded-b489-4b80-8d54-95eadc5159aa tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:48.773315 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4b07dded-b489-4b80-8d54-95eadc5159aa tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:48.838185 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-4b07dded-b489-4b80-8d54-95eadc5159aa tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:11:48.845648 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-4b07dded-b489-4b80-8d54-95eadc5159aa tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39" status: 200 len: 1277 microversion: 2.1 time: 0.090289 Aug 25 06:11:48.846218 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1223/2480] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:11:48 2021] GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39 => generated 1277 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:11:49.862636 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9b825988-4f4b-4922-9bbc-9079503d1b93 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:49.863291 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9b825988-4f4b-4922-9bbc-9079503d1b93 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4c22fa01-c624-4f0c-89ba-d1c30eee7c39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:49.869009 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9b825988-4f4b-4922-9bbc-9079503d1b93 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:49.869454 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9b825988-4f4b-4922-9bbc-9079503d1b93 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:49.870237 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9b825988-4f4b-4922-9bbc-9079503d1b93 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:49.870665 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9b825988-4f4b-4922-9bbc-9079503d1b93 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:49.998567 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-9b825988-4f4b-4922-9bbc-9079503d1b93 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:11:50.006554 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9b825988-4f4b-4922-9bbc-9079503d1b93 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39" status: 200 len: 1317 microversion: 2.1 time: 0.147723 Aug 25 06:11:50.007118 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1258/2481] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:11:49 2021] GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39 => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:11:50.263021 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [req-1b3b4754-6821-478b-8094-967eebc6ba35 req-a7dd0043-643a-49d5-ab6c-dded5ff09115 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c22fa01-c624-4f0c-89ba-d1c30eee7c39", "tag": "80bf6de9-c015-42b2-aa88-81a08fa39fd9"}]} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:11:50.264543 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 06:11:50.264543 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: warnings.warn(msg) Aug 25 06:11:50.272274 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-1b3b4754-6821-478b-8094-967eebc6ba35 req-a7dd0043-643a-49d5-ab6c-dded5ff09115 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:50.272738 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-1b3b4754-6821-478b-8094-967eebc6ba35 req-a7dd0043-643a-49d5-ab6c-dded5ff09115 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:50.285864 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.compute.server_external_events [req-1b3b4754-6821-478b-8094-967eebc6ba35 req-a7dd0043-643a-49d5-ab6c-dded5ff09115 service nova] Creating event network-changed:80bf6de9-c015-42b2-aa88-81a08fa39fd9 for instance 4c22fa01-c624-4f0c-89ba-d1c30eee7c39 on hv-cinder-78662 Aug 25 06:11:50.291254 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [req-1b3b4754-6821-478b-8094-967eebc6ba35 req-a7dd0043-643a-49d5-ab6c-dded5ff09115 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032464 Aug 25 06:11:50.291856 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1224/2482] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 06:11:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:11:51.024257 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-7c08c29d-a04c-40f8-a656-b6f59fe65d59 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:51.024858 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-7c08c29d-a04c-40f8-a656-b6f59fe65d59 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4c22fa01-c624-4f0c-89ba-d1c30eee7c39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:51.030846 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7c08c29d-a04c-40f8-a656-b6f59fe65d59 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:51.038193 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7c08c29d-a04c-40f8-a656-b6f59fe65d59 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:51.038193 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7c08c29d-a04c-40f8-a656-b6f59fe65d59 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:51.038193 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-7c08c29d-a04c-40f8-a656-b6f59fe65d59 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:51.156484 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-7c08c29d-a04c-40f8-a656-b6f59fe65d59 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:11:51.164264 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-7c08c29d-a04c-40f8-a656-b6f59fe65d59 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39" status: 200 len: 1317 microversion: 2.1 time: 0.143673 Aug 25 06:11:51.164760 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1259/2483] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:11:51 2021] GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39 => generated 1317 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:11:52.181914 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-4c49dde7-9b98-404f-b88b-6660556b7e21 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:52.182535 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-4c49dde7-9b98-404f-b88b-6660556b7e21 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4c22fa01-c624-4f0c-89ba-d1c30eee7c39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:52.189839 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4c49dde7-9b98-404f-b88b-6660556b7e21 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:52.190284 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4c49dde7-9b98-404f-b88b-6660556b7e21 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:52.191041 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4c49dde7-9b98-404f-b88b-6660556b7e21 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:52.191472 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4c49dde7-9b98-404f-b88b-6660556b7e21 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:52.327418 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-4c49dde7-9b98-404f-b88b-6660556b7e21 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:11:52.335020 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-4c49dde7-9b98-404f-b88b-6660556b7e21 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39" status: 200 len: 1317 microversion: 2.1 time: 0.157383 Aug 25 06:11:52.335579 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1225/2484] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:11:52 2021] GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:11:53.351701 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e21c4a1f-d870-46f7-a439-e2ba9088a5bf tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:53.352381 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e21c4a1f-d870-46f7-a439-e2ba9088a5bf tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4c22fa01-c624-4f0c-89ba-d1c30eee7c39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:53.358382 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e21c4a1f-d870-46f7-a439-e2ba9088a5bf tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:53.358822 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e21c4a1f-d870-46f7-a439-e2ba9088a5bf tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:53.359565 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e21c4a1f-d870-46f7-a439-e2ba9088a5bf tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:53.360342 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e21c4a1f-d870-46f7-a439-e2ba9088a5bf tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:53.481457 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-e21c4a1f-d870-46f7-a439-e2ba9088a5bf tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:11:53.488530 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e21c4a1f-d870-46f7-a439-e2ba9088a5bf tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39" status: 200 len: 1317 microversion: 2.1 time: 0.140748 Aug 25 06:11:53.489087 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1260/2485] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:11:53 2021] GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39 => generated 1317 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:11:54.506014 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-0d5aa8d1-94e7-4c04-aef4-d62f9dcadd5e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:54.506624 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-0d5aa8d1-94e7-4c04-aef4-d62f9dcadd5e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4c22fa01-c624-4f0c-89ba-d1c30eee7c39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:54.512730 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0d5aa8d1-94e7-4c04-aef4-d62f9dcadd5e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:54.513169 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0d5aa8d1-94e7-4c04-aef4-d62f9dcadd5e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:54.514022 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0d5aa8d1-94e7-4c04-aef4-d62f9dcadd5e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:54.514446 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0d5aa8d1-94e7-4c04-aef4-d62f9dcadd5e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:54.639505 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-0d5aa8d1-94e7-4c04-aef4-d62f9dcadd5e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:11:54.646983 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-0d5aa8d1-94e7-4c04-aef4-d62f9dcadd5e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39" status: 200 len: 1317 microversion: 2.1 time: 0.144643 Aug 25 06:11:54.647557 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1226/2486] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:11:54 2021] GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39 => generated 1317 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:11:55.663640 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-efe43598-1969-4e98-bd55-2193a3be028e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:55.664251 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-efe43598-1969-4e98-bd55-2193a3be028e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4c22fa01-c624-4f0c-89ba-d1c30eee7c39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:55.670119 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-efe43598-1969-4e98-bd55-2193a3be028e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:55.670569 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-efe43598-1969-4e98-bd55-2193a3be028e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:55.671327 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-efe43598-1969-4e98-bd55-2193a3be028e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:55.671758 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-efe43598-1969-4e98-bd55-2193a3be028e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:55.796856 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-efe43598-1969-4e98-bd55-2193a3be028e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:11:55.804754 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-efe43598-1969-4e98-bd55-2193a3be028e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39" status: 200 len: 1317 microversion: 2.1 time: 0.144870 Aug 25 06:11:55.805313 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1261/2487] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:11:55 2021] GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39 => generated 1317 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:11:56.822238 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-88527326-febd-486a-b17f-cb4df8883e0a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:56.822853 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-88527326-febd-486a-b17f-cb4df8883e0a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4c22fa01-c624-4f0c-89ba-d1c30eee7c39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:56.829279 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-88527326-febd-486a-b17f-cb4df8883e0a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:56.829762 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-88527326-febd-486a-b17f-cb4df8883e0a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:56.830526 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-88527326-febd-486a-b17f-cb4df8883e0a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:56.830961 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-88527326-febd-486a-b17f-cb4df8883e0a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:56.953816 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-88527326-febd-486a-b17f-cb4df8883e0a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:11:56.961037 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-88527326-febd-486a-b17f-cb4df8883e0a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39" status: 200 len: 1317 microversion: 2.1 time: 0.142431 Aug 25 06:11:56.961627 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1227/2488] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:11:56 2021] GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39 => generated 1317 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 06:11:57.979805 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c807e870-e8c1-4b1f-b52b-d4ad3d91b900 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:57.980343 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c807e870-e8c1-4b1f-b52b-d4ad3d91b900 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4c22fa01-c624-4f0c-89ba-d1c30eee7c39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:57.987043 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c807e870-e8c1-4b1f-b52b-d4ad3d91b900 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:57.987492 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c807e870-e8c1-4b1f-b52b-d4ad3d91b900 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:57.988251 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c807e870-e8c1-4b1f-b52b-d4ad3d91b900 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:57.988682 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c807e870-e8c1-4b1f-b52b-d4ad3d91b900 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:58.111620 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-c807e870-e8c1-4b1f-b52b-d4ad3d91b900 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:11:58.119118 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c807e870-e8c1-4b1f-b52b-d4ad3d91b900 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39" status: 200 len: 1317 microversion: 2.1 time: 0.143073 Aug 25 06:11:58.119686 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1262/2489] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:11:57 2021] GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39 => generated 1317 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:11:59.135151 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-052fe1d9-3b1f-46f7-b3cc-53375c38190f tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:11:59.135764 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-052fe1d9-3b1f-46f7-b3cc-53375c38190f tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4c22fa01-c624-4f0c-89ba-d1c30eee7c39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:11:59.142154 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-052fe1d9-3b1f-46f7-b3cc-53375c38190f tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:59.142623 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-052fe1d9-3b1f-46f7-b3cc-53375c38190f tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:59.143385 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-052fe1d9-3b1f-46f7-b3cc-53375c38190f tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:11:59.143813 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-052fe1d9-3b1f-46f7-b3cc-53375c38190f tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:11:59.268949 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-052fe1d9-3b1f-46f7-b3cc-53375c38190f tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:11:59.276275 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-052fe1d9-3b1f-46f7-b3cc-53375c38190f tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39" status: 200 len: 1317 microversion: 2.1 time: 0.144785 Aug 25 06:11:59.276871 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1228/2490] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:11:59 2021] GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39 => generated 1317 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:12:00.293087 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-658b3399-b4af-4b3c-a462-bc7cbe5a0032 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:00.294262 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-658b3399-b4af-4b3c-a462-bc7cbe5a0032 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4c22fa01-c624-4f0c-89ba-d1c30eee7c39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:00.300677 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-658b3399-b4af-4b3c-a462-bc7cbe5a0032 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:00.301120 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-658b3399-b4af-4b3c-a462-bc7cbe5a0032 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:00.302002 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-658b3399-b4af-4b3c-a462-bc7cbe5a0032 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:00.302458 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-658b3399-b4af-4b3c-a462-bc7cbe5a0032 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:00.485070 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-658b3399-b4af-4b3c-a462-bc7cbe5a0032 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:12:00.493052 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-658b3399-b4af-4b3c-a462-bc7cbe5a0032 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39" status: 200 len: 1317 microversion: 2.1 time: 0.203700 Aug 25 06:12:00.495122 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1263/2491] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:12:00 2021] GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39 => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:12:01.509972 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-9a7dff2d-533c-434d-8578-bd424026e892 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:01.510504 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-9a7dff2d-533c-434d-8578-bd424026e892 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4c22fa01-c624-4f0c-89ba-d1c30eee7c39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:01.517694 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9a7dff2d-533c-434d-8578-bd424026e892 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:01.518138 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9a7dff2d-533c-434d-8578-bd424026e892 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:01.518945 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9a7dff2d-533c-434d-8578-bd424026e892 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:01.519404 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-9a7dff2d-533c-434d-8578-bd424026e892 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:01.651183 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-9a7dff2d-533c-434d-8578-bd424026e892 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:12:01.659925 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-9a7dff2d-533c-434d-8578-bd424026e892 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39" status: 200 len: 1317 microversion: 2.1 time: 0.154439 Aug 25 06:12:01.660496 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1229/2492] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:12:01 2021] GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:12:02.677787 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a085808b-f3b4-49c5-a6c0-a22bacd3df1e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:02.678692 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a085808b-f3b4-49c5-a6c0-a22bacd3df1e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4c22fa01-c624-4f0c-89ba-d1c30eee7c39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:02.684986 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a085808b-f3b4-49c5-a6c0-a22bacd3df1e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:02.685518 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a085808b-f3b4-49c5-a6c0-a22bacd3df1e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:02.686402 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a085808b-f3b4-49c5-a6c0-a22bacd3df1e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:02.686930 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a085808b-f3b4-49c5-a6c0-a22bacd3df1e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:02.701093 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [req-743bca79-6b7f-4501-bc89-8359292f2abe req-ee899b0e-70c0-4654-a477-33ab66e47065 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c22fa01-c624-4f0c-89ba-d1c30eee7c39", "name": "network-vif-plugged", "status": "completed", "tag": "80bf6de9-c015-42b2-aa88-81a08fa39fd9"}]} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:12:02.703373 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 06:12:02.703373 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: warnings.warn(msg) Aug 25 06:12:02.711457 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-743bca79-6b7f-4501-bc89-8359292f2abe req-ee899b0e-70c0-4654-a477-33ab66e47065 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:02.711981 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-743bca79-6b7f-4501-bc89-8359292f2abe req-ee899b0e-70c0-4654-a477-33ab66e47065 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:02.723859 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.compute.server_external_events [req-743bca79-6b7f-4501-bc89-8359292f2abe req-ee899b0e-70c0-4654-a477-33ab66e47065 service nova] Creating event network-vif-plugged:80bf6de9-c015-42b2-aa88-81a08fa39fd9 for instance 4c22fa01-c624-4f0c-89ba-d1c30eee7c39 on hv-cinder-78662 Aug 25 06:12:02.729270 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [req-743bca79-6b7f-4501-bc89-8359292f2abe req-ee899b0e-70c0-4654-a477-33ab66e47065 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032916 Aug 25 06:12:02.730569 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1230/2493] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 06:12:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 06:12:02.821906 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-a085808b-f3b4-49c5-a6c0-a22bacd3df1e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:12:02.830742 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a085808b-f3b4-49c5-a6c0-a22bacd3df1e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39" status: 200 len: 1317 microversion: 2.1 time: 0.156985 Aug 25 06:12:02.841193 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1264/2494] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:12:02 2021] GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:12:03.849862 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-fd116be7-e998-4c9d-83df-5c38b7017682 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:03.850891 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-fd116be7-e998-4c9d-83df-5c38b7017682 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4c22fa01-c624-4f0c-89ba-d1c30eee7c39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:03.857178 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fd116be7-e998-4c9d-83df-5c38b7017682 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:03.857655 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fd116be7-e998-4c9d-83df-5c38b7017682 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:03.858517 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fd116be7-e998-4c9d-83df-5c38b7017682 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:03.859078 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fd116be7-e998-4c9d-83df-5c38b7017682 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:04.007202 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-fd116be7-e998-4c9d-83df-5c38b7017682 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:12:04.015011 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-fd116be7-e998-4c9d-83df-5c38b7017682 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39" status: 200 len: 1317 microversion: 2.1 time: 0.169858 Aug 25 06:12:04.017102 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1231/2495] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:12:03 2021] GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:12:05.032901 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-1ba4b530-f070-45e5-bf8a-26329c8d4f34 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:05.033817 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-1ba4b530-f070-45e5-bf8a-26329c8d4f34 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4c22fa01-c624-4f0c-89ba-d1c30eee7c39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:05.041305 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1ba4b530-f070-45e5-bf8a-26329c8d4f34 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:05.048196 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1ba4b530-f070-45e5-bf8a-26329c8d4f34 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:05.048196 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1ba4b530-f070-45e5-bf8a-26329c8d4f34 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:05.048196 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-1ba4b530-f070-45e5-bf8a-26329c8d4f34 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:05.197509 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-1ba4b530-f070-45e5-bf8a-26329c8d4f34 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:12:05.206773 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-1ba4b530-f070-45e5-bf8a-26329c8d4f34 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39" status: 200 len: 1507 microversion: 2.1 time: 0.178406 Aug 25 06:12:05.207435 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1265/2496] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:12:05 2021] GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39 => generated 1507 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:12:06.865306 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-fb65c2aa-9bc9-4eaa-86d6-5504d4d466ed tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf5ee079-e56c-487b-9594-6e2958210602"}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:12:06.866389 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-fb65c2aa-9bc9-4eaa-86d6-5504d4d466ed tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4c22fa01-c624-4f0c-89ba-d1c30eee7c39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:06.872204 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fb65c2aa-9bc9-4eaa-86d6-5504d4d466ed tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:06.872751 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fb65c2aa-9bc9-4eaa-86d6-5504d4d466ed tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:06.873626 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fb65c2aa-9bc9-4eaa-86d6-5504d4d466ed tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:06.874131 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fb65c2aa-9bc9-4eaa-86d6-5504d4d466ed tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:07.611382 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-fb65c2aa-9bc9-4eaa-86d6-5504d4d466ed tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "POST /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.749602 Aug 25 06:12:07.611999 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1232/2497] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 25 06:12:06 2021] POST /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39/os-volume_attachments => generated 194 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:12:14.320423 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-505ef4ad-0ce7-4cc6-ad96-16d55c8c6cbc tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Action: 'create', calling method: .version_select at 0x7f91066039d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-7372938"}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:12:14.338790 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.quota [None req-505ef4ad-0ce7-4cc6-ad96-16d55c8c6cbc tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Getting quotas for project 8b15de72ab1c4793bb72e45a48d7e893. Resources: {'key_pairs'} {{(pid=108885) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 06:12:14.343238 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.quota [None req-505ef4ad-0ce7-4cc6-ad96-16d55c8c6cbc tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Getting quotas for user eab9d592e3d649bd8faa4a9e6081a14a and project 8b15de72ab1c4793bb72e45a48d7e893. Resources: {'key_pairs'} {{(pid=108885) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 06:12:14.585620 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.quota [None req-505ef4ad-0ce7-4cc6-ad96-16d55c8c6cbc tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Getting quotas for project 8b15de72ab1c4793bb72e45a48d7e893. Resources: {'key_pairs'} {{(pid=108885) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 06:12:14.595209 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.quota [None req-505ef4ad-0ce7-4cc6-ad96-16d55c8c6cbc tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Getting quotas for user eab9d592e3d649bd8faa4a9e6081a14a and project 8b15de72ab1c4793bb72e45a48d7e893. Resources: {'key_pairs'} {{(pid=108885) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 06:12:14.610001 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-505ef4ad-0ce7-4cc6-ad96-16d55c8c6cbc tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.476093 Aug 25 06:12:14.610599 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1266/2498] 10.222.0.42 () {60 vars in 1158 bytes} [Wed Aug 25 06:12:14 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:12:15.221299 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c29638c0-05ff-47e8-bd6d-38e46218b134 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf5ee079-e56c-487b-9594-6e2958210602"}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:12:15.222671 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c29638c0-05ff-47e8-bd6d-38e46218b134 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4c22fa01-c624-4f0c-89ba-d1c30eee7c39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:15.229506 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c29638c0-05ff-47e8-bd6d-38e46218b134 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:15.230072 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c29638c0-05ff-47e8-bd6d-38e46218b134 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:15.230933 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c29638c0-05ff-47e8-bd6d-38e46218b134 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:15.231366 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c29638c0-05ff-47e8-bd6d-38e46218b134 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:15.318655 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.wsgi [None req-c29638c0-05ff-47e8-bd6d-38e46218b134 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] HTTP exception thrown: Invalid volume: volume bf5ee079-e56c-487b-9594-6e2958210602 is already attached to instances: 4c22fa01-c624-4f0c-89ba-d1c30eee7c39 Aug 25 06:12:15.319674 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c29638c0-05ff-47e8-bd6d-38e46218b134 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Returning 400 to user: Invalid volume: volume bf5ee079-e56c-487b-9594-6e2958210602 is already attached to instances: 4c22fa01-c624-4f0c-89ba-d1c30eee7c39 {{(pid=108884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 06:12:15.320677 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c29638c0-05ff-47e8-bd6d-38e46218b134 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "POST /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104753 Aug 25 06:12:15.321581 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1233/2499] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 25 06:12:15 2021] POST /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 06:12:15.387225 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-86e7d22e-d983-4127-b277-5c0858d524fc tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:15.387712 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-86e7d22e-d983-4127-b277-5c0858d524fc tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4c22fa01-c624-4f0c-89ba-d1c30eee7c39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:15.394970 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-86e7d22e-d983-4127-b277-5c0858d524fc tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:15.395440 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-86e7d22e-d983-4127-b277-5c0858d524fc tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:15.396204 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-86e7d22e-d983-4127-b277-5c0858d524fc tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:15.396629 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-86e7d22e-d983-4127-b277-5c0858d524fc tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:15.493293 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.objects.instance [None req-86e7d22e-d983-4127-b277-5c0858d524fc tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lazy-loading 'services' on Instance uuid 4c22fa01-c624-4f0c-89ba-d1c30eee7c39 {{(pid=108885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 06:12:15.756708 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-86e7d22e-d983-4127-b277-5c0858d524fc tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39/os-volume_attachments/bf5ee079-e56c-487b-9594-6e2958210602" status: 202 len: 0 microversion: 2.1 time: 0.372960 Aug 25 06:12:15.757299 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1267/2500] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 25 06:12:15 2021] DELETE /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39/os-volume_attachments/bf5ee079-e56c-487b-9594-6e2958210602 => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 06:12:15.767749 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a8cf2529-dc6d-425e-a659-d7343c553fa6 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:15.769711 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a8cf2529-dc6d-425e-a659-d7343c553fa6 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4c22fa01-c624-4f0c-89ba-d1c30eee7c39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:15.775254 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a8cf2529-dc6d-425e-a659-d7343c553fa6 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:15.778697 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a8cf2529-dc6d-425e-a659-d7343c553fa6 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:15.780744 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a8cf2529-dc6d-425e-a659-d7343c553fa6 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:15.781181 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a8cf2529-dc6d-425e-a659-d7343c553fa6 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:15.812068 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a8cf2529-dc6d-425e-a659-d7343c553fa6 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048596 Aug 25 06:12:15.812645 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1234/2501] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 06:12:15 2021] GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:12:16.825557 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-34f7a6a7-d5eb-49ab-b950-ad880bfef6b5 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:16.827245 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-34f7a6a7-d5eb-49ab-b950-ad880bfef6b5 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4c22fa01-c624-4f0c-89ba-d1c30eee7c39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:16.834978 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-34f7a6a7-d5eb-49ab-b950-ad880bfef6b5 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:16.835663 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-34f7a6a7-d5eb-49ab-b950-ad880bfef6b5 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:16.837008 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-34f7a6a7-d5eb-49ab-b950-ad880bfef6b5 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:16.837454 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-34f7a6a7-d5eb-49ab-b950-ad880bfef6b5 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:16.871170 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-34f7a6a7-d5eb-49ab-b950-ad880bfef6b5 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050085 Aug 25 06:12:16.872546 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1268/2502] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 06:12:16 2021] GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:12:17.883162 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-07c2ff04-408f-4176-a6e7-6db53db3b966 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:17.884077 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-07c2ff04-408f-4176-a6e7-6db53db3b966 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4c22fa01-c624-4f0c-89ba-d1c30eee7c39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:17.890781 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-07c2ff04-408f-4176-a6e7-6db53db3b966 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:17.891859 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-07c2ff04-408f-4176-a6e7-6db53db3b966 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:17.892628 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-07c2ff04-408f-4176-a6e7-6db53db3b966 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:17.893058 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-07c2ff04-408f-4176-a6e7-6db53db3b966 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:17.921487 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-07c2ff04-408f-4176-a6e7-6db53db3b966 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042069 Aug 25 06:12:17.922111 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1235/2503] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 06:12:17 2021] GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 06:12:18.087752 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-83da7ee8-882e-48a7-a5ab-8782f867db00 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1328721912", "imageRef": "05da2439-78f2-405c-b60a-89671b21a373", "flavorRef": "452", "networks": [{"uuid": "d0d72ee8-5c74-49ab-aa11-cdff3f2fe3a5"}]}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:12:18.139581 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.network.neutron [None req-83da7ee8-882e-48a7-a5ab-8782f867db00 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] validate_networks() for [('d0d72ee8-5c74-49ab-aa11-cdff3f2fe3a5', None, None, None, None, None)] {{(pid=108885) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 25 06:12:18.520042 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-83da7ee8-882e-48a7-a5ab-8782f867db00 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Flavor limits 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 06:12:18.520474 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-83da7ee8-882e-48a7-a5ab-8782f867db00 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Image limits 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 06:12:18.521085 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-83da7ee8-882e-48a7-a5ab-8782f867db00 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Flavor pref 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 06:12:18.521699 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-83da7ee8-882e-48a7-a5ab-8782f867db00 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Image pref 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 06:12:18.522256 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-83da7ee8-882e-48a7-a5ab-8782f867db00 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 06:12:18.532122 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-83da7ee8-882e-48a7-a5ab-8782f867db00 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:18.532584 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-83da7ee8-882e-48a7-a5ab-8782f867db00 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:18.533382 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-83da7ee8-882e-48a7-a5ab-8782f867db00 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:18.533837 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-83da7ee8-882e-48a7-a5ab-8782f867db00 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:18.553057 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.quota [None req-83da7ee8-882e-48a7-a5ab-8782f867db00 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Getting quotas for project 71c35350b81f4cc4a4866e75cf5e2a01. Resources: {'ram', 'cores', 'instances'} {{(pid=108885) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 06:12:18.556954 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.quota [None req-83da7ee8-882e-48a7-a5ab-8782f867db00 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Getting quotas for user 5458184857ec4b7aace9b054355c5f9d and project 71c35350b81f4cc4a4866e75cf5e2a01. Resources: {'ram', 'cores', 'instances'} {{(pid=108885) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 06:12:18.568659 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-83da7ee8-882e-48a7-a5ab-8782f867db00 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Going to run 1 instances... {{(pid=108885) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 25 06:12:18.571028 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-83da7ee8-882e-48a7-a5ab-8782f867db00 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 1dbeec7e-00ca-4437-8756-60ccd1fd05e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05da2439-78f2-405c-b60a-89671b21a373',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 25 06:12:18.724582 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-83da7ee8-882e-48a7-a5ab-8782f867db00 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.640586 Aug 25 06:12:18.730475 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1269/2504] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 25 06:12:18 2021] POST /compute/v2.1/servers => generated 380 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 06:12:18.736730 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1d21818f-1585-4424-8fdf-57a687509a67 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:18.738508 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1d21818f-1585-4424-8fdf-57a687509a67 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 1dbeec7e-00ca-4437-8756-60ccd1fd05e4] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:18.798140 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-1d21818f-1585-4424-8fdf-57a687509a67 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:12:18.806166 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1d21818f-1585-4424-8fdf-57a687509a67 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4" status: 200 len: 1218 microversion: 2.1 time: 0.074462 Aug 25 06:12:18.807031 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1236/2505] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:12:18 2021] GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4 => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:12:19.828793 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f0f109a4-d1e9-4961-aac9-1a1bdec9a92a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:19.829511 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f0f109a4-d1e9-4961-aac9-1a1bdec9a92a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 1dbeec7e-00ca-4437-8756-60ccd1fd05e4] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:19.835865 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f0f109a4-d1e9-4961-aac9-1a1bdec9a92a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:19.836307 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f0f109a4-d1e9-4961-aac9-1a1bdec9a92a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:19.837072 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f0f109a4-d1e9-4961-aac9-1a1bdec9a92a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:19.837507 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f0f109a4-d1e9-4961-aac9-1a1bdec9a92a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:19.900772 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-f0f109a4-d1e9-4961-aac9-1a1bdec9a92a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:12:19.908293 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f0f109a4-d1e9-4961-aac9-1a1bdec9a92a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4" status: 200 len: 1222 microversion: 2.1 time: 0.082968 Aug 25 06:12:19.908871 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1270/2506] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:12:19 2021] GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:12:20.924127 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-f1596558-680f-408d-9472-8678de850226 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:20.924739 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-f1596558-680f-408d-9472-8678de850226 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 1dbeec7e-00ca-4437-8756-60ccd1fd05e4] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:20.930554 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f1596558-680f-408d-9472-8678de850226 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:20.931003 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f1596558-680f-408d-9472-8678de850226 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:20.931774 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f1596558-680f-408d-9472-8678de850226 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:20.932210 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f1596558-680f-408d-9472-8678de850226 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:20.995735 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-f1596558-680f-408d-9472-8678de850226 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:12:21.004060 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-f1596558-680f-408d-9472-8678de850226 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4" status: 200 len: 1288 microversion: 2.1 time: 0.083578 Aug 25 06:12:21.004639 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1237/2507] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:12:20 2021] GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4 => generated 1288 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:12:22.022571 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6f9a94d4-77a5-4da1-a155-b8527f92b8d7 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:22.023204 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6f9a94d4-77a5-4da1-a155-b8527f92b8d7 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 1dbeec7e-00ca-4437-8756-60ccd1fd05e4] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:22.029883 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6f9a94d4-77a5-4da1-a155-b8527f92b8d7 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:22.030325 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6f9a94d4-77a5-4da1-a155-b8527f92b8d7 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:22.031070 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6f9a94d4-77a5-4da1-a155-b8527f92b8d7 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:22.031528 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6f9a94d4-77a5-4da1-a155-b8527f92b8d7 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:22.171193 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-6f9a94d4-77a5-4da1-a155-b8527f92b8d7 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:12:22.178992 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6f9a94d4-77a5-4da1-a155-b8527f92b8d7 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4" status: 200 len: 1318 microversion: 2.1 time: 0.160263 Aug 25 06:12:22.179460 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1271/2508] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:12:22 2021] GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:12:22.364168 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [req-2bc01747-f448-46c4-b195-cd54e1ad94ea req-9cd7a9c1-dd4d-462f-aa78-417c04386cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dbeec7e-00ca-4437-8756-60ccd1fd05e4", "tag": "f2ec86a6-d2b1-4fc9-9a3c-381a6b76ec46"}]} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:12:22.372620 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 06:12:22.372620 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: warnings.warn(msg) Aug 25 06:12:22.373065 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-2bc01747-f448-46c4-b195-cd54e1ad94ea req-9cd7a9c1-dd4d-462f-aa78-417c04386cc8 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:22.373465 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-2bc01747-f448-46c4-b195-cd54e1ad94ea req-9cd7a9c1-dd4d-462f-aa78-417c04386cc8 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:22.389325 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.compute.server_external_events [req-2bc01747-f448-46c4-b195-cd54e1ad94ea req-9cd7a9c1-dd4d-462f-aa78-417c04386cc8 service nova] Creating event network-changed:f2ec86a6-d2b1-4fc9-9a3c-381a6b76ec46 for instance 1dbeec7e-00ca-4437-8756-60ccd1fd05e4 on hv-cinder-78662 Aug 25 06:12:22.395477 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [req-2bc01747-f448-46c4-b195-cd54e1ad94ea req-9cd7a9c1-dd4d-462f-aa78-417c04386cc8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034904 Aug 25 06:12:22.396304 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1238/2509] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 06:12:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:12:23.195849 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-3b3905e7-1086-4190-bc1b-e38dd132455d tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:23.196456 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-3b3905e7-1086-4190-bc1b-e38dd132455d tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 1dbeec7e-00ca-4437-8756-60ccd1fd05e4] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:23.202359 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3b3905e7-1086-4190-bc1b-e38dd132455d tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:23.202797 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3b3905e7-1086-4190-bc1b-e38dd132455d tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:23.203591 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3b3905e7-1086-4190-bc1b-e38dd132455d tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:23.204024 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3b3905e7-1086-4190-bc1b-e38dd132455d tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:23.331006 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-3b3905e7-1086-4190-bc1b-e38dd132455d tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:12:23.338535 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-3b3905e7-1086-4190-bc1b-e38dd132455d tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4" status: 200 len: 1318 microversion: 2.1 time: 0.146290 Aug 25 06:12:23.339101 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1272/2510] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:12:23 2021] GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:12:24.356215 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-2699261f-38b6-409b-ad8f-53716056629c tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:24.356833 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-2699261f-38b6-409b-ad8f-53716056629c tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 1dbeec7e-00ca-4437-8756-60ccd1fd05e4] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:24.364034 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2699261f-38b6-409b-ad8f-53716056629c tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:24.364274 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2699261f-38b6-409b-ad8f-53716056629c tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:24.365040 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2699261f-38b6-409b-ad8f-53716056629c tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:24.365469 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2699261f-38b6-409b-ad8f-53716056629c tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:24.496135 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-2699261f-38b6-409b-ad8f-53716056629c tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:12:24.505104 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-2699261f-38b6-409b-ad8f-53716056629c tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4" status: 200 len: 1318 microversion: 2.1 time: 0.153044 Aug 25 06:12:24.505708 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1239/2511] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:12:24 2021] GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:12:25.522454 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-17821aba-329d-4bde-9075-dd8b91f2475d tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:25.523055 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-17821aba-329d-4bde-9075-dd8b91f2475d tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 1dbeec7e-00ca-4437-8756-60ccd1fd05e4] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:25.529126 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-17821aba-329d-4bde-9075-dd8b91f2475d tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:25.530011 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-17821aba-329d-4bde-9075-dd8b91f2475d tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:25.530121 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-17821aba-329d-4bde-9075-dd8b91f2475d tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:25.530523 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-17821aba-329d-4bde-9075-dd8b91f2475d tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:25.653452 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-17821aba-329d-4bde-9075-dd8b91f2475d tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:12:25.664901 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-17821aba-329d-4bde-9075-dd8b91f2475d tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4" status: 200 len: 1318 microversion: 2.1 time: 0.146602 Aug 25 06:12:25.665476 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1273/2512] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:12:25 2021] GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:12:26.681727 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-13d3f9a9-6e76-49ff-a21e-532c31fac9d3 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:26.682408 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-13d3f9a9-6e76-49ff-a21e-532c31fac9d3 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 1dbeec7e-00ca-4437-8756-60ccd1fd05e4] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:26.688360 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-13d3f9a9-6e76-49ff-a21e-532c31fac9d3 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:26.688740 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-13d3f9a9-6e76-49ff-a21e-532c31fac9d3 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:26.689495 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-13d3f9a9-6e76-49ff-a21e-532c31fac9d3 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:26.689975 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-13d3f9a9-6e76-49ff-a21e-532c31fac9d3 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:26.818832 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-13d3f9a9-6e76-49ff-a21e-532c31fac9d3 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:12:26.826543 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-13d3f9a9-6e76-49ff-a21e-532c31fac9d3 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4" status: 200 len: 1318 microversion: 2.1 time: 0.148748 Aug 25 06:12:26.827114 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1240/2513] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:12:26 2021] GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:12:27.844088 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-64b453ca-69c7-4b0d-ad64-6570d8063c8e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:27.844690 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-64b453ca-69c7-4b0d-ad64-6570d8063c8e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 1dbeec7e-00ca-4437-8756-60ccd1fd05e4] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:27.851507 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-64b453ca-69c7-4b0d-ad64-6570d8063c8e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:27.852055 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-64b453ca-69c7-4b0d-ad64-6570d8063c8e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:27.852868 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-64b453ca-69c7-4b0d-ad64-6570d8063c8e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:27.853296 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-64b453ca-69c7-4b0d-ad64-6570d8063c8e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:27.979337 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-64b453ca-69c7-4b0d-ad64-6570d8063c8e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:12:27.986456 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-64b453ca-69c7-4b0d-ad64-6570d8063c8e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4" status: 200 len: 1318 microversion: 2.1 time: 0.146077 Aug 25 06:12:27.987084 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1274/2514] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:12:27 2021] GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:12:29.004024 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a507eced-959d-4f76-8a85-e0d30ed4068f tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:29.005044 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a507eced-959d-4f76-8a85-e0d30ed4068f tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 1dbeec7e-00ca-4437-8756-60ccd1fd05e4] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:29.011782 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a507eced-959d-4f76-8a85-e0d30ed4068f tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:29.012218 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a507eced-959d-4f76-8a85-e0d30ed4068f tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:29.012978 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a507eced-959d-4f76-8a85-e0d30ed4068f tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:29.013448 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a507eced-959d-4f76-8a85-e0d30ed4068f tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:29.140502 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-a507eced-959d-4f76-8a85-e0d30ed4068f tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:12:29.150228 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a507eced-959d-4f76-8a85-e0d30ed4068f tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4" status: 200 len: 1318 microversion: 2.1 time: 0.150379 Aug 25 06:12:29.157097 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1241/2515] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:12:28 2021] GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:12:30.174313 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d4d2a222-9fa3-4d0a-a7a1-532226bb80cc tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:30.175390 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d4d2a222-9fa3-4d0a-a7a1-532226bb80cc tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 1dbeec7e-00ca-4437-8756-60ccd1fd05e4] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:30.181382 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d4d2a222-9fa3-4d0a-a7a1-532226bb80cc tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:30.181853 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d4d2a222-9fa3-4d0a-a7a1-532226bb80cc tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:30.182664 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d4d2a222-9fa3-4d0a-a7a1-532226bb80cc tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:30.183095 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d4d2a222-9fa3-4d0a-a7a1-532226bb80cc tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:30.314109 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d4d2a222-9fa3-4d0a-a7a1-532226bb80cc tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:12:30.324348 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d4d2a222-9fa3-4d0a-a7a1-532226bb80cc tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4" status: 200 len: 1318 microversion: 2.1 time: 0.153828 Aug 25 06:12:30.324941 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1275/2516] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:12:30 2021] GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:12:31.340731 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b779d510-1111-4af2-8674-9ae800850a86 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:31.341323 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b779d510-1111-4af2-8674-9ae800850a86 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 1dbeec7e-00ca-4437-8756-60ccd1fd05e4] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:31.347695 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b779d510-1111-4af2-8674-9ae800850a86 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:31.348132 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b779d510-1111-4af2-8674-9ae800850a86 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:31.348885 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b779d510-1111-4af2-8674-9ae800850a86 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:31.349308 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b779d510-1111-4af2-8674-9ae800850a86 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:31.478711 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-b779d510-1111-4af2-8674-9ae800850a86 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:12:31.485760 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b779d510-1111-4af2-8674-9ae800850a86 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4" status: 200 len: 1318 microversion: 2.1 time: 0.148584 Aug 25 06:12:31.486359 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1242/2517] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:12:31 2021] GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:12:32.502323 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5267da65-e792-4884-a851-a662d9c16be5 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:32.503716 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5267da65-e792-4884-a851-a662d9c16be5 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 1dbeec7e-00ca-4437-8756-60ccd1fd05e4] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:32.510075 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5267da65-e792-4884-a851-a662d9c16be5 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:32.510516 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5267da65-e792-4884-a851-a662d9c16be5 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:32.511286 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5267da65-e792-4884-a851-a662d9c16be5 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:32.511752 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5267da65-e792-4884-a851-a662d9c16be5 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:32.643626 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-5267da65-e792-4884-a851-a662d9c16be5 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:12:32.650824 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5267da65-e792-4884-a851-a662d9c16be5 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4" status: 200 len: 1318 microversion: 2.1 time: 0.152195 Aug 25 06:12:32.651389 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1276/2518] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:12:32 2021] GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:12:32.875240 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [req-ff3b7f14-e51c-4fa5-b841-cfae8ed809bf req-6fe9dd2f-c46b-4a23-a2a4-8224f50f9a8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dbeec7e-00ca-4437-8756-60ccd1fd05e4", "name": "network-vif-plugged", "status": "completed", "tag": "f2ec86a6-d2b1-4fc9-9a3c-381a6b76ec46"}]} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:12:32.876740 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 06:12:32.876740 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: warnings.warn(msg) Aug 25 06:12:32.883956 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-ff3b7f14-e51c-4fa5-b841-cfae8ed809bf req-6fe9dd2f-c46b-4a23-a2a4-8224f50f9a8c service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:32.884410 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-ff3b7f14-e51c-4fa5-b841-cfae8ed809bf req-6fe9dd2f-c46b-4a23-a2a4-8224f50f9a8c service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:32.895405 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.compute.server_external_events [req-ff3b7f14-e51c-4fa5-b841-cfae8ed809bf req-6fe9dd2f-c46b-4a23-a2a4-8224f50f9a8c service nova] Creating event network-vif-plugged:f2ec86a6-d2b1-4fc9-9a3c-381a6b76ec46 for instance 1dbeec7e-00ca-4437-8756-60ccd1fd05e4 on hv-cinder-78662 Aug 25 06:12:32.900630 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [req-ff3b7f14-e51c-4fa5-b841-cfae8ed809bf req-6fe9dd2f-c46b-4a23-a2a4-8224f50f9a8c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029082 Aug 25 06:12:32.901239 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1243/2519] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 06:12:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:12:33.667999 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d0034062-94d0-4e3d-9bae-0f44e93780d7 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:33.668528 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d0034062-94d0-4e3d-9bae-0f44e93780d7 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 1dbeec7e-00ca-4437-8756-60ccd1fd05e4] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:33.674436 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d0034062-94d0-4e3d-9bae-0f44e93780d7 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:33.674986 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d0034062-94d0-4e3d-9bae-0f44e93780d7 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:33.675707 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d0034062-94d0-4e3d-9bae-0f44e93780d7 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:33.676140 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d0034062-94d0-4e3d-9bae-0f44e93780d7 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:33.802978 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d0034062-94d0-4e3d-9bae-0f44e93780d7 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:12:33.810199 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d0034062-94d0-4e3d-9bae-0f44e93780d7 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4" status: 200 len: 1318 microversion: 2.1 time: 0.146045 Aug 25 06:12:33.810754 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1277/2520] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:12:33 2021] GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:12:34.827145 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-435b1ba1-faf9-458e-8c65-6c388d984e41 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:34.827836 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-435b1ba1-faf9-458e-8c65-6c388d984e41 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 1dbeec7e-00ca-4437-8756-60ccd1fd05e4] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:34.835078 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-435b1ba1-faf9-458e-8c65-6c388d984e41 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:34.835519 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-435b1ba1-faf9-458e-8c65-6c388d984e41 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:34.836276 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-435b1ba1-faf9-458e-8c65-6c388d984e41 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:34.836705 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-435b1ba1-faf9-458e-8c65-6c388d984e41 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:34.961367 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-435b1ba1-faf9-458e-8c65-6c388d984e41 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:12:34.968651 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-435b1ba1-faf9-458e-8c65-6c388d984e41 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4" status: 200 len: 1318 microversion: 2.1 time: 0.145549 Aug 25 06:12:34.969216 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1244/2521] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:12:34 2021] GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:12:35.971243 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 06:12:35.971904 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: Wed Aug 25 06:12:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 06:12:35.987643 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ca5b1642-2e16-4e46-92b5-062589317c03 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:35.988258 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ca5b1642-2e16-4e46-92b5-062589317c03 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 1dbeec7e-00ca-4437-8756-60ccd1fd05e4] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:35.994927 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ca5b1642-2e16-4e46-92b5-062589317c03 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:35.995375 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ca5b1642-2e16-4e46-92b5-062589317c03 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:35.996143 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ca5b1642-2e16-4e46-92b5-062589317c03 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:35.996580 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ca5b1642-2e16-4e46-92b5-062589317c03 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:36.117847 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ca5b1642-2e16-4e46-92b5-062589317c03 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:12:36.125034 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ca5b1642-2e16-4e46-92b5-062589317c03 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4" status: 200 len: 1509 microversion: 2.1 time: 0.141561 Aug 25 06:12:36.125628 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1278/2522] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:12:35 2021] GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4 => generated 1509 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:12:38.796211 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ffb69641-c268-490a-9f7f-23d769349c0e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a59853e-a995-4fb6-84d4-efada9d0e077"}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:12:38.797187 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ffb69641-c268-490a-9f7f-23d769349c0e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 1dbeec7e-00ca-4437-8756-60ccd1fd05e4] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:38.805586 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ffb69641-c268-490a-9f7f-23d769349c0e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:38.806035 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ffb69641-c268-490a-9f7f-23d769349c0e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:38.806813 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ffb69641-c268-490a-9f7f-23d769349c0e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:38.807241 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ffb69641-c268-490a-9f7f-23d769349c0e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:39.637730 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ffb69641-c268-490a-9f7f-23d769349c0e tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "POST /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.845042 Aug 25 06:12:39.638624 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1245/2523] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 25 06:12:38 2021] POST /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4/os-volume_attachments => generated 194 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:12:48.314627 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-dfbe37ea-1557-4061-ac1f-94ae1183b923 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:48.315117 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-dfbe37ea-1557-4061-ac1f-94ae1183b923 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 1dbeec7e-00ca-4437-8756-60ccd1fd05e4] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:48.320786 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-dfbe37ea-1557-4061-ac1f-94ae1183b923 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:48.321224 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-dfbe37ea-1557-4061-ac1f-94ae1183b923 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:48.322009 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-dfbe37ea-1557-4061-ac1f-94ae1183b923 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:48.322438 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-dfbe37ea-1557-4061-ac1f-94ae1183b923 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:48.408208 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.objects.instance [None req-dfbe37ea-1557-4061-ac1f-94ae1183b923 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lazy-loading 'services' on Instance uuid 1dbeec7e-00ca-4437-8756-60ccd1fd05e4 {{(pid=108885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 06:12:48.614777 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-dfbe37ea-1557-4061-ac1f-94ae1183b923 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4/os-volume_attachments/2a59853e-a995-4fb6-84d4-efada9d0e077" status: 202 len: 0 microversion: 2.1 time: 0.303775 Aug 25 06:12:48.615284 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1279/2524] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 25 06:12:48 2021] DELETE /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4/os-volume_attachments/2a59853e-a995-4fb6-84d4-efada9d0e077 => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 06:12:48.628224 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3c439b00-b56e-4adb-9d7c-e1a5b5c6520a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:48.630114 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3c439b00-b56e-4adb-9d7c-e1a5b5c6520a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 1dbeec7e-00ca-4437-8756-60ccd1fd05e4] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:48.640410 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3c439b00-b56e-4adb-9d7c-e1a5b5c6520a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:48.643488 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3c439b00-b56e-4adb-9d7c-e1a5b5c6520a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:48.643488 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3c439b00-b56e-4adb-9d7c-e1a5b5c6520a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:48.643488 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3c439b00-b56e-4adb-9d7c-e1a5b5c6520a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:48.672646 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3c439b00-b56e-4adb-9d7c-e1a5b5c6520a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051965 Aug 25 06:12:48.673199 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1246/2525] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 06:12:48 2021] GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:12:48.882109 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d4b0bb8a-6e90-44e9-a146-cacea21510ad tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1738287020", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-7372938", "security_groups": [{"name": "tempest-secgroup-smoke-123090279"}], "block_device_mapping_v2": [{"uuid": "6a60e7f7-71ce-4aea-a41f-fbe85b5e00af", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fc0081a5-5e60-4209-8f34-8444a2664985"}]}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:12:48.991312 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.network.neutron [None req-d4b0bb8a-6e90-44e9-a146-cacea21510ad tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] validate_networks() for [('fc0081a5-5e60-4209-8f34-8444a2664985', None, None, None, None, None)] {{(pid=108885) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 25 06:12:49.371394 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-d4b0bb8a-6e90-44e9-a146-cacea21510ad tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Flavor limits 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 06:12:49.371968 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-d4b0bb8a-6e90-44e9-a146-cacea21510ad tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Image limits 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 06:12:49.372252 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-d4b0bb8a-6e90-44e9-a146-cacea21510ad tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Flavor pref 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 06:12:49.372649 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-d4b0bb8a-6e90-44e9-a146-cacea21510ad tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Image pref 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 06:12:49.373113 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-d4b0bb8a-6e90-44e9-a146-cacea21510ad tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 06:12:49.382509 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d4b0bb8a-6e90-44e9-a146-cacea21510ad tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:49.390089 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d4b0bb8a-6e90-44e9-a146-cacea21510ad tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:49.390089 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d4b0bb8a-6e90-44e9-a146-cacea21510ad tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:49.390089 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d4b0bb8a-6e90-44e9-a146-cacea21510ad tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:49.400484 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.quota [None req-d4b0bb8a-6e90-44e9-a146-cacea21510ad tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Getting quotas for project 8b15de72ab1c4793bb72e45a48d7e893. Resources: {'ram', 'cores', 'instances'} {{(pid=108885) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 06:12:49.404318 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.quota [None req-d4b0bb8a-6e90-44e9-a146-cacea21510ad tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Getting quotas for user eab9d592e3d649bd8faa4a9e6081a14a and project 8b15de72ab1c4793bb72e45a48d7e893. Resources: {'ram', 'cores', 'instances'} {{(pid=108885) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 06:12:49.467622 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d4b0bb8a-6e90-44e9-a146-cacea21510ad tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Going to run 1 instances... {{(pid=108885) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 25 06:12:49.470229 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d4b0bb8a-6e90-44e9-a146-cacea21510ad tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 9d9f8dc3-f9d4-4a88-8256-b1610447efbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6a60e7f7-71ce-4aea-a41f-fbe85b5e00af',volume_size=None,volume_type=None)] {{(pid=108885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 25 06:12:49.684727 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-794f103d-8ac7-4bba-afc8-6b2830cec4de tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:49.685686 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-794f103d-8ac7-4bba-afc8-6b2830cec4de tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 1dbeec7e-00ca-4437-8756-60ccd1fd05e4] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:49.691840 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-794f103d-8ac7-4bba-afc8-6b2830cec4de tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:49.692303 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-794f103d-8ac7-4bba-afc8-6b2830cec4de tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:49.694128 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-794f103d-8ac7-4bba-afc8-6b2830cec4de tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:49.694128 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-794f103d-8ac7-4bba-afc8-6b2830cec4de tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:49.724720 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-794f103d-8ac7-4bba-afc8-6b2830cec4de tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043766 Aug 25 06:12:49.725282 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1247/2526] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 06:12:49 2021] GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 06:12:49.867816 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d4b0bb8a-6e90-44e9-a146-cacea21510ad tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.989632 Aug 25 06:12:49.868552 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1280/2527] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 25 06:12:48 2021] POST /compute/v2.1/servers => generated 405 bytes in 991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 06:12:49.879274 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8552b71a-8d1b-4269-9e61-37449858b114 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:49.879905 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8552b71a-8d1b-4269-9e61-37449858b114 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 9d9f8dc3-f9d4-4a88-8256-b1610447efbe] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:49.939838 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-8552b71a-8d1b-4269-9e61-37449858b114 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:12:49.947084 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8552b71a-8d1b-4269-9e61-37449858b114 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe" status: 200 len: 1092 microversion: 2.1 time: 0.072664 Aug 25 06:12:49.947659 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1248/2528] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:12:49 2021] GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe => generated 1092 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:12:50.737303 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-bf9dfe64-2d22-4d66-b3e8-4673d1eb39d3 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:50.738291 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-bf9dfe64-2d22-4d66-b3e8-4673d1eb39d3 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 1dbeec7e-00ca-4437-8756-60ccd1fd05e4] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:50.744728 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bf9dfe64-2d22-4d66-b3e8-4673d1eb39d3 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:50.745164 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bf9dfe64-2d22-4d66-b3e8-4673d1eb39d3 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:50.745968 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bf9dfe64-2d22-4d66-b3e8-4673d1eb39d3 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:50.746397 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bf9dfe64-2d22-4d66-b3e8-4673d1eb39d3 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:50.776579 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-bf9dfe64-2d22-4d66-b3e8-4673d1eb39d3 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043146 Aug 25 06:12:50.777124 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1281/2529] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 06:12:50 2021] GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 06:12:50.964287 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a595f15d-a44f-4889-bcf3-2a637022838f tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:50.964951 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a595f15d-a44f-4889-bcf3-2a637022838f tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 9d9f8dc3-f9d4-4a88-8256-b1610447efbe] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:50.971809 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a595f15d-a44f-4889-bcf3-2a637022838f tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:50.972250 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a595f15d-a44f-4889-bcf3-2a637022838f tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:50.973077 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a595f15d-a44f-4889-bcf3-2a637022838f tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:50.973498 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a595f15d-a44f-4889-bcf3-2a637022838f tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:51.035158 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-a595f15d-a44f-4889-bcf3-2a637022838f tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:12:51.043442 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a595f15d-a44f-4889-bcf3-2a637022838f tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe" status: 200 len: 1142 microversion: 2.1 time: 0.083341 Aug 25 06:12:51.044089 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1249/2530] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:12:50 2021] GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe => generated 1142 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:12:52.059986 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-0adb1879-f8e8-4073-8a1a-a5cfc6f6326d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:52.060697 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-0adb1879-f8e8-4073-8a1a-a5cfc6f6326d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 9d9f8dc3-f9d4-4a88-8256-b1610447efbe] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:52.066873 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0adb1879-f8e8-4073-8a1a-a5cfc6f6326d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:52.068957 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0adb1879-f8e8-4073-8a1a-a5cfc6f6326d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:52.068957 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0adb1879-f8e8-4073-8a1a-a5cfc6f6326d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:52.068957 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0adb1879-f8e8-4073-8a1a-a5cfc6f6326d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:52.119096 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d7c23498-5bda-40b9-9f5b-8f6f7cd9aaa4 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:52.119927 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-d7c23498-5bda-40b9-9f5b-8f6f7cd9aaa4 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 1dbeec7e-00ca-4437-8756-60ccd1fd05e4] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:52.126495 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d7c23498-5bda-40b9-9f5b-8f6f7cd9aaa4 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:52.127280 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d7c23498-5bda-40b9-9f5b-8f6f7cd9aaa4 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:52.128267 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d7c23498-5bda-40b9-9f5b-8f6f7cd9aaa4 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:52.128784 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d7c23498-5bda-40b9-9f5b-8f6f7cd9aaa4 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:52.139864 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-0adb1879-f8e8-4073-8a1a-a5cfc6f6326d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:12:52.147976 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-0adb1879-f8e8-4073-8a1a-a5cfc6f6326d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe" status: 200 len: 1198 microversion: 2.1 time: 0.091668 Aug 25 06:12:52.148534 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1282/2531] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:12:52 2021] GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe => generated 1198 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 06:12:52.159972 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-d7c23498-5bda-40b9-9f5b-8f6f7cd9aaa4 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 1dbeec7e-00ca-4437-8756-60ccd1fd05e4] Going to try to terminate instance {{(pid=108884) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 25 06:12:52.529415 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d7c23498-5bda-40b9-9f5b-8f6f7cd9aaa4 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4" status: 204 len: 0 microversion: 2.1 time: 0.413541 Aug 25 06:12:52.530254 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1250/2532] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 25 06:12:52 2021] DELETE /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 06:12:52.543892 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-8770bce0-0702-4bc2-b8f9-f470f97dc089 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:52.543892 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-8770bce0-0702-4bc2-b8f9-f470f97dc089 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 1dbeec7e-00ca-4437-8756-60ccd1fd05e4] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:52.546199 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8770bce0-0702-4bc2-b8f9-f470f97dc089 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:52.546679 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8770bce0-0702-4bc2-b8f9-f470f97dc089 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:52.547455 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8770bce0-0702-4bc2-b8f9-f470f97dc089 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:52.547894 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8770bce0-0702-4bc2-b8f9-f470f97dc089 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:52.679683 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-8770bce0-0702-4bc2-b8f9-f470f97dc089 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:12:52.688572 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-8770bce0-0702-4bc2-b8f9-f470f97dc089 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4" status: 200 len: 1515 microversion: 2.1 time: 0.154049 Aug 25 06:12:52.689148 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1283/2533] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:12:52 2021] GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:12:53.165576 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1bcfb10d-0625-4d40-97dc-776c2e75517e tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:53.167260 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1bcfb10d-0625-4d40-97dc-776c2e75517e tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 9d9f8dc3-f9d4-4a88-8256-b1610447efbe] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:53.173257 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1bcfb10d-0625-4d40-97dc-776c2e75517e tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:53.177152 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1bcfb10d-0625-4d40-97dc-776c2e75517e tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:53.177152 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1bcfb10d-0625-4d40-97dc-776c2e75517e tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:53.177152 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1bcfb10d-0625-4d40-97dc-776c2e75517e tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:53.318893 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-1bcfb10d-0625-4d40-97dc-776c2e75517e tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:12:53.331581 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1bcfb10d-0625-4d40-97dc-776c2e75517e tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe" status: 200 len: 1275 microversion: 2.1 time: 0.169951 Aug 25 06:12:53.332152 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1251/2534] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:12:53 2021] GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe => generated 1275 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:12:53.623099 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [req-50d5491e-7b7f-4aee-b6a8-468cdfb19fe9 req-792b4083-3b2a-4a17-9a33-f17d4d813a3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d9f8dc3-f9d4-4a88-8256-b1610447efbe", "tag": "4cce5795-f55b-496e-be3e-0c2d69f9ab93"}]} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:12:53.624931 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 06:12:53.624931 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: warnings.warn(msg) Aug 25 06:12:53.632159 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-50d5491e-7b7f-4aee-b6a8-468cdfb19fe9 req-792b4083-3b2a-4a17-9a33-f17d4d813a3b service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:53.632943 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-50d5491e-7b7f-4aee-b6a8-468cdfb19fe9 req-792b4083-3b2a-4a17-9a33-f17d4d813a3b service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:53.644731 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.compute.server_external_events [req-50d5491e-7b7f-4aee-b6a8-468cdfb19fe9 req-792b4083-3b2a-4a17-9a33-f17d4d813a3b service nova] Creating event network-changed:4cce5795-f55b-496e-be3e-0c2d69f9ab93 for instance 9d9f8dc3-f9d4-4a88-8256-b1610447efbe on hv-cinder-78662 Aug 25 06:12:53.649733 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [req-50d5491e-7b7f-4aee-b6a8-468cdfb19fe9 req-792b4083-3b2a-4a17-9a33-f17d4d813a3b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031089 Aug 25 06:12:53.650361 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1284/2535] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 06:12:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 06:12:53.705971 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-cf16139c-541b-4c97-abb5-9acd25ef7b01 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:53.706701 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-cf16139c-541b-4c97-abb5-9acd25ef7b01 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 1dbeec7e-00ca-4437-8756-60ccd1fd05e4] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:53.712890 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cf16139c-541b-4c97-abb5-9acd25ef7b01 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:53.713663 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cf16139c-541b-4c97-abb5-9acd25ef7b01 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:53.718098 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cf16139c-541b-4c97-abb5-9acd25ef7b01 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:53.718098 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cf16139c-541b-4c97-abb5-9acd25ef7b01 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:53.854884 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-cf16139c-541b-4c97-abb5-9acd25ef7b01 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:12:53.862354 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-cf16139c-541b-4c97-abb5-9acd25ef7b01 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4" status: 200 len: 1515 microversion: 2.1 time: 0.160402 Aug 25 06:12:53.862933 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1252/2536] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:12:53 2021] GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:12:54.350811 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-4f18fdb3-9091-4806-9c04-3ca2e8ddf321 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:54.351512 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-4f18fdb3-9091-4806-9c04-3ca2e8ddf321 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 9d9f8dc3-f9d4-4a88-8256-b1610447efbe] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:54.360000 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4f18fdb3-9091-4806-9c04-3ca2e8ddf321 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:54.360490 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4f18fdb3-9091-4806-9c04-3ca2e8ddf321 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:54.361282 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4f18fdb3-9091-4806-9c04-3ca2e8ddf321 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:54.361746 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4f18fdb3-9091-4806-9c04-3ca2e8ddf321 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:54.506442 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-4f18fdb3-9091-4806-9c04-3ca2e8ddf321 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:12:54.516574 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-4f18fdb3-9091-4806-9c04-3ca2e8ddf321 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe" status: 200 len: 1263 microversion: 2.1 time: 0.169846 Aug 25 06:12:54.517468 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1285/2537] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:12:54 2021] GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe => generated 1263 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:12:54.879721 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ae7180ac-7b94-4995-8aa8-6b7280679b1b tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:54.880341 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ae7180ac-7b94-4995-8aa8-6b7280679b1b tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 1dbeec7e-00ca-4437-8756-60ccd1fd05e4] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:54.887102 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ae7180ac-7b94-4995-8aa8-6b7280679b1b tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:54.887575 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ae7180ac-7b94-4995-8aa8-6b7280679b1b tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:54.888339 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ae7180ac-7b94-4995-8aa8-6b7280679b1b tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:54.888767 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ae7180ac-7b94-4995-8aa8-6b7280679b1b tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:55.013639 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ae7180ac-7b94-4995-8aa8-6b7280679b1b tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:12:55.021676 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ae7180ac-7b94-4995-8aa8-6b7280679b1b tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4" status: 200 len: 1515 microversion: 2.1 time: 0.145625 Aug 25 06:12:55.022253 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1253/2538] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:12:54 2021] GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4 => generated 1515 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 06:12:55.535016 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-3b319292-01c0-47a3-843b-74ce37ef3e45 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:55.535621 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-3b319292-01c0-47a3-843b-74ce37ef3e45 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 9d9f8dc3-f9d4-4a88-8256-b1610447efbe] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:55.542366 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3b319292-01c0-47a3-843b-74ce37ef3e45 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:55.542827 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3b319292-01c0-47a3-843b-74ce37ef3e45 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:55.543577 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3b319292-01c0-47a3-843b-74ce37ef3e45 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:55.544006 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-3b319292-01c0-47a3-843b-74ce37ef3e45 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:55.670631 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [req-5fd02d01-e9a4-4ecb-9113-118fd415f045 req-05e83752-3efc-401d-918c-cb1e8272a019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dbeec7e-00ca-4437-8756-60ccd1fd05e4", "name": "network-vif-deleted", "tag": "f2ec86a6-d2b1-4fc9-9a3c-381a6b76ec46"}]} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:12:55.672457 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 06:12:55.672457 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: warnings.warn(msg) Aug 25 06:12:55.673593 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-3b319292-01c0-47a3-843b-74ce37ef3e45 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:12:55.681061 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-5fd02d01-e9a4-4ecb-9113-118fd415f045 req-05e83752-3efc-401d-918c-cb1e8272a019 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:55.681796 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-5fd02d01-e9a4-4ecb-9113-118fd415f045 req-05e83752-3efc-401d-918c-cb1e8272a019 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:55.683394 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-3b319292-01c0-47a3-843b-74ce37ef3e45 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe" status: 200 len: 1263 microversion: 2.1 time: 0.152077 Aug 25 06:12:55.683978 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1286/2539] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:12:55 2021] GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:12:55.696847 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.compute.server_external_events [req-5fd02d01-e9a4-4ecb-9113-118fd415f045 req-05e83752-3efc-401d-918c-cb1e8272a019 service nova] Creating event network-vif-deleted:f2ec86a6-d2b1-4fc9-9a3c-381a6b76ec46 for instance 1dbeec7e-00ca-4437-8756-60ccd1fd05e4 on hv-cinder-78662 Aug 25 06:12:55.702154 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [req-5fd02d01-e9a4-4ecb-9113-118fd415f045 req-05e83752-3efc-401d-918c-cb1e8272a019 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041124 Aug 25 06:12:55.703206 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1254/2540] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 06:12:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:12:56.038659 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6e793627-c22b-44aa-9354-81bc405787a2 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:56.039258 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6e793627-c22b-44aa-9354-81bc405787a2 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 1dbeec7e-00ca-4437-8756-60ccd1fd05e4] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:56.046047 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6e793627-c22b-44aa-9354-81bc405787a2 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:56.046487 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6e793627-c22b-44aa-9354-81bc405787a2 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:56.047242 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6e793627-c22b-44aa-9354-81bc405787a2 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:56.047745 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6e793627-c22b-44aa-9354-81bc405787a2 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:56.079385 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6e793627-c22b-44aa-9354-81bc405787a2 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:56.079825 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6e793627-c22b-44aa-9354-81bc405787a2 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:56.080299 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.objects.instance [None req-6e793627-c22b-44aa-9354-81bc405787a2 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lazy-loading 'fault' on Instance uuid 1dbeec7e-00ca-4437-8756-60ccd1fd05e4 {{(pid=108885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 06:12:56.120467 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-6e793627-c22b-44aa-9354-81bc405787a2 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:12:56.127606 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6e793627-c22b-44aa-9354-81bc405787a2 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4" status: 200 len: 1308 microversion: 2.1 time: 0.092623 Aug 25 06:12:56.128168 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1287/2541] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:12:56 2021] GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4 => generated 1308 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:12:56.701151 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-273568e1-07d6-43e5-a9d8-e605b58965b6 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:56.701789 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-273568e1-07d6-43e5-a9d8-e605b58965b6 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 9d9f8dc3-f9d4-4a88-8256-b1610447efbe] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:56.708073 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-273568e1-07d6-43e5-a9d8-e605b58965b6 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:56.708509 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-273568e1-07d6-43e5-a9d8-e605b58965b6 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:56.709256 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-273568e1-07d6-43e5-a9d8-e605b58965b6 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:56.709788 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-273568e1-07d6-43e5-a9d8-e605b58965b6 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:56.829141 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-273568e1-07d6-43e5-a9d8-e605b58965b6 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:12:56.836256 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-273568e1-07d6-43e5-a9d8-e605b58965b6 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe" status: 200 len: 1263 microversion: 2.1 time: 0.139657 Aug 25 06:12:56.836830 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1255/2542] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:12:56 2021] GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe => generated 1263 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:12:57.144806 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2b87d9c0-2246-4185-abcd-b607f32ffdf3 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:57.145425 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2b87d9c0-2246-4185-abcd-b607f32ffdf3 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 1dbeec7e-00ca-4437-8756-60ccd1fd05e4] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:57.151320 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2b87d9c0-2246-4185-abcd-b607f32ffdf3 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:57.151768 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2b87d9c0-2246-4185-abcd-b607f32ffdf3 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:57.152527 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2b87d9c0-2246-4185-abcd-b607f32ffdf3 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:57.152963 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2b87d9c0-2246-4185-abcd-b607f32ffdf3 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:57.166296 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.wsgi [None req-2b87d9c0-2246-4185-abcd-b607f32ffdf3 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] HTTP exception thrown: Instance 1dbeec7e-00ca-4437-8756-60ccd1fd05e4 could not be found. Aug 25 06:12:57.166886 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2b87d9c0-2246-4185-abcd-b607f32ffdf3 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Returning 404 to user: Instance 1dbeec7e-00ca-4437-8756-60ccd1fd05e4 could not be found. {{(pid=108885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 06:12:57.167697 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2b87d9c0-2246-4185-abcd-b607f32ffdf3 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4" status: 404 len: 111 microversion: 2.1 time: 0.026564 Aug 25 06:12:57.168215 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1288/2543] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:12:57 2021] GET /compute/v2.1/servers/1dbeec7e-00ca-4437-8756-60ccd1fd05e4 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 06:12:57.855378 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7fc5d343-3173-435d-999d-eb7dfb0c0bee tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:57.855986 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7fc5d343-3173-435d-999d-eb7dfb0c0bee tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 9d9f8dc3-f9d4-4a88-8256-b1610447efbe] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:57.861719 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7fc5d343-3173-435d-999d-eb7dfb0c0bee tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:57.862160 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7fc5d343-3173-435d-999d-eb7dfb0c0bee tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:57.862905 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7fc5d343-3173-435d-999d-eb7dfb0c0bee tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:57.863329 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7fc5d343-3173-435d-999d-eb7dfb0c0bee tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:57.986691 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-7fc5d343-3173-435d-999d-eb7dfb0c0bee tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:12:57.994566 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7fc5d343-3173-435d-999d-eb7dfb0c0bee tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe" status: 200 len: 1263 microversion: 2.1 time: 0.141995 Aug 25 06:12:57.995131 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1256/2544] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:12:57 2021] GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe => generated 1263 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:12:58.438667 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-fea2e07d-1448-4045-884f-7e353ffce091 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:58.439156 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-fea2e07d-1448-4045-884f-7e353ffce091 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4c22fa01-c624-4f0c-89ba-d1c30eee7c39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:58.444909 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fea2e07d-1448-4045-884f-7e353ffce091 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:58.445350 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fea2e07d-1448-4045-884f-7e353ffce091 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:58.446141 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fea2e07d-1448-4045-884f-7e353ffce091 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:58.447108 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fea2e07d-1448-4045-884f-7e353ffce091 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:58.472859 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-fea2e07d-1448-4045-884f-7e353ffce091 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4c22fa01-c624-4f0c-89ba-d1c30eee7c39] Going to try to terminate instance {{(pid=108885) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 25 06:12:58.792107 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-fea2e07d-1448-4045-884f-7e353ffce091 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39" status: 204 len: 0 microversion: 2.1 time: 0.356750 Aug 25 06:12:58.792723 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1289/2545] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 25 06:12:58 2021] DELETE /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 06:12:58.800555 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-bdd75f0c-252a-487c-86b5-da5751954116 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:58.805317 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-bdd75f0c-252a-487c-86b5-da5751954116 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4c22fa01-c624-4f0c-89ba-d1c30eee7c39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:58.807668 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bdd75f0c-252a-487c-86b5-da5751954116 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:58.808115 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bdd75f0c-252a-487c-86b5-da5751954116 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:58.808882 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bdd75f0c-252a-487c-86b5-da5751954116 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:58.809315 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bdd75f0c-252a-487c-86b5-da5751954116 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:58.929978 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-bdd75f0c-252a-487c-86b5-da5751954116 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:12:58.938098 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-bdd75f0c-252a-487c-86b5-da5751954116 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39" status: 200 len: 1513 microversion: 2.1 time: 0.141196 Aug 25 06:12:58.938658 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1257/2546] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:12:58 2021] GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39 => generated 1513 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:12:59.011689 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-13f0cf43-41ee-4640-aa03-a4a777cfed61 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:59.017251 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-13f0cf43-41ee-4640-aa03-a4a777cfed61 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 9d9f8dc3-f9d4-4a88-8256-b1610447efbe] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:59.018267 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-13f0cf43-41ee-4640-aa03-a4a777cfed61 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:59.018766 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-13f0cf43-41ee-4640-aa03-a4a777cfed61 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:59.019482 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-13f0cf43-41ee-4640-aa03-a4a777cfed61 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:59.019920 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-13f0cf43-41ee-4640-aa03-a4a777cfed61 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:59.142149 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-13f0cf43-41ee-4640-aa03-a4a777cfed61 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:12:59.149349 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-13f0cf43-41ee-4640-aa03-a4a777cfed61 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe" status: 200 len: 1263 microversion: 2.1 time: 0.141743 Aug 25 06:12:59.149981 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1290/2547] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:12:59 2021] GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe => generated 1263 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:12:59.954971 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-63ae9688-7394-4b55-96cc-528c54a2e2a4 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:12:59.955501 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-63ae9688-7394-4b55-96cc-528c54a2e2a4 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4c22fa01-c624-4f0c-89ba-d1c30eee7c39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:12:59.961397 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-63ae9688-7394-4b55-96cc-528c54a2e2a4 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:59.961868 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-63ae9688-7394-4b55-96cc-528c54a2e2a4 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:12:59.963202 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-63ae9688-7394-4b55-96cc-528c54a2e2a4 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:12:59.963634 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-63ae9688-7394-4b55-96cc-528c54a2e2a4 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:00.086677 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-63ae9688-7394-4b55-96cc-528c54a2e2a4 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:13:00.095364 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-63ae9688-7394-4b55-96cc-528c54a2e2a4 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39" status: 200 len: 1513 microversion: 2.1 time: 0.144162 Aug 25 06:13:00.095929 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1258/2548] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:12:59 2021] GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39 => generated 1513 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:13:00.166393 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-351c725c-5b23-4b5f-af7d-a76e91491270 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:13:00.167012 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-351c725c-5b23-4b5f-af7d-a76e91491270 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 9d9f8dc3-f9d4-4a88-8256-b1610447efbe] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:13:00.172794 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-351c725c-5b23-4b5f-af7d-a76e91491270 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:00.173221 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-351c725c-5b23-4b5f-af7d-a76e91491270 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:00.174022 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-351c725c-5b23-4b5f-af7d-a76e91491270 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:00.174455 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-351c725c-5b23-4b5f-af7d-a76e91491270 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:00.317058 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-351c725c-5b23-4b5f-af7d-a76e91491270 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:13:00.325413 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-351c725c-5b23-4b5f-af7d-a76e91491270 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe" status: 200 len: 1263 microversion: 2.1 time: 0.163177 Aug 25 06:13:00.326070 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1291/2549] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:13:00 2021] GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe => generated 1263 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:13:01.112438 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d2fb549a-bab4-4f5d-a14c-94cd689d5cad tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:13:01.113044 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-d2fb549a-bab4-4f5d-a14c-94cd689d5cad tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4c22fa01-c624-4f0c-89ba-d1c30eee7c39] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:13:01.120412 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d2fb549a-bab4-4f5d-a14c-94cd689d5cad tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:01.120872 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d2fb549a-bab4-4f5d-a14c-94cd689d5cad tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:01.121661 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d2fb549a-bab4-4f5d-a14c-94cd689d5cad tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:01.122365 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d2fb549a-bab4-4f5d-a14c-94cd689d5cad tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:01.191635 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [req-4b964d41-6fd0-4031-a3dd-3f0819ad46ca req-a872df6f-ff43-4162-938f-4da58dbcbf09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c22fa01-c624-4f0c-89ba-d1c30eee7c39", "name": "network-vif-deleted", "tag": "80bf6de9-c015-42b2-aa88-81a08fa39fd9"}]} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:13:01.193815 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 06:13:01.193815 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: warnings.warn(msg) Aug 25 06:13:01.203194 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-d2fb549a-bab4-4f5d-a14c-94cd689d5cad tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:13:01.207659 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-4b964d41-6fd0-4031-a3dd-3f0819ad46ca req-a872df6f-ff43-4162-938f-4da58dbcbf09 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:01.208299 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-4b964d41-6fd0-4031-a3dd-3f0819ad46ca req-a872df6f-ff43-4162-938f-4da58dbcbf09 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:01.209592 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d2fb549a-bab4-4f5d-a14c-94cd689d5cad tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39" status: 200 len: 1471 microversion: 2.1 time: 0.100790 Aug 25 06:13:01.219211 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1259/2550] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:13:01 2021] GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39 => generated 1471 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 06:13:01.220270 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.compute.server_external_events [req-4b964d41-6fd0-4031-a3dd-3f0819ad46ca req-a872df6f-ff43-4162-938f-4da58dbcbf09 service nova] Creating event network-vif-deleted:80bf6de9-c015-42b2-aa88-81a08fa39fd9 for instance 4c22fa01-c624-4f0c-89ba-d1c30eee7c39 on hv-cinder-78662 Aug 25 06:13:01.225254 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [req-4b964d41-6fd0-4031-a3dd-3f0819ad46ca req-a872df6f-ff43-4162-938f-4da58dbcbf09 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037460 Aug 25 06:13:01.225874 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1292/2551] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 06:13:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 06:13:01.343201 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ba01176b-77e3-4329-91ff-3398b50a58b8 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:13:01.343947 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ba01176b-77e3-4329-91ff-3398b50a58b8 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 9d9f8dc3-f9d4-4a88-8256-b1610447efbe] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:13:01.350858 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ba01176b-77e3-4329-91ff-3398b50a58b8 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:01.351391 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ba01176b-77e3-4329-91ff-3398b50a58b8 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:01.352179 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ba01176b-77e3-4329-91ff-3398b50a58b8 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:01.353127 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ba01176b-77e3-4329-91ff-3398b50a58b8 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:01.482569 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ba01176b-77e3-4329-91ff-3398b50a58b8 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:13:01.489948 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ba01176b-77e3-4329-91ff-3398b50a58b8 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe" status: 200 len: 1263 microversion: 2.1 time: 0.151340 Aug 25 06:13:01.490505 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1260/2552] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:13:01 2021] GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 06:13:02.229315 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-4aa97fc6-cbfb-4022-b1c9-2677af20b476 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:13:02.230135 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-4aa97fc6-cbfb-4022-b1c9-2677af20b476 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4c22fa01-c624-4f0c-89ba-d1c30eee7c39] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:13:02.238468 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4aa97fc6-cbfb-4022-b1c9-2677af20b476 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:02.238914 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4aa97fc6-cbfb-4022-b1c9-2677af20b476 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:02.239873 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4aa97fc6-cbfb-4022-b1c9-2677af20b476 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:02.240561 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-4aa97fc6-cbfb-4022-b1c9-2677af20b476 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:02.256191 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.wsgi [None req-4aa97fc6-cbfb-4022-b1c9-2677af20b476 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] HTTP exception thrown: Instance 4c22fa01-c624-4f0c-89ba-d1c30eee7c39 could not be found. Aug 25 06:13:02.257896 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-4aa97fc6-cbfb-4022-b1c9-2677af20b476 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Returning 404 to user: Instance 4c22fa01-c624-4f0c-89ba-d1c30eee7c39 could not be found. {{(pid=108885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 06:13:02.258325 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-4aa97fc6-cbfb-4022-b1c9-2677af20b476 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39" status: 404 len: 111 microversion: 2.1 time: 0.034586 Aug 25 06:13:02.259299 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1293/2553] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:13:02 2021] GET /compute/v2.1/servers/4c22fa01-c624-4f0c-89ba-d1c30eee7c39 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 06:13:02.267888 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3d3baf51-f8a1-4b72-bd97-b6df0343b763 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:13:02.268511 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3d3baf51-f8a1-4b72-bd97-b6df0343b763 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 68d57b0b-4d9e-415d-8f2a-96f25c3f19af] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:13:02.276222 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3d3baf51-f8a1-4b72-bd97-b6df0343b763 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:02.280870 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3d3baf51-f8a1-4b72-bd97-b6df0343b763 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:02.280870 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3d3baf51-f8a1-4b72-bd97-b6df0343b763 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:02.280870 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3d3baf51-f8a1-4b72-bd97-b6df0343b763 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:02.304542 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3d3baf51-f8a1-4b72-bd97-b6df0343b763 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 68d57b0b-4d9e-415d-8f2a-96f25c3f19af] Going to try to terminate instance {{(pid=108884) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 25 06:13:02.506548 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-632180ac-46fc-43ae-970e-b831cc5b2953 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:13:02.507330 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-632180ac-46fc-43ae-970e-b831cc5b2953 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 9d9f8dc3-f9d4-4a88-8256-b1610447efbe] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:13:02.513580 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-632180ac-46fc-43ae-970e-b831cc5b2953 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:02.514030 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-632180ac-46fc-43ae-970e-b831cc5b2953 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:02.514854 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-632180ac-46fc-43ae-970e-b831cc5b2953 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:02.515291 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-632180ac-46fc-43ae-970e-b831cc5b2953 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:02.534089 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3d3baf51-f8a1-4b72-bd97-b6df0343b763 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "DELETE /compute/v2.1/servers/68d57b0b-4d9e-415d-8f2a-96f25c3f19af" status: 204 len: 0 microversion: 2.1 time: 0.269602 Aug 25 06:13:02.534875 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1261/2554] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 25 06:13:02 2021] DELETE /compute/v2.1/servers/68d57b0b-4d9e-415d-8f2a-96f25c3f19af => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 06:13:02.543767 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a8eed045-aa05-4636-b585-2f40091b68f4 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:13:02.544450 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a8eed045-aa05-4636-b585-2f40091b68f4 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 68d57b0b-4d9e-415d-8f2a-96f25c3f19af] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:13:02.551146 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a8eed045-aa05-4636-b585-2f40091b68f4 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:02.551590 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a8eed045-aa05-4636-b585-2f40091b68f4 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:02.552376 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a8eed045-aa05-4636-b585-2f40091b68f4 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:02.552801 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a8eed045-aa05-4636-b585-2f40091b68f4 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:02.678969 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-632180ac-46fc-43ae-970e-b831cc5b2953 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:13:02.686802 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-632180ac-46fc-43ae-970e-b831cc5b2953 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe" status: 200 len: 1263 microversion: 2.1 time: 0.184121 Aug 25 06:13:02.687574 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1294/2555] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:13:02 2021] GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe => generated 1263 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 06:13:02.718541 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-a8eed045-aa05-4636-b585-2f40091b68f4 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:13:02.726811 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a8eed045-aa05-4636-b585-2f40091b68f4 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/68d57b0b-4d9e-415d-8f2a-96f25c3f19af" status: 200 len: 1512 microversion: 2.1 time: 0.187626 Aug 25 06:13:02.727398 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1262/2556] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:13:02 2021] GET /compute/v2.1/servers/68d57b0b-4d9e-415d-8f2a-96f25c3f19af => generated 1512 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 06:13:03.703517 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6c08e8d0-8cd7-4ad4-a944-0a722072c123 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:13:03.704120 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6c08e8d0-8cd7-4ad4-a944-0a722072c123 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 9d9f8dc3-f9d4-4a88-8256-b1610447efbe] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:13:03.709881 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6c08e8d0-8cd7-4ad4-a944-0a722072c123 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:03.710320 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6c08e8d0-8cd7-4ad4-a944-0a722072c123 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:03.711066 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6c08e8d0-8cd7-4ad4-a944-0a722072c123 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:03.711494 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6c08e8d0-8cd7-4ad4-a944-0a722072c123 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:03.744087 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-2b8d61b5-c1f1-4e45-b723-1ab2d755234a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:13:03.744910 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-2b8d61b5-c1f1-4e45-b723-1ab2d755234a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 68d57b0b-4d9e-415d-8f2a-96f25c3f19af] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:13:03.751672 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2b8d61b5-c1f1-4e45-b723-1ab2d755234a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:03.752117 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2b8d61b5-c1f1-4e45-b723-1ab2d755234a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:03.752880 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2b8d61b5-c1f1-4e45-b723-1ab2d755234a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:03.753313 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2b8d61b5-c1f1-4e45-b723-1ab2d755234a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:03.863257 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-6c08e8d0-8cd7-4ad4-a944-0a722072c123 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:13:03.871178 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6c08e8d0-8cd7-4ad4-a944-0a722072c123 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe" status: 200 len: 1263 microversion: 2.1 time: 0.171330 Aug 25 06:13:03.871737 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1295/2557] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:13:03 2021] GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe => generated 1263 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:13:03.927663 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-2b8d61b5-c1f1-4e45-b723-1ab2d755234a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:13:03.935727 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-2b8d61b5-c1f1-4e45-b723-1ab2d755234a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/68d57b0b-4d9e-415d-8f2a-96f25c3f19af" status: 200 len: 1512 microversion: 2.1 time: 0.195581 Aug 25 06:13:03.936289 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1263/2558] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:13:03 2021] GET /compute/v2.1/servers/68d57b0b-4d9e-415d-8f2a-96f25c3f19af => generated 1512 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 06:13:04.813978 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [req-9c223220-146a-4e43-a290-494139ed4e27 req-e7f265ad-d522-4a6b-aa4f-18e2faa2981f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68d57b0b-4d9e-415d-8f2a-96f25c3f19af", "name": "network-vif-deleted", "tag": "b3ffe0c7-ba8e-43ea-96a7-818803c5542c"}]} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:13:04.815631 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 06:13:04.815631 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: warnings.warn(msg) Aug 25 06:13:04.823385 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-9c223220-146a-4e43-a290-494139ed4e27 req-e7f265ad-d522-4a6b-aa4f-18e2faa2981f service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:04.824608 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-9c223220-146a-4e43-a290-494139ed4e27 req-e7f265ad-d522-4a6b-aa4f-18e2faa2981f service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:04.837553 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.compute.server_external_events [req-9c223220-146a-4e43-a290-494139ed4e27 req-e7f265ad-d522-4a6b-aa4f-18e2faa2981f service nova] Creating event network-vif-deleted:b3ffe0c7-ba8e-43ea-96a7-818803c5542c for instance 68d57b0b-4d9e-415d-8f2a-96f25c3f19af on hv-cinder-78662 Aug 25 06:13:04.842825 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [req-9c223220-146a-4e43-a290-494139ed4e27 req-e7f265ad-d522-4a6b-aa4f-18e2faa2981f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032738 Aug 25 06:13:04.843429 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1296/2559] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 06:13:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:13:04.888579 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8eb58b2b-d6c2-44a5-b11a-e00a9be188b7 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:13:04.889342 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8eb58b2b-d6c2-44a5-b11a-e00a9be188b7 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 9d9f8dc3-f9d4-4a88-8256-b1610447efbe] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:13:04.895371 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8eb58b2b-d6c2-44a5-b11a-e00a9be188b7 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:04.895808 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8eb58b2b-d6c2-44a5-b11a-e00a9be188b7 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:04.896578 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8eb58b2b-d6c2-44a5-b11a-e00a9be188b7 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:04.897069 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8eb58b2b-d6c2-44a5-b11a-e00a9be188b7 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:04.953676 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e8609b80-5f12-41e8-aaf1-35a5bdaa5a23 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:13:04.954433 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e8609b80-5f12-41e8-aaf1-35a5bdaa5a23 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 68d57b0b-4d9e-415d-8f2a-96f25c3f19af] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:13:04.961365 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e8609b80-5f12-41e8-aaf1-35a5bdaa5a23 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:04.962062 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e8609b80-5f12-41e8-aaf1-35a5bdaa5a23 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:04.963762 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e8609b80-5f12-41e8-aaf1-35a5bdaa5a23 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:04.964475 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e8609b80-5f12-41e8-aaf1-35a5bdaa5a23 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:05.292730 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-e8609b80-5f12-41e8-aaf1-35a5bdaa5a23 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:13:05.300199 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e8609b80-5f12-41e8-aaf1-35a5bdaa5a23 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/68d57b0b-4d9e-415d-8f2a-96f25c3f19af" status: 200 len: 1301 microversion: 2.1 time: 0.351493 Aug 25 06:13:05.300849 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1297/2560] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:13:04 2021] GET /compute/v2.1/servers/68d57b0b-4d9e-415d-8f2a-96f25c3f19af => generated 1301 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 06:13:05.320823 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-8eb58b2b-d6c2-44a5-b11a-e00a9be188b7 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:13:05.328396 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8eb58b2b-d6c2-44a5-b11a-e00a9be188b7 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe" status: 200 len: 1263 microversion: 2.1 time: 0.444132 Aug 25 06:13:05.328958 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1264/2561] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:13:04 2021] GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe => generated 1263 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:13:06.316884 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e144b176-aec0-4ac2-bd6c-26314d48bc2c tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:13:06.317504 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-e144b176-aec0-4ac2-bd6c-26314d48bc2c tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 68d57b0b-4d9e-415d-8f2a-96f25c3f19af] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:13:06.324445 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e144b176-aec0-4ac2-bd6c-26314d48bc2c tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:06.324894 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e144b176-aec0-4ac2-bd6c-26314d48bc2c tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:06.325699 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e144b176-aec0-4ac2-bd6c-26314d48bc2c tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:06.326133 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-e144b176-aec0-4ac2-bd6c-26314d48bc2c tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:06.340891 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.wsgi [None req-e144b176-aec0-4ac2-bd6c-26314d48bc2c tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] HTTP exception thrown: Instance 68d57b0b-4d9e-415d-8f2a-96f25c3f19af could not be found. Aug 25 06:13:06.341495 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-e144b176-aec0-4ac2-bd6c-26314d48bc2c tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Returning 404 to user: Instance 68d57b0b-4d9e-415d-8f2a-96f25c3f19af could not be found. {{(pid=108885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 06:13:06.342348 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-e144b176-aec0-4ac2-bd6c-26314d48bc2c tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/68d57b0b-4d9e-415d-8f2a-96f25c3f19af" status: 404 len: 111 microversion: 2.1 time: 0.029227 Aug 25 06:13:06.342934 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1298/2562] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:13:06 2021] GET /compute/v2.1/servers/68d57b0b-4d9e-415d-8f2a-96f25c3f19af => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 06:13:06.346539 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7af0cbf2-1bff-4d7e-868c-b1c54a2d5419 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:13:06.347485 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7af0cbf2-1bff-4d7e-868c-b1c54a2d5419 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 9d9f8dc3-f9d4-4a88-8256-b1610447efbe] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:13:06.354402 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7af0cbf2-1bff-4d7e-868c-b1c54a2d5419 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:06.354848 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7af0cbf2-1bff-4d7e-868c-b1c54a2d5419 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:06.355622 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7af0cbf2-1bff-4d7e-868c-b1c54a2d5419 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:06.356056 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7af0cbf2-1bff-4d7e-868c-b1c54a2d5419 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:06.481434 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-7af0cbf2-1bff-4d7e-868c-b1c54a2d5419 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:13:06.489126 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7af0cbf2-1bff-4d7e-868c-b1c54a2d5419 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe" status: 200 len: 1263 microversion: 2.1 time: 0.146869 Aug 25 06:13:06.489753 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1265/2563] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:13:06 2021] GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe => generated 1263 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 06:13:07.029430 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [req-7487db10-e9db-4be2-bbbc-d6a940565435 req-f0c2e0f4-8784-4404-80cb-7b5df1897026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d9f8dc3-f9d4-4a88-8256-b1610447efbe", "name": "network-vif-plugged", "status": "completed", "tag": "4cce5795-f55b-496e-be3e-0c2d69f9ab93"}]} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:13:07.032046 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 06:13:07.032046 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: warnings.warn(msg) Aug 25 06:13:07.038094 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-7487db10-e9db-4be2-bbbc-d6a940565435 req-f0c2e0f4-8784-4404-80cb-7b5df1897026 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:07.038463 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-7487db10-e9db-4be2-bbbc-d6a940565435 req-f0c2e0f4-8784-4404-80cb-7b5df1897026 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:07.053984 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.compute.server_external_events [req-7487db10-e9db-4be2-bbbc-d6a940565435 req-f0c2e0f4-8784-4404-80cb-7b5df1897026 service nova] Creating event network-vif-plugged:4cce5795-f55b-496e-be3e-0c2d69f9ab93 for instance 9d9f8dc3-f9d4-4a88-8256-b1610447efbe on hv-cinder-78662 Aug 25 06:13:07.061008 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [req-7487db10-e9db-4be2-bbbc-d6a940565435 req-f0c2e0f4-8784-4404-80cb-7b5df1897026 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035171 Aug 25 06:13:07.061647 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1299/2564] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 06:13:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 06:13:07.508077 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-003592c3-194b-4847-a17f-fa1ee554ca1b tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:13:07.508883 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-003592c3-194b-4847-a17f-fa1ee554ca1b tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 9d9f8dc3-f9d4-4a88-8256-b1610447efbe] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:13:07.515177 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-003592c3-194b-4847-a17f-fa1ee554ca1b tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:07.515618 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-003592c3-194b-4847-a17f-fa1ee554ca1b tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:07.516384 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-003592c3-194b-4847-a17f-fa1ee554ca1b tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:07.516814 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-003592c3-194b-4847-a17f-fa1ee554ca1b tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:07.595002 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f0ed375d-2ca5-4a72-a872-6a30316ee72a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:13:07.595594 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f0ed375d-2ca5-4a72-a872-6a30316ee72a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4fee06df-2121-4b1f-af52-6b9ecd1a6eb9] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:13:07.601579 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f0ed375d-2ca5-4a72-a872-6a30316ee72a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:07.602022 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f0ed375d-2ca5-4a72-a872-6a30316ee72a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:07.603567 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f0ed375d-2ca5-4a72-a872-6a30316ee72a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:07.603998 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f0ed375d-2ca5-4a72-a872-6a30316ee72a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:07.628510 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f0ed375d-2ca5-4a72-a872-6a30316ee72a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4fee06df-2121-4b1f-af52-6b9ecd1a6eb9] Going to try to terminate instance {{(pid=108885) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 25 06:13:07.643092 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-003592c3-194b-4847-a17f-fa1ee554ca1b tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:13:07.651160 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-003592c3-194b-4847-a17f-fa1ee554ca1b tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe" status: 200 len: 1263 microversion: 2.1 time: 0.146924 Aug 25 06:13:07.651733 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1266/2565] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:13:07 2021] GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe => generated 1263 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:13:07.939764 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f0ed375d-2ca5-4a72-a872-6a30316ee72a tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9" status: 204 len: 0 microversion: 2.1 time: 0.348264 Aug 25 06:13:07.940529 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1300/2566] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 25 06:13:07 2021] DELETE /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 06:13:07.949555 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-37b4fdb3-e5bb-4a7a-b10f-70afde86d638 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:13:07.950185 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-37b4fdb3-e5bb-4a7a-b10f-70afde86d638 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4fee06df-2121-4b1f-af52-6b9ecd1a6eb9] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:13:07.956145 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-37b4fdb3-e5bb-4a7a-b10f-70afde86d638 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:07.956593 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-37b4fdb3-e5bb-4a7a-b10f-70afde86d638 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:07.957365 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-37b4fdb3-e5bb-4a7a-b10f-70afde86d638 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:07.957832 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-37b4fdb3-e5bb-4a7a-b10f-70afde86d638 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:08.087472 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-37b4fdb3-e5bb-4a7a-b10f-70afde86d638 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:13:08.094698 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-37b4fdb3-e5bb-4a7a-b10f-70afde86d638 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9" status: 200 len: 1513 microversion: 2.1 time: 0.149917 Aug 25 06:13:08.095261 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1267/2567] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:13:07 2021] GET /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:13:08.668727 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9b59a842-e8cf-4a0b-b68d-13256df6e59c tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:13:08.669418 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9b59a842-e8cf-4a0b-b68d-13256df6e59c tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 9d9f8dc3-f9d4-4a88-8256-b1610447efbe] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:13:08.675123 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9b59a842-e8cf-4a0b-b68d-13256df6e59c tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:08.675549 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9b59a842-e8cf-4a0b-b68d-13256df6e59c tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:08.676303 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9b59a842-e8cf-4a0b-b68d-13256df6e59c tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:08.676732 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9b59a842-e8cf-4a0b-b68d-13256df6e59c tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:08.807530 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-9b59a842-e8cf-4a0b-b68d-13256df6e59c tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:13:08.814879 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9b59a842-e8cf-4a0b-b68d-13256df6e59c tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe" status: 200 len: 1263 microversion: 2.1 time: 0.151113 Aug 25 06:13:08.815438 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1301/2568] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:13:08 2021] GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:13:09.112192 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5cd119a9-bd8d-4d4a-bcc0-0c5acfbcc2fe tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:13:09.112771 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5cd119a9-bd8d-4d4a-bcc0-0c5acfbcc2fe tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4fee06df-2121-4b1f-af52-6b9ecd1a6eb9] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:13:09.118711 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5cd119a9-bd8d-4d4a-bcc0-0c5acfbcc2fe tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:09.119151 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5cd119a9-bd8d-4d4a-bcc0-0c5acfbcc2fe tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:09.119906 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5cd119a9-bd8d-4d4a-bcc0-0c5acfbcc2fe tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:09.120333 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5cd119a9-bd8d-4d4a-bcc0-0c5acfbcc2fe tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:09.243402 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-5cd119a9-bd8d-4d4a-bcc0-0c5acfbcc2fe tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:13:09.250554 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5cd119a9-bd8d-4d4a-bcc0-0c5acfbcc2fe tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9" status: 200 len: 1513 microversion: 2.1 time: 0.142008 Aug 25 06:13:09.251145 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1268/2569] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:13:09 2021] GET /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9 => generated 1513 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:13:09.831965 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-21aae184-b72b-4ad0-8d9b-7ea9f6bd07e8 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:13:09.832498 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-21aae184-b72b-4ad0-8d9b-7ea9f6bd07e8 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 9d9f8dc3-f9d4-4a88-8256-b1610447efbe] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:13:09.838754 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-21aae184-b72b-4ad0-8d9b-7ea9f6bd07e8 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:09.839199 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-21aae184-b72b-4ad0-8d9b-7ea9f6bd07e8 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:09.839984 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-21aae184-b72b-4ad0-8d9b-7ea9f6bd07e8 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:09.840415 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-21aae184-b72b-4ad0-8d9b-7ea9f6bd07e8 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:09.964596 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-21aae184-b72b-4ad0-8d9b-7ea9f6bd07e8 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:13:09.972440 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-21aae184-b72b-4ad0-8d9b-7ea9f6bd07e8 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe" status: 200 len: 1450 microversion: 2.1 time: 0.144320 Aug 25 06:13:09.973001 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1302/2570] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:13:09 2021] GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe => generated 1450 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:13:09.987924 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-db8a14a8-c6db-45a3-98f7-89a60dc8ca8a tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:13:09.988535 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-db8a14a8-c6db-45a3-98f7-89a60dc8ca8a tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 9d9f8dc3-f9d4-4a88-8256-b1610447efbe] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:13:09.995046 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-db8a14a8-c6db-45a3-98f7-89a60dc8ca8a tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:09.995423 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-db8a14a8-c6db-45a3-98f7-89a60dc8ca8a tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:09.996183 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-db8a14a8-c6db-45a3-98f7-89a60dc8ca8a tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:09.996616 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-db8a14a8-c6db-45a3-98f7-89a60dc8ca8a tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:10.146499 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-db8a14a8-c6db-45a3-98f7-89a60dc8ca8a tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:13:10.155663 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-db8a14a8-c6db-45a3-98f7-89a60dc8ca8a tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe" status: 200 len: 1450 microversion: 2.1 time: 0.171300 Aug 25 06:13:10.156229 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1269/2571] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:13:09 2021] GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe => generated 1450 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:13:10.267485 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-19e97f04-8041-4cc3-ac01-8e8459a20fdb tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:13:10.268351 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-19e97f04-8041-4cc3-ac01-8e8459a20fdb tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4fee06df-2121-4b1f-af52-6b9ecd1a6eb9] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:13:10.275768 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-19e97f04-8041-4cc3-ac01-8e8459a20fdb tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:10.276225 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-19e97f04-8041-4cc3-ac01-8e8459a20fdb tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:10.277313 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-19e97f04-8041-4cc3-ac01-8e8459a20fdb tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:10.277777 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-19e97f04-8041-4cc3-ac01-8e8459a20fdb tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:10.463310 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-19e97f04-8041-4cc3-ac01-8e8459a20fdb tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5458184857ec4b7aace9b054355c5f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c35350b81f4cc4a4866e75cf5e2a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:13:10.475214 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-19e97f04-8041-4cc3-ac01-8e8459a20fdb tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9" status: 200 len: 1513 microversion: 2.1 time: 0.211336 Aug 25 06:13:10.486166 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1303/2572] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:13:10 2021] GET /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9 => generated 1513 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:13:10.527825 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [req-e573a575-29d2-405d-87de-6f2649d52b23 req-dfb937c7-47cb-4f85-b70f-54d088f2d81d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fee06df-2121-4b1f-af52-6b9ecd1a6eb9", "name": "network-vif-deleted", "tag": "050b165f-ad55-4b03-b336-51856973c15c"}]} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:13:10.529419 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 06:13:10.529419 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: warnings.warn(msg) Aug 25 06:13:10.536602 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-e573a575-29d2-405d-87de-6f2649d52b23 req-dfb937c7-47cb-4f85-b70f-54d088f2d81d service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:10.537716 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-e573a575-29d2-405d-87de-6f2649d52b23 req-dfb937c7-47cb-4f85-b70f-54d088f2d81d service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:10.548308 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.compute.server_external_events [req-e573a575-29d2-405d-87de-6f2649d52b23 req-dfb937c7-47cb-4f85-b70f-54d088f2d81d service nova] Creating event network-vif-deleted:050b165f-ad55-4b03-b336-51856973c15c for instance 4fee06df-2121-4b1f-af52-6b9ecd1a6eb9 on hv-cinder-78662 Aug 25 06:13:10.553308 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [req-e573a575-29d2-405d-87de-6f2649d52b23 req-dfb937c7-47cb-4f85-b70f-54d088f2d81d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029984 Aug 25 06:13:10.553939 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1270/2573] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 06:13:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:13:11.492861 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9f1de3ae-feaf-4478-8dc9-05a8524b1417 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:13:11.493701 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9f1de3ae-feaf-4478-8dc9-05a8524b1417 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] [instance: 4fee06df-2121-4b1f-af52-6b9ecd1a6eb9] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:13:11.499951 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9f1de3ae-feaf-4478-8dc9-05a8524b1417 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:11.500393 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9f1de3ae-feaf-4478-8dc9-05a8524b1417 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:11.501158 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9f1de3ae-feaf-4478-8dc9-05a8524b1417 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:11.501623 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9f1de3ae-feaf-4478-8dc9-05a8524b1417 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:11.515556 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.wsgi [None req-9f1de3ae-feaf-4478-8dc9-05a8524b1417 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] HTTP exception thrown: Instance 4fee06df-2121-4b1f-af52-6b9ecd1a6eb9 could not be found. Aug 25 06:13:11.516155 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9f1de3ae-feaf-4478-8dc9-05a8524b1417 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] Returning 404 to user: Instance 4fee06df-2121-4b1f-af52-6b9ecd1a6eb9 could not be found. {{(pid=108885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 06:13:11.516997 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9f1de3ae-feaf-4478-8dc9-05a8524b1417 tempest-AttachVolumeNegativeTest-1809890372 tempest-AttachVolumeNegativeTest-1809890372-project] 10.222.0.42 "GET /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9" status: 404 len: 111 microversion: 2.1 time: 0.028697 Aug 25 06:13:11.517630 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1304/2574] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:13:11 2021] GET /compute/v2.1/servers/4fee06df-2121-4b1f-af52-6b9ecd1a6eb9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 06:13:12.589631 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [req-7a30a9fa-859d-47ad-88ba-4dc2a724d91d req-a199ecd9-cf7d-45e8-ba78-e8e2f26cafd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d9f8dc3-f9d4-4a88-8256-b1610447efbe", "tag": "4cce5795-f55b-496e-be3e-0c2d69f9ab93"}]} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:13:12.591691 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 06:13:12.591691 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: warnings.warn(msg) Aug 25 06:13:12.600564 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-7a30a9fa-859d-47ad-88ba-4dc2a724d91d req-a199ecd9-cf7d-45e8-ba78-e8e2f26cafd3 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:13:12.601005 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-7a30a9fa-859d-47ad-88ba-4dc2a724d91d req-a199ecd9-cf7d-45e8-ba78-e8e2f26cafd3 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:13:12.613590 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.compute.server_external_events [req-7a30a9fa-859d-47ad-88ba-4dc2a724d91d req-a199ecd9-cf7d-45e8-ba78-e8e2f26cafd3 service nova] Creating event network-changed:4cce5795-f55b-496e-be3e-0c2d69f9ab93 for instance 9d9f8dc3-f9d4-4a88-8256-b1610447efbe on hv-cinder-78662 Aug 25 06:13:12.619278 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [req-7a30a9fa-859d-47ad-88ba-4dc2a724d91d req-a199ecd9-cf7d-45e8-ba78-e8e2f26cafd3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103123 Aug 25 06:13:12.619919 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1271/2575] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 06:13:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:13:14.283031 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-65174dbf-ea7c-4021-8479-66438ec2a326 tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] Action: 'create', calling method: .version_select at 0x7f9106649040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1336003653"}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:13:14.956195 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-65174dbf-ea7c-4021-8479-66438ec2a326 tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.795356 Aug 25 06:13:14.956808 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1305/2576] 10.222.0.42 () {60 vars in 1155 bytes} [Wed Aug 25 06:13:14 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 797 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 25 06:13:14.972128 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-15f98c54-fd31-4265-855e-8ebe1b04f08b tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] Calling method '.version_select at 0x7f910c0ace50>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:13:15.029882 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-15f98c54-fd31-4265-855e-8ebe1b04f08b tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/aedde957-d409-43bd-bb5b-b74ac181ac58" status: 200 len: 345 microversion: 2.1 time: 0.061898 Aug 25 06:13:15.030594 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1272/2577] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 25 06:13:14 2021] GET /compute/v2.1/os-volumes/aedde957-d409-43bd-bb5b-b74ac181ac58 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:13:16.042675 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-dc08892b-dcbc-46f3-8be2-66cc7d00a484 tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] Calling method '.version_select at 0x7f910657d1f0>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:13:16.094820 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-dc08892b-dcbc-46f3-8be2-66cc7d00a484 tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/aedde957-d409-43bd-bb5b-b74ac181ac58" status: 200 len: 346 microversion: 2.1 time: 0.056107 Aug 25 06:13:16.095416 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1306/2578] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 25 06:13:16 2021] GET /compute/v2.1/os-volumes/aedde957-d409-43bd-bb5b-b74ac181ac58 => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:13:16.106362 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-429011e3-7f1b-49d1-a1d7-7bc9acd11bd9 tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] Action: 'create', calling method: .version_select at 0x7f9106e72700>, body: {"snapshot": {"volume_id": "aedde957-d409-43bd-bb5b-b74ac181ac58", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1168077401"}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:13:16.603115 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-429011e3-7f1b-49d1-a1d7-7bc9acd11bd9 tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.500422 Aug 25 06:13:16.603801 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1273/2579] 10.222.0.42 () {60 vars in 1162 bytes} [Wed Aug 25 06:13:16 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:13:16.613952 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f2dbafb6-d269-44c6-a3f3-f82909ba297c tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] Calling method '.version_select at 0x7f9106609d30>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:13:16.645443 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f2dbafb6-d269-44c6-a3f3-f82909ba297c tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/f65bce08-cc8f-4847-9456-063b7cad4efc" status: 200 len: 287 microversion: 2.1 time: 0.035326 Aug 25 06:13:16.646039 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1307/2580] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Aug 25 06:13:16 2021] GET /compute/v2.1/os-snapshots/f65bce08-cc8f-4847-9456-063b7cad4efc => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:13:16.655690 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-31cd5e60-f59f-44b7-800d-8f7a3c7eb1c5 tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] Calling method '.version_select at 0x7f9106f10820>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:13:16.687590 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-31cd5e60-f59f-44b7-800d-8f7a3c7eb1c5 tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.032265 Aug 25 06:13:16.687590 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1274/2581] 10.222.0.42 () {58 vars in 1140 bytes} [Wed Aug 25 06:13:16 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:13:16.695155 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-080ae46d-3d6a-4f56-9b63-cc465ad6c452 tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] Calling method '.version_select at 0x7f910657d040>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:13:16.724553 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-080ae46d-3d6a-4f56-9b63-cc465ad6c452 tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/f65bce08-cc8f-4847-9456-063b7cad4efc" status: 200 len: 287 microversion: 2.1 time: 0.033173 Aug 25 06:13:16.725206 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1308/2582] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Aug 25 06:13:16 2021] GET /compute/v2.1/os-snapshots/f65bce08-cc8f-4847-9456-063b7cad4efc => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:13:17.735793 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-2a199963-d4da-4d98-806d-8b761aba5a64 tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] Calling method '.version_select at 0x7f9106effc10>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:13:17.764165 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-2a199963-d4da-4d98-806d-8b761aba5a64 tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/f65bce08-cc8f-4847-9456-063b7cad4efc" status: 200 len: 287 microversion: 2.1 time: 0.031924 Aug 25 06:13:17.764787 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1275/2583] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Aug 25 06:13:17 2021] GET /compute/v2.1/os-snapshots/f65bce08-cc8f-4847-9456-063b7cad4efc => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:13:18.775940 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a6f9ac52-5fe0-4435-875f-3ce127936186 tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] Calling method '.version_select at 0x7f9106693820>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:13:18.804622 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a6f9ac52-5fe0-4435-875f-3ce127936186 tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/f65bce08-cc8f-4847-9456-063b7cad4efc" status: 200 len: 287 microversion: 2.1 time: 0.032418 Aug 25 06:13:18.805200 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1309/2584] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Aug 25 06:13:18 2021] GET /compute/v2.1/os-snapshots/f65bce08-cc8f-4847-9456-063b7cad4efc => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:13:19.817708 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e0b9da0b-44d6-4620-a028-efb32909baab tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] Calling method '.version_select at 0x7f9106f108b0>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:13:19.846706 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e0b9da0b-44d6-4620-a028-efb32909baab tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/f65bce08-cc8f-4847-9456-063b7cad4efc" status: 200 len: 287 microversion: 2.1 time: 0.033113 Aug 25 06:13:19.847264 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1276/2585] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Aug 25 06:13:19 2021] GET /compute/v2.1/os-snapshots/f65bce08-cc8f-4847-9456-063b7cad4efc => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:13:20.858760 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-10a11b4f-d8ca-4a29-875e-eb5b6fe125eb tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] Calling method '.version_select at 0x7f910648d8b0>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:13:20.866343 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: ERROR oslo.messaging._drivers.impl_rabbit [-] [024c7946-b47b-4a06-aa5e-7d5b6a13301d] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 25 06:13:20.888219 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-10a11b4f-d8ca-4a29-875e-eb5b6fe125eb tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/f65bce08-cc8f-4847-9456-063b7cad4efc" status: 200 len: 287 microversion: 2.1 time: 0.033284 Aug 25 06:13:20.888767 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1310/2586] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Aug 25 06:13:20 2021] GET /compute/v2.1/os-snapshots/f65bce08-cc8f-4847-9456-063b7cad4efc => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:13:21.900666 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-867ccd2f-9117-41b2-b5cb-b42e02806547 tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] Calling method '.version_select at 0x7f9106e72280>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:13:21.930189 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-867ccd2f-9117-41b2-b5cb-b42e02806547 tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/f65bce08-cc8f-4847-9456-063b7cad4efc" status: 200 len: 287 microversion: 2.1 time: 0.034004 Aug 25 06:13:21.930818 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1277/2587] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Aug 25 06:13:21 2021] GET /compute/v2.1/os-snapshots/f65bce08-cc8f-4847-9456-063b7cad4efc => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:13:22.952967 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c8896ad9-df7f-43dd-955c-f7a2ab4d6777 tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] Calling method '.version_select at 0x7f910c046820>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:13:22.967467 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO oslo.messaging._drivers.impl_rabbit [-] [024c7946-b47b-4a06-aa5e-7d5b6a13301d] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 48022. Aug 25 06:13:22.983391 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c8896ad9-df7f-43dd-955c-f7a2ab4d6777 tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/f65bce08-cc8f-4847-9456-063b7cad4efc" status: 200 len: 288 microversion: 2.1 time: 0.044887 Aug 25 06:13:22.983391 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1311/2588] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Aug 25 06:13:22 2021] GET /compute/v2.1/os-snapshots/f65bce08-cc8f-4847-9456-063b7cad4efc => generated 288 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:13:22.993628 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-80741b25-9f57-4aa8-9396-0754f6ffab5f tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] Calling method '.version_select at 0x7f9106eaa1f0>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:13:23.117875 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-80741b25-9f57-4aa8-9396-0754f6ffab5f tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/f65bce08-cc8f-4847-9456-063b7cad4efc" status: 202 len: 0 microversion: 2.1 time: 0.126239 Aug 25 06:13:23.117875 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1278/2589] 10.222.0.42 () {58 vars in 1254 bytes} [Wed Aug 25 06:13:22 2021] DELETE /compute/v2.1/os-snapshots/f65bce08-cc8f-4847-9456-063b7cad4efc => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 06:13:23.125341 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-65f2a5a1-a890-46c5-bcf8-c96d53acd8bc tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] Calling method '.version_select at 0x7f9106649040>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:13:23.155413 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-65f2a5a1-a890-46c5-bcf8-c96d53acd8bc tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/f65bce08-cc8f-4847-9456-063b7cad4efc" status: 200 len: 287 microversion: 2.1 time: 0.033756 Aug 25 06:13:23.156009 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1312/2590] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Aug 25 06:13:23 2021] GET /compute/v2.1/os-snapshots/f65bce08-cc8f-4847-9456-063b7cad4efc => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:13:24.167097 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-36b107aa-d54d-4d44-9165-e6cf27c23c79 tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] Calling method '.version_select at 0x7f9106e72700>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:13:24.190638 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.wsgi [None req-36b107aa-d54d-4d44-9165-e6cf27c23c79 tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] HTTP exception thrown: Snapshot f65bce08-cc8f-4847-9456-063b7cad4efc could not be found. Aug 25 06:13:24.191234 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-36b107aa-d54d-4d44-9165-e6cf27c23c79 tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] Returning 404 to user: Snapshot f65bce08-cc8f-4847-9456-063b7cad4efc could not be found. {{(pid=108884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 06:13:24.192069 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-36b107aa-d54d-4d44-9165-e6cf27c23c79 tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/f65bce08-cc8f-4847-9456-063b7cad4efc" status: 404 len: 111 microversion: 2.1 time: 0.028783 Aug 25 06:13:24.192765 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1279/2591] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Aug 25 06:13:24 2021] GET /compute/v2.1/os-snapshots/f65bce08-cc8f-4847-9456-063b7cad4efc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 06:13:24.201205 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-677dd82e-1b2b-4781-9e17-053ca6af0ae7 tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] Calling method '.version_select at 0x7f9106609550>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:13:24.452542 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-677dd82e-1b2b-4781-9e17-053ca6af0ae7 tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/aedde957-d409-43bd-bb5b-b74ac181ac58" status: 202 len: 0 microversion: 2.1 time: 0.255556 Aug 25 06:13:24.453103 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1313/2592] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Aug 25 06:13:24 2021] DELETE /compute/v2.1/os-volumes/aedde957-d409-43bd-bb5b-b74ac181ac58 => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 06:13:24.465865 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-bfe3d7c7-ca66-42e3-8d03-62c3eec1d44f tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] Calling method '.version_select at 0x7f9106d784c0>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:13:24.517063 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-bfe3d7c7-ca66-42e3-8d03-62c3eec1d44f tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/aedde957-d409-43bd-bb5b-b74ac181ac58" status: 200 len: 345 microversion: 2.1 time: 0.055579 Aug 25 06:13:24.517659 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1280/2593] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 25 06:13:24 2021] GET /compute/v2.1/os-volumes/aedde957-d409-43bd-bb5b-b74ac181ac58 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:13:25.530789 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-dacec906-70f5-44a5-a543-9f4684c837c7 tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] Calling method '.version_select at 0x7f910648d8b0>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:13:25.559541 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.wsgi [None req-dacec906-70f5-44a5-a543-9f4684c837c7 tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] HTTP exception thrown: Volume aedde957-d409-43bd-bb5b-b74ac181ac58 could not be found. Aug 25 06:13:25.560142 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-dacec906-70f5-44a5-a543-9f4684c837c7 tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] Returning 404 to user: Volume aedde957-d409-43bd-bb5b-b74ac181ac58 could not be found. {{(pid=108885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 06:13:25.560984 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-dacec906-70f5-44a5-a543-9f4684c837c7 tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/aedde957-d409-43bd-bb5b-b74ac181ac58" status: 404 len: 109 microversion: 2.1 time: 0.034524 Aug 25 06:13:25.561553 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1314/2594] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 25 06:13:25 2021] GET /compute/v2.1/os-volumes/aedde957-d409-43bd-bb5b-b74ac181ac58 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 06:13:25.575302 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d4c67111-e132-48f8-a567-710f3051aafb tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] Calling method '.version_select at 0x7f9106e72c10>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:13:25.602155 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.wsgi [None req-d4c67111-e132-48f8-a567-710f3051aafb tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] HTTP exception thrown: Volume aedde957-d409-43bd-bb5b-b74ac181ac58 could not be found. Aug 25 06:13:25.602755 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d4c67111-e132-48f8-a567-710f3051aafb tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] Returning 404 to user: Volume aedde957-d409-43bd-bb5b-b74ac181ac58 could not be found. {{(pid=108884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 06:13:25.603581 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d4c67111-e132-48f8-a567-710f3051aafb tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/aedde957-d409-43bd-bb5b-b74ac181ac58" status: 404 len: 109 microversion: 2.1 time: 0.032215 Aug 25 06:13:25.604118 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1281/2595] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Aug 25 06:13:25 2021] DELETE /compute/v2.1/os-volumes/aedde957-d409-43bd-bb5b-b74ac181ac58 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 06:13:25.612961 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-18395eed-c6d3-42b1-ac4d-0b85e2e074c9 tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] Calling method '.version_select at 0x7f910c0465e0>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:13:25.638314 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.wsgi [None req-18395eed-c6d3-42b1-ac4d-0b85e2e074c9 tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] HTTP exception thrown: Volume aedde957-d409-43bd-bb5b-b74ac181ac58 could not be found. Aug 25 06:13:25.638893 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-18395eed-c6d3-42b1-ac4d-0b85e2e074c9 tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] Returning 404 to user: Volume aedde957-d409-43bd-bb5b-b74ac181ac58 could not be found. {{(pid=108885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 06:13:25.639736 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-18395eed-c6d3-42b1-ac4d-0b85e2e074c9 tempest-VolumesSnapshotsTestJSON-1167868993 tempest-VolumesSnapshotsTestJSON-1167868993-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/aedde957-d409-43bd-bb5b-b74ac181ac58" status: 404 len: 109 microversion: 2.1 time: 0.030321 Aug 25 06:13:25.640251 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1315/2596] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 25 06:13:25 2021] GET /compute/v2.1/os-volumes/aedde957-d409-43bd-bb5b-b74ac181ac58 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 06:14:05.071499 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 06:14:05.072086 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: Wed Aug 25 06:14:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 06:14:07.759598 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-de8a38cf-b05e-4f3e-ad8d-60213afb0e58 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Action: 'create', calling method: .version_select at 0x7f9106c32b80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1135844039"}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:14:07.777598 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.quota [None req-de8a38cf-b05e-4f3e-ad8d-60213afb0e58 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Getting quotas for project badc1e82eb534e34ade3d453aaabc61d. Resources: {'key_pairs'} {{(pid=108884) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 06:14:07.781289 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.quota [None req-de8a38cf-b05e-4f3e-ad8d-60213afb0e58 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Getting quotas for user 2273d869361e43be812142b1320d920d and project badc1e82eb534e34ade3d453aaabc61d. Resources: {'key_pairs'} {{(pid=108884) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 06:14:08.007851 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.quota [None req-de8a38cf-b05e-4f3e-ad8d-60213afb0e58 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Getting quotas for project badc1e82eb534e34ade3d453aaabc61d. Resources: {'key_pairs'} {{(pid=108884) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 06:14:08.012245 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.quota [None req-de8a38cf-b05e-4f3e-ad8d-60213afb0e58 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Getting quotas for user 2273d869361e43be812142b1320d920d and project badc1e82eb534e34ade3d453aaabc61d. Resources: {'key_pairs'} {{(pid=108884) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 06:14:08.025807 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-de8a38cf-b05e-4f3e-ad8d-60213afb0e58 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.270950 Aug 25 06:14:08.029554 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1282/2597] 10.222.0.42 () {60 vars in 1158 bytes} [Wed Aug 25 06:14:07 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 06:14:08.075997 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-567cedb8-e2ea-4f42-beb1-eabbc4899f97 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1125037453", "imageRef": "c5c0fc60-4963-4d5d-9153-f82d26acff5c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1135844039", "networks": [{"uuid": "85a067b7-29b2-436f-8841-89f279770d5f"}]}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:14:08.126831 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.network.neutron [None req-567cedb8-e2ea-4f42-beb1-eabbc4899f97 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] validate_networks() for [('85a067b7-29b2-436f-8841-89f279770d5f', None, None, None, None, None)] {{(pid=108885) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 25 06:14:08.504658 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-567cedb8-e2ea-4f42-beb1-eabbc4899f97 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Flavor limits 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 06:14:08.505078 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-567cedb8-e2ea-4f42-beb1-eabbc4899f97 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Image limits 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 06:14:08.505568 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-567cedb8-e2ea-4f42-beb1-eabbc4899f97 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Flavor pref 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 06:14:08.505973 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-567cedb8-e2ea-4f42-beb1-eabbc4899f97 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Image pref 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 06:14:08.506426 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-567cedb8-e2ea-4f42-beb1-eabbc4899f97 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 06:14:08.515428 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-567cedb8-e2ea-4f42-beb1-eabbc4899f97 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:08.515892 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-567cedb8-e2ea-4f42-beb1-eabbc4899f97 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:08.516698 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-567cedb8-e2ea-4f42-beb1-eabbc4899f97 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:08.517149 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-567cedb8-e2ea-4f42-beb1-eabbc4899f97 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:08.533910 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.quota [None req-567cedb8-e2ea-4f42-beb1-eabbc4899f97 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Getting quotas for project badc1e82eb534e34ade3d453aaabc61d. Resources: {'ram', 'cores', 'instances'} {{(pid=108885) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 06:14:08.537737 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.quota [None req-567cedb8-e2ea-4f42-beb1-eabbc4899f97 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Getting quotas for user 2273d869361e43be812142b1320d920d and project badc1e82eb534e34ade3d453aaabc61d. Resources: {'ram', 'cores', 'instances'} {{(pid=108885) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 06:14:08.548990 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-567cedb8-e2ea-4f42-beb1-eabbc4899f97 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Going to run 1 instances... {{(pid=108885) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 25 06:14:08.551328 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-567cedb8-e2ea-4f42-beb1-eabbc4899f97 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5c0fc60-4963-4d5d-9153-f82d26acff5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 25 06:14:08.703889 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-567cedb8-e2ea-4f42-beb1-eabbc4899f97 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.632184 Aug 25 06:14:08.705008 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1316/2598] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 25 06:14:08 2021] POST /compute/v2.1/servers => generated 380 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 06:14:08.715340 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7eac2f4f-eb23-43b4-8a2d-8f900970afb5 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:14:08.716398 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7eac2f4f-eb23-43b4-8a2d-8f900970afb5 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:14:08.783476 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-7eac2f4f-eb23-43b4-8a2d-8f900970afb5 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:14:08.789922 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7eac2f4f-eb23-43b4-8a2d-8f900970afb5 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1259 microversion: 2.1 time: 0.079136 Aug 25 06:14:08.791223 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1283/2599] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:14:08 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1259 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 06:14:09.806687 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-0439f012-1592-4e19-b2c0-678d65bd1b5c tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:14:09.807702 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-0439f012-1592-4e19-b2c0-678d65bd1b5c tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:14:09.813263 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0439f012-1592-4e19-b2c0-678d65bd1b5c tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:09.813742 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0439f012-1592-4e19-b2c0-678d65bd1b5c tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:09.814520 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0439f012-1592-4e19-b2c0-678d65bd1b5c tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:09.814944 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0439f012-1592-4e19-b2c0-678d65bd1b5c tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:09.875412 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-0439f012-1592-4e19-b2c0-678d65bd1b5c tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:14:09.883941 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-0439f012-1592-4e19-b2c0-678d65bd1b5c tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1263 microversion: 2.1 time: 0.081009 Aug 25 06:14:09.884510 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1317/2600] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:14:09 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1263 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:14:10.902408 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-76583199-c668-43c1-8a9e-980181d0aa35 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:14:10.903014 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-76583199-c668-43c1-8a9e-980181d0aa35 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:14:10.909165 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-76583199-c668-43c1-8a9e-980181d0aa35 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:10.909702 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-76583199-c668-43c1-8a9e-980181d0aa35 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:10.910480 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-76583199-c668-43c1-8a9e-980181d0aa35 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:10.910905 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-76583199-c668-43c1-8a9e-980181d0aa35 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:10.971058 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-76583199-c668-43c1-8a9e-980181d0aa35 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:14:10.978620 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-76583199-c668-43c1-8a9e-980181d0aa35 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1319 microversion: 2.1 time: 0.080582 Aug 25 06:14:10.980008 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1284/2601] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:14:10 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1319 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:14:11.996914 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-30a5d542-21fb-490e-94e3-f1c105542d36 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:14:11.997448 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-30a5d542-21fb-490e-94e3-f1c105542d36 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:14:12.003460 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-30a5d542-21fb-490e-94e3-f1c105542d36 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:12.003907 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-30a5d542-21fb-490e-94e3-f1c105542d36 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:12.004664 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-30a5d542-21fb-490e-94e3-f1c105542d36 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:12.005096 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-30a5d542-21fb-490e-94e3-f1c105542d36 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:12.146061 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-30a5d542-21fb-490e-94e3-f1c105542d36 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:14:12.156428 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-30a5d542-21fb-490e-94e3-f1c105542d36 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1359 microversion: 2.1 time: 0.164024 Aug 25 06:14:12.157042 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1318/2602] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:14:11 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:14:13.174761 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-4ed75397-fda6-4468-858a-5dd551542461 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:14:13.175364 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-4ed75397-fda6-4468-858a-5dd551542461 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:14:13.181151 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4ed75397-fda6-4468-858a-5dd551542461 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:13.181649 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4ed75397-fda6-4468-858a-5dd551542461 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:13.183035 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4ed75397-fda6-4468-858a-5dd551542461 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:13.183500 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4ed75397-fda6-4468-858a-5dd551542461 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:13.317035 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-4ed75397-fda6-4468-858a-5dd551542461 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:14:13.324890 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-4ed75397-fda6-4468-858a-5dd551542461 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1359 microversion: 2.1 time: 0.153928 Aug 25 06:14:13.325453 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1285/2603] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:14:13 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:14:14.342186 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5cc8fc36-eed0-4088-9b40-b5cf0ffacd77 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:14:14.342940 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5cc8fc36-eed0-4088-9b40-b5cf0ffacd77 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:14:14.349619 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5cc8fc36-eed0-4088-9b40-b5cf0ffacd77 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:14.350100 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5cc8fc36-eed0-4088-9b40-b5cf0ffacd77 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:14.350930 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5cc8fc36-eed0-4088-9b40-b5cf0ffacd77 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:14.351359 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5cc8fc36-eed0-4088-9b40-b5cf0ffacd77 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:14.487401 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-5cc8fc36-eed0-4088-9b40-b5cf0ffacd77 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:14:14.496340 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5cc8fc36-eed0-4088-9b40-b5cf0ffacd77 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1359 microversion: 2.1 time: 0.158694 Aug 25 06:14:14.496923 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1319/2604] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:14:14 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:14:15.513578 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-cbe342ad-85c5-4296-a0b3-aba312b60537 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:14:15.514274 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-cbe342ad-85c5-4296-a0b3-aba312b60537 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:14:15.522972 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cbe342ad-85c5-4296-a0b3-aba312b60537 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:15.523933 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cbe342ad-85c5-4296-a0b3-aba312b60537 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:15.525005 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cbe342ad-85c5-4296-a0b3-aba312b60537 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:15.526421 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-cbe342ad-85c5-4296-a0b3-aba312b60537 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:15.695217 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-cbe342ad-85c5-4296-a0b3-aba312b60537 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:14:15.703152 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-cbe342ad-85c5-4296-a0b3-aba312b60537 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1359 microversion: 2.1 time: 0.193585 Aug 25 06:14:15.703751 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1286/2605] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:14:15 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:14:16.719683 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-0c6a38c7-c543-4103-8938-44c4ae68601a tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:14:16.720292 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-0c6a38c7-c543-4103-8938-44c4ae68601a tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:14:16.726219 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0c6a38c7-c543-4103-8938-44c4ae68601a tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:16.726661 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0c6a38c7-c543-4103-8938-44c4ae68601a tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:16.727410 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0c6a38c7-c543-4103-8938-44c4ae68601a tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:16.727833 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0c6a38c7-c543-4103-8938-44c4ae68601a tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:16.855606 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-0c6a38c7-c543-4103-8938-44c4ae68601a tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:14:16.862907 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-0c6a38c7-c543-4103-8938-44c4ae68601a tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1359 microversion: 2.1 time: 0.146835 Aug 25 06:14:16.863569 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1320/2606] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:14:16 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:14:17.880575 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-0446a541-33e0-4cca-b1cb-1222a58be554 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:14:17.881110 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-0446a541-33e0-4cca-b1cb-1222a58be554 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:14:17.887866 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0446a541-33e0-4cca-b1cb-1222a58be554 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:17.888314 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0446a541-33e0-4cca-b1cb-1222a58be554 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:17.889072 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0446a541-33e0-4cca-b1cb-1222a58be554 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:17.889517 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0446a541-33e0-4cca-b1cb-1222a58be554 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:18.044797 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-0446a541-33e0-4cca-b1cb-1222a58be554 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:14:18.054888 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-0446a541-33e0-4cca-b1cb-1222a58be554 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1359 microversion: 2.1 time: 0.178132 Aug 25 06:14:18.055822 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1287/2607] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:14:17 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:14:19.078376 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-83cd872f-3da9-41f2-8aa3-e5de5b1b7588 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:14:19.079080 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-83cd872f-3da9-41f2-8aa3-e5de5b1b7588 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:14:19.085183 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-83cd872f-3da9-41f2-8aa3-e5de5b1b7588 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:19.085648 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-83cd872f-3da9-41f2-8aa3-e5de5b1b7588 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:19.086414 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-83cd872f-3da9-41f2-8aa3-e5de5b1b7588 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:19.087007 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-83cd872f-3da9-41f2-8aa3-e5de5b1b7588 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:19.218202 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-83cd872f-3da9-41f2-8aa3-e5de5b1b7588 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:14:19.225608 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-83cd872f-3da9-41f2-8aa3-e5de5b1b7588 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1359 microversion: 2.1 time: 0.150788 Aug 25 06:14:19.226182 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1321/2608] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:14:19 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:14:20.242269 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-611ea15c-67d1-42a1-8cdd-9cc43a4fc885 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:14:20.242921 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-611ea15c-67d1-42a1-8cdd-9cc43a4fc885 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:14:20.248966 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-611ea15c-67d1-42a1-8cdd-9cc43a4fc885 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:20.249417 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-611ea15c-67d1-42a1-8cdd-9cc43a4fc885 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:20.250205 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-611ea15c-67d1-42a1-8cdd-9cc43a4fc885 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:20.250640 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-611ea15c-67d1-42a1-8cdd-9cc43a4fc885 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:20.394317 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-611ea15c-67d1-42a1-8cdd-9cc43a4fc885 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:14:20.405457 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-611ea15c-67d1-42a1-8cdd-9cc43a4fc885 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1359 microversion: 2.1 time: 0.166874 Aug 25 06:14:20.414689 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1288/2609] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:14:20 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 06:14:21.428219 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2243412b-c09d-4233-8392-30a188d2d15c tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:14:21.429728 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2243412b-c09d-4233-8392-30a188d2d15c tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:14:21.436710 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2243412b-c09d-4233-8392-30a188d2d15c tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:21.437158 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2243412b-c09d-4233-8392-30a188d2d15c tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:21.437977 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2243412b-c09d-4233-8392-30a188d2d15c tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:21.438429 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2243412b-c09d-4233-8392-30a188d2d15c tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:21.594455 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-2243412b-c09d-4233-8392-30a188d2d15c tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:14:21.605132 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2243412b-c09d-4233-8392-30a188d2d15c tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1359 microversion: 2.1 time: 0.183780 Aug 25 06:14:21.605930 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1322/2610] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:14:21 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:14:22.622228 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-18dff28d-f085-40b3-9c6b-0d8f87077633 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:14:22.622962 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-18dff28d-f085-40b3-9c6b-0d8f87077633 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:14:22.629328 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-18dff28d-f085-40b3-9c6b-0d8f87077633 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:22.629885 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-18dff28d-f085-40b3-9c6b-0d8f87077633 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:22.630654 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-18dff28d-f085-40b3-9c6b-0d8f87077633 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:22.631085 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-18dff28d-f085-40b3-9c6b-0d8f87077633 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:22.757399 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-18dff28d-f085-40b3-9c6b-0d8f87077633 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:14:22.765999 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-18dff28d-f085-40b3-9c6b-0d8f87077633 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1359 microversion: 2.1 time: 0.147680 Aug 25 06:14:22.766575 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1289/2611] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:14:22 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:14:23.290041 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 06:14:23.291146 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: Wed Aug 25 06:14:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 06:14:23.782764 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-192e486b-2c42-4db9-a3bf-e4e1af3980be tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:14:23.783308 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-192e486b-2c42-4db9-a3bf-e4e1af3980be tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:14:23.790057 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-192e486b-2c42-4db9-a3bf-e4e1af3980be tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:23.790413 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-192e486b-2c42-4db9-a3bf-e4e1af3980be tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:23.791885 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-192e486b-2c42-4db9-a3bf-e4e1af3980be tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:23.792307 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-192e486b-2c42-4db9-a3bf-e4e1af3980be tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:23.915297 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-192e486b-2c42-4db9-a3bf-e4e1af3980be tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:14:23.923560 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-192e486b-2c42-4db9-a3bf-e4e1af3980be tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1359 microversion: 2.1 time: 0.144564 Aug 25 06:14:23.924131 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1323/2612] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:14:23 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:14:24.940172 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-6259f505-2b45-4362-9069-c6770cb28714 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:14:24.940809 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-6259f505-2b45-4362-9069-c6770cb28714 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:14:24.947788 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6259f505-2b45-4362-9069-c6770cb28714 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:24.948220 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6259f505-2b45-4362-9069-c6770cb28714 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:24.949005 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6259f505-2b45-4362-9069-c6770cb28714 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:24.949435 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-6259f505-2b45-4362-9069-c6770cb28714 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:25.074741 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-6259f505-2b45-4362-9069-c6770cb28714 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:14:25.084222 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-6259f505-2b45-4362-9069-c6770cb28714 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1359 microversion: 2.1 time: 0.147859 Aug 25 06:14:25.084802 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1290/2613] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:14:24 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:14:26.100333 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-059fa9bf-2c34-4ca1-8be0-5132e31d4099 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:14:26.100929 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-059fa9bf-2c34-4ca1-8be0-5132e31d4099 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:14:26.107640 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-059fa9bf-2c34-4ca1-8be0-5132e31d4099 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:26.108081 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-059fa9bf-2c34-4ca1-8be0-5132e31d4099 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:26.108832 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-059fa9bf-2c34-4ca1-8be0-5132e31d4099 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:26.109257 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-059fa9bf-2c34-4ca1-8be0-5132e31d4099 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:26.231833 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-059fa9bf-2c34-4ca1-8be0-5132e31d4099 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:14:26.238926 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-059fa9bf-2c34-4ca1-8be0-5132e31d4099 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1359 microversion: 2.1 time: 0.142222 Aug 25 06:14:26.239480 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1324/2614] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:14:26 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1359 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:14:27.257239 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ca79e596-a6a0-4b66-a72e-2e45a1f0e2c1 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:14:27.257899 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ca79e596-a6a0-4b66-a72e-2e45a1f0e2c1 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:14:27.265166 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ca79e596-a6a0-4b66-a72e-2e45a1f0e2c1 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:27.265661 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ca79e596-a6a0-4b66-a72e-2e45a1f0e2c1 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:27.266525 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ca79e596-a6a0-4b66-a72e-2e45a1f0e2c1 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:27.266967 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ca79e596-a6a0-4b66-a72e-2e45a1f0e2c1 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:27.433191 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ca79e596-a6a0-4b66-a72e-2e45a1f0e2c1 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:14:27.446260 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ca79e596-a6a0-4b66-a72e-2e45a1f0e2c1 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1359 microversion: 2.1 time: 0.193352 Aug 25 06:14:27.450594 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1291/2615] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:14:27 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1359 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:14:28.063760 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [req-82e22ba2-e406-4aec-a6dd-1511dfd643f2 req-ac12ac35-1893-4cc1-89ff-69905d6fd3f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fa8553a-872a-4b76-bd51-a736a62663aa", "tag": "3748ac8a-661a-450c-8fbe-84c6728411d1"}]} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:14:28.065398 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 06:14:28.065398 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: warnings.warn(msg) Aug 25 06:14:28.073405 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-82e22ba2-e406-4aec-a6dd-1511dfd643f2 req-ac12ac35-1893-4cc1-89ff-69905d6fd3f1 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:28.073405 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-82e22ba2-e406-4aec-a6dd-1511dfd643f2 req-ac12ac35-1893-4cc1-89ff-69905d6fd3f1 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:28.088888 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.compute.server_external_events [req-82e22ba2-e406-4aec-a6dd-1511dfd643f2 req-ac12ac35-1893-4cc1-89ff-69905d6fd3f1 service nova] Creating event network-changed:3748ac8a-661a-450c-8fbe-84c6728411d1 for instance 2fa8553a-872a-4b76-bd51-a736a62663aa on hv-cinder-78662 Aug 25 06:14:28.095772 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [req-82e22ba2-e406-4aec-a6dd-1511dfd643f2 req-ac12ac35-1893-4cc1-89ff-69905d6fd3f1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035049 Aug 25 06:14:28.097576 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1325/2616] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 06:14:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:14:28.465157 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-de3dccc9-4056-4b7e-826f-16b3c7dd75d3 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:14:28.465901 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-de3dccc9-4056-4b7e-826f-16b3c7dd75d3 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:14:28.471691 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-de3dccc9-4056-4b7e-826f-16b3c7dd75d3 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:28.472144 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-de3dccc9-4056-4b7e-826f-16b3c7dd75d3 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:28.472916 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-de3dccc9-4056-4b7e-826f-16b3c7dd75d3 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:28.473352 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-de3dccc9-4056-4b7e-826f-16b3c7dd75d3 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:28.626182 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-de3dccc9-4056-4b7e-826f-16b3c7dd75d3 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:14:28.634615 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-de3dccc9-4056-4b7e-826f-16b3c7dd75d3 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1359 microversion: 2.1 time: 0.173827 Aug 25 06:14:28.635559 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1292/2617] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:14:28 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:14:29.652818 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c853ed52-77a2-4b21-a760-a95bfad9615c tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:14:29.653512 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c853ed52-77a2-4b21-a760-a95bfad9615c tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:14:29.659820 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c853ed52-77a2-4b21-a760-a95bfad9615c tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:29.660266 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c853ed52-77a2-4b21-a760-a95bfad9615c tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:29.661031 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c853ed52-77a2-4b21-a760-a95bfad9615c tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:29.661459 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c853ed52-77a2-4b21-a760-a95bfad9615c tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:29.787356 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-c853ed52-77a2-4b21-a760-a95bfad9615c tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:14:29.795741 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c853ed52-77a2-4b21-a760-a95bfad9615c tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1359 microversion: 2.1 time: 0.147609 Aug 25 06:14:29.796301 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1326/2618] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:14:29 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:14:30.815988 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5651faa7-afec-4bc4-bb05-80c4d3c4db4d tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:14:30.816654 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5651faa7-afec-4bc4-bb05-80c4d3c4db4d tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:14:30.822676 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5651faa7-afec-4bc4-bb05-80c4d3c4db4d tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:30.823110 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5651faa7-afec-4bc4-bb05-80c4d3c4db4d tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:30.823858 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5651faa7-afec-4bc4-bb05-80c4d3c4db4d tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:30.824279 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5651faa7-afec-4bc4-bb05-80c4d3c4db4d tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:30.948397 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-5651faa7-afec-4bc4-bb05-80c4d3c4db4d tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:14:30.955701 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5651faa7-afec-4bc4-bb05-80c4d3c4db4d tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1359 microversion: 2.1 time: 0.145094 Aug 25 06:14:30.956260 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1293/2619] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:14:30 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:14:31.972541 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-16ff0b56-af2d-43ce-9850-43184153c48e tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:14:31.973142 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-16ff0b56-af2d-43ce-9850-43184153c48e tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:14:31.979185 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-16ff0b56-af2d-43ce-9850-43184153c48e tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:31.979621 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-16ff0b56-af2d-43ce-9850-43184153c48e tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:31.980378 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-16ff0b56-af2d-43ce-9850-43184153c48e tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:31.980805 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-16ff0b56-af2d-43ce-9850-43184153c48e tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:32.110337 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-16ff0b56-af2d-43ce-9850-43184153c48e tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:14:32.117841 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-16ff0b56-af2d-43ce-9850-43184153c48e tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1359 microversion: 2.1 time: 0.148861 Aug 25 06:14:32.119214 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1327/2620] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:14:31 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:14:33.136029 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1860d893-14f4-4ea6-b3e5-cb664d2aed28 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:14:33.136643 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1860d893-14f4-4ea6-b3e5-cb664d2aed28 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:14:33.142563 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1860d893-14f4-4ea6-b3e5-cb664d2aed28 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:33.143009 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1860d893-14f4-4ea6-b3e5-cb664d2aed28 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:33.143763 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1860d893-14f4-4ea6-b3e5-cb664d2aed28 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:33.144251 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1860d893-14f4-4ea6-b3e5-cb664d2aed28 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:33.272934 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-1860d893-14f4-4ea6-b3e5-cb664d2aed28 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:14:33.281801 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1860d893-14f4-4ea6-b3e5-cb664d2aed28 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1359 microversion: 2.1 time: 0.149746 Aug 25 06:14:33.282453 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1294/2621] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:14:33 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:14:34.298682 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5b4f32dd-83c4-4a58-a734-f12e4157d3b2 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:14:34.299306 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5b4f32dd-83c4-4a58-a734-f12e4157d3b2 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:14:34.305243 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5b4f32dd-83c4-4a58-a734-f12e4157d3b2 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:34.305726 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5b4f32dd-83c4-4a58-a734-f12e4157d3b2 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:34.306480 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5b4f32dd-83c4-4a58-a734-f12e4157d3b2 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:34.306912 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5b4f32dd-83c4-4a58-a734-f12e4157d3b2 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:34.447652 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-5b4f32dd-83c4-4a58-a734-f12e4157d3b2 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:14:34.455351 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5b4f32dd-83c4-4a58-a734-f12e4157d3b2 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1359 microversion: 2.1 time: 0.160333 Aug 25 06:14:34.455917 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1328/2622] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:14:34 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:14:35.438444 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [req-b2815430-6b7b-4994-9787-b80ff4a6d713 req-b2d614ad-cd91-4328-8a29-40d32d275bec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fa8553a-872a-4b76-bd51-a736a62663aa", "name": "network-vif-plugged", "status": "completed", "tag": "3748ac8a-661a-450c-8fbe-84c6728411d1"}]} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:14:35.439959 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 06:14:35.439959 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: warnings.warn(msg) Aug 25 06:14:35.448066 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-b2815430-6b7b-4994-9787-b80ff4a6d713 req-b2d614ad-cd91-4328-8a29-40d32d275bec service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:35.448510 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-b2815430-6b7b-4994-9787-b80ff4a6d713 req-b2d614ad-cd91-4328-8a29-40d32d275bec service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:35.459566 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.compute.server_external_events [req-b2815430-6b7b-4994-9787-b80ff4a6d713 req-b2d614ad-cd91-4328-8a29-40d32d275bec service nova] Creating event network-vif-plugged:3748ac8a-661a-450c-8fbe-84c6728411d1 for instance 2fa8553a-872a-4b76-bd51-a736a62663aa on hv-cinder-78662 Aug 25 06:14:35.465033 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [req-b2815430-6b7b-4994-9787-b80ff4a6d713 req-b2d614ad-cd91-4328-8a29-40d32d275bec service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030319 Aug 25 06:14:35.465653 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1295/2623] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 06:14:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:14:35.473483 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-32cb5970-13e4-45ad-a589-7a3924cd4144 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:14:35.474123 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-32cb5970-13e4-45ad-a589-7a3924cd4144 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:14:35.481166 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-32cb5970-13e4-45ad-a589-7a3924cd4144 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:35.481669 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-32cb5970-13e4-45ad-a589-7a3924cd4144 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:35.482456 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-32cb5970-13e4-45ad-a589-7a3924cd4144 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:35.482898 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-32cb5970-13e4-45ad-a589-7a3924cd4144 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:35.621432 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-32cb5970-13e4-45ad-a589-7a3924cd4144 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:14:35.632560 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-32cb5970-13e4-45ad-a589-7a3924cd4144 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1359 microversion: 2.1 time: 0.163596 Aug 25 06:14:35.633344 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1329/2624] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:14:35 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:14:36.650682 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-f482a90b-67cd-4cfe-ae61-fddb3046c62e tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:14:36.652104 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-f482a90b-67cd-4cfe-ae61-fddb3046c62e tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:14:36.658284 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f482a90b-67cd-4cfe-ae61-fddb3046c62e tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:36.658720 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f482a90b-67cd-4cfe-ae61-fddb3046c62e tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:36.659528 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f482a90b-67cd-4cfe-ae61-fddb3046c62e tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:36.660003 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f482a90b-67cd-4cfe-ae61-fddb3046c62e tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:36.786477 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-f482a90b-67cd-4cfe-ae61-fddb3046c62e tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:14:36.793970 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-f482a90b-67cd-4cfe-ae61-fddb3046c62e tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1359 microversion: 2.1 time: 0.147251 Aug 25 06:14:36.794548 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1296/2625] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:14:36 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:14:37.811630 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-f40d4947-3cd3-46ba-8376-ef58e659d775 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:14:37.812146 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-f40d4947-3cd3-46ba-8376-ef58e659d775 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:14:37.817993 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f40d4947-3cd3-46ba-8376-ef58e659d775 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:37.818439 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f40d4947-3cd3-46ba-8376-ef58e659d775 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:37.819237 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f40d4947-3cd3-46ba-8376-ef58e659d775 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:37.819669 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-f40d4947-3cd3-46ba-8376-ef58e659d775 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:37.946256 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-f40d4947-3cd3-46ba-8376-ef58e659d775 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:14:37.953587 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-f40d4947-3cd3-46ba-8376-ef58e659d775 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1549 microversion: 2.1 time: 0.146472 Aug 25 06:14:37.954151 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1330/2626] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:14:37 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1549 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:14:37.969751 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-81b99658-bda6-4405-b678-0c39449f6ae9 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:14:37.970372 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-81b99658-bda6-4405-b678-0c39449f6ae9 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:14:37.976357 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-81b99658-bda6-4405-b678-0c39449f6ae9 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:37.976832 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-81b99658-bda6-4405-b678-0c39449f6ae9 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:37.977626 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-81b99658-bda6-4405-b678-0c39449f6ae9 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:37.978091 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-81b99658-bda6-4405-b678-0c39449f6ae9 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:38.100383 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-81b99658-bda6-4405-b678-0c39449f6ae9 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:14:38.107586 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-81b99658-bda6-4405-b678-0c39449f6ae9 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1549 microversion: 2.1 time: 0.141444 Aug 25 06:14:38.108148 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1297/2627] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:14:37 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1549 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:14:38.123139 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-90eda285-7df8-44e3-bf6c-fc24f9567955 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:14:38.126700 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 06:14:38.126700 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: warnings.warn(msg) Aug 25 06:14:38.127720 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-90eda285-7df8-44e3-bf6c-fc24f9567955 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:14:38.128492 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-90eda285-7df8-44e3-bf6c-fc24f9567955 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Searching by: {'deleted': False, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d'} {{(pid=108885) get_all /opt/stack/nova/nova/compute/api.py:2867}} Aug 25 06:14:38.135038 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-90eda285-7df8-44e3-bf6c-fc24f9567955 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:38.136566 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-90eda285-7df8-44e3-bf6c-fc24f9567955 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:38.137372 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-90eda285-7df8-44e3-bf6c-fc24f9567955 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:38.137840 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-90eda285-7df8-44e3-bf6c-fc24f9567955 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:38.229049 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.multi_cell_list [None req-90eda285-7df8-44e3-bf6c-fc24f9567955 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=108885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Aug 25 06:14:38.327691 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-90eda285-7df8-44e3-bf6c-fc24f9567955 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.208518 Aug 25 06:14:38.328274 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1331/2628] 10.222.0.42 () {58 vars in 1125 bytes} [Wed Aug 25 06:14:38 2021] GET /compute/v2.1/servers => generated 343 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:14:38.338149 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5f0fd3db-cceb-4abd-adc4-be13815919b8 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:14:38.339387 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5f0fd3db-cceb-4abd-adc4-be13815919b8 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:14:38.345184 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5f0fd3db-cceb-4abd-adc4-be13815919b8 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:38.345663 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5f0fd3db-cceb-4abd-adc4-be13815919b8 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:38.346415 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5f0fd3db-cceb-4abd-adc4-be13815919b8 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:38.346843 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5f0fd3db-cceb-4abd-adc4-be13815919b8 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:38.471248 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-5f0fd3db-cceb-4abd-adc4-be13815919b8 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:14:38.478505 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5f0fd3db-cceb-4abd-adc4-be13815919b8 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1549 microversion: 2.1 time: 0.143911 Aug 25 06:14:38.479720 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1298/2629] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:14:38 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1549 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:14:40.275300 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-63b57c37-a843-4dcf-9927-395c0c35a55d tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55c01ca3-a7e1-432f-bd97-4e75a577a83c"}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:14:40.276333 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-63b57c37-a843-4dcf-9927-395c0c35a55d tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:14:40.282812 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-63b57c37-a843-4dcf-9927-395c0c35a55d tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:40.283253 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-63b57c37-a843-4dcf-9927-395c0c35a55d tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:40.284009 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-63b57c37-a843-4dcf-9927-395c0c35a55d tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:40.284644 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-63b57c37-a843-4dcf-9927-395c0c35a55d tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:41.096823 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-63b57c37-a843-4dcf-9927-395c0c35a55d tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "POST /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.825172 Aug 25 06:14:41.097455 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1332/2630] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 25 06:14:40 2021] POST /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa/os-volume_attachments => generated 194 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:14:48.667409 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-88db0026-89ac-4ee2-bfba-dddee36abcb6 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:14:48.668074 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-88db0026-89ac-4ee2-bfba-dddee36abcb6 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:14:48.674265 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-88db0026-89ac-4ee2-bfba-dddee36abcb6 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:48.674717 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-88db0026-89ac-4ee2-bfba-dddee36abcb6 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:48.675597 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-88db0026-89ac-4ee2-bfba-dddee36abcb6 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:48.676029 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-88db0026-89ac-4ee2-bfba-dddee36abcb6 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:48.801336 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-88db0026-89ac-4ee2-bfba-dddee36abcb6 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:14:48.809032 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-88db0026-89ac-4ee2-bfba-dddee36abcb6 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1595 microversion: 2.1 time: 0.145230 Aug 25 06:14:48.809632 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1299/2631] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:14:48 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1595 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:14:50.847968 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [req-001a7c26-f6d8-476b-ba05-f8b04f9f5d71 req-395fed9e-2385-466c-9e6f-1744311dfda5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fa8553a-872a-4b76-bd51-a736a62663aa", "tag": "3748ac8a-661a-450c-8fbe-84c6728411d1"}]} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:14:50.849462 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 06:14:50.849462 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: warnings.warn(msg) Aug 25 06:14:50.857925 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-001a7c26-f6d8-476b-ba05-f8b04f9f5d71 req-395fed9e-2385-466c-9e6f-1744311dfda5 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:50.858385 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-001a7c26-f6d8-476b-ba05-f8b04f9f5d71 req-395fed9e-2385-466c-9e6f-1744311dfda5 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:50.869681 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.compute.server_external_events [req-001a7c26-f6d8-476b-ba05-f8b04f9f5d71 req-395fed9e-2385-466c-9e6f-1744311dfda5 service nova] Creating event network-changed:3748ac8a-661a-450c-8fbe-84c6728411d1 for instance 2fa8553a-872a-4b76-bd51-a736a62663aa on hv-cinder-78662 Aug 25 06:14:50.875402 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [req-001a7c26-f6d8-476b-ba05-f8b04f9f5d71 req-395fed9e-2385-466c-9e6f-1744311dfda5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031810 Aug 25 06:14:50.876798 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1333/2632] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 06:14:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 06:14:53.181727 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-bac23611-79aa-4e9c-a9d3-8125238316ad tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1685652387"}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:14:53.182319 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-bac23611-79aa-4e9c-a9d3-8125238316ad tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:14:53.191579 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bac23611-79aa-4e9c-a9d3-8125238316ad tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:53.192037 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bac23611-79aa-4e9c-a9d3-8125238316ad tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:53.193250 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bac23611-79aa-4e9c-a9d3-8125238316ad tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:53.193971 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-bac23611-79aa-4e9c-a9d3-8125238316ad tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:53.317097 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.network.security_group_api [None req-bac23611-79aa-4e9c-a9d3-8125238316ad tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Adding security group 2c2015e0-c3bb-497f-9de0-9793a5264ba4 to port 3748ac8a-661a-450c-8fbe-84c6728411d1 Aug 25 06:14:53.762561 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-bac23611-79aa-4e9c-a9d3-8125238316ad tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "POST /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa/action" status: 202 len: 0 microversion: 2.1 time: 0.584827 Aug 25 06:14:53.764937 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1300/2633] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 06:14:53 2021] POST /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa/action => generated 0 bytes in 588 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 06:14:53.775281 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-232ea2b5-87e7-40c3-ba32-5861d96d29f2 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:14:53.776795 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-232ea2b5-87e7-40c3-ba32-5861d96d29f2 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:14:53.781058 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [req-a415aac3-c12b-41d4-8096-9254260c64cb req-46121ced-b4e5-440d-a405-0d5e3892d6bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fa8553a-872a-4b76-bd51-a736a62663aa", "tag": "3748ac8a-661a-450c-8fbe-84c6728411d1"}]} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:14:53.782699 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 06:14:53.782699 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: warnings.warn(msg) Aug 25 06:14:53.787644 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-232ea2b5-87e7-40c3-ba32-5861d96d29f2 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:53.787644 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-232ea2b5-87e7-40c3-ba32-5861d96d29f2 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:53.787644 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-232ea2b5-87e7-40c3-ba32-5861d96d29f2 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:53.787644 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-232ea2b5-87e7-40c3-ba32-5861d96d29f2 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:53.806799 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-a415aac3-c12b-41d4-8096-9254260c64cb req-46121ced-b4e5-440d-a405-0d5e3892d6bf service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:14:53.807235 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-a415aac3-c12b-41d4-8096-9254260c64cb req-46121ced-b4e5-440d-a405-0d5e3892d6bf service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:14:53.832097 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.compute.server_external_events [req-a415aac3-c12b-41d4-8096-9254260c64cb req-46121ced-b4e5-440d-a405-0d5e3892d6bf service nova] Creating event network-changed:3748ac8a-661a-450c-8fbe-84c6728411d1 for instance 2fa8553a-872a-4b76-bd51-a736a62663aa on hv-cinder-78662 Aug 25 06:14:53.839292 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [req-a415aac3-c12b-41d4-8096-9254260c64cb req-46121ced-b4e5-440d-a405-0d5e3892d6bf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062319 Aug 25 06:14:53.840721 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1301/2634] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 06:14:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:14:53.932454 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-232ea2b5-87e7-40c3-ba32-5861d96d29f2 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:14:53.940953 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-232ea2b5-87e7-40c3-ba32-5861d96d29f2 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1760 microversion: 2.1 time: 0.171124 Aug 25 06:14:53.942291 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1334/2635] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:14:53 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1760 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:15:30.393711 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-0a28e4cc-b8e4-44bc-81e8-c7311d36fba8 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:15:30.394310 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-0a28e4cc-b8e4-44bc-81e8-c7311d36fba8 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 9d9f8dc3-f9d4-4a88-8256-b1610447efbe] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:15:30.400657 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0a28e4cc-b8e4-44bc-81e8-c7311d36fba8 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:30.401098 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0a28e4cc-b8e4-44bc-81e8-c7311d36fba8 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:30.402143 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0a28e4cc-b8e4-44bc-81e8-c7311d36fba8 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:30.402930 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0a28e4cc-b8e4-44bc-81e8-c7311d36fba8 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:30.431661 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-0a28e4cc-b8e4-44bc-81e8-c7311d36fba8 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 9d9f8dc3-f9d4-4a88-8256-b1610447efbe] Going to try to terminate instance {{(pid=108884) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 25 06:15:30.782134 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-0a28e4cc-b8e4-44bc-81e8-c7311d36fba8 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe" status: 204 len: 0 microversion: 2.1 time: 0.392123 Aug 25 06:15:30.782733 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1302/2636] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 25 06:15:30 2021] DELETE /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 06:15:30.791661 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a83b91d5-884f-45ba-bf3c-ee2c03fc0771 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:15:30.792277 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a83b91d5-884f-45ba-bf3c-ee2c03fc0771 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 9d9f8dc3-f9d4-4a88-8256-b1610447efbe] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:15:30.798280 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a83b91d5-884f-45ba-bf3c-ee2c03fc0771 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:30.798727 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a83b91d5-884f-45ba-bf3c-ee2c03fc0771 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:30.799491 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a83b91d5-884f-45ba-bf3c-ee2c03fc0771 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:30.799927 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-a83b91d5-884f-45ba-bf3c-ee2c03fc0771 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:30.925242 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-a83b91d5-884f-45ba-bf3c-ee2c03fc0771 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:15:30.933139 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a83b91d5-884f-45ba-bf3c-ee2c03fc0771 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe" status: 200 len: 1574 microversion: 2.1 time: 0.145868 Aug 25 06:15:30.933746 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1335/2637] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:15:30 2021] GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe => generated 1574 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:15:31.952721 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d3bc5bf6-1f4e-452c-9dc0-65828152e059 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:15:31.957288 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-d3bc5bf6-1f4e-452c-9dc0-65828152e059 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 9d9f8dc3-f9d4-4a88-8256-b1610447efbe] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:15:31.959685 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d3bc5bf6-1f4e-452c-9dc0-65828152e059 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:31.960124 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d3bc5bf6-1f4e-452c-9dc0-65828152e059 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:31.960874 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d3bc5bf6-1f4e-452c-9dc0-65828152e059 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:31.961299 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-d3bc5bf6-1f4e-452c-9dc0-65828152e059 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:32.089214 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-d3bc5bf6-1f4e-452c-9dc0-65828152e059 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:15:32.101478 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d3bc5bf6-1f4e-452c-9dc0-65828152e059 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe" status: 200 len: 1574 microversion: 2.1 time: 0.154226 Aug 25 06:15:32.102569 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1303/2638] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:15:31 2021] GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:15:33.120099 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b18c28f8-e587-40f6-8a9d-d108f0941972 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:15:33.120663 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b18c28f8-e587-40f6-8a9d-d108f0941972 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 9d9f8dc3-f9d4-4a88-8256-b1610447efbe] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:15:33.126807 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b18c28f8-e587-40f6-8a9d-d108f0941972 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:33.127332 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b18c28f8-e587-40f6-8a9d-d108f0941972 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:33.128140 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b18c28f8-e587-40f6-8a9d-d108f0941972 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:33.128573 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b18c28f8-e587-40f6-8a9d-d108f0941972 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:33.256651 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-b18c28f8-e587-40f6-8a9d-d108f0941972 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:15:33.269050 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b18c28f8-e587-40f6-8a9d-d108f0941972 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe" status: 200 len: 1574 microversion: 2.1 time: 0.153241 Aug 25 06:15:33.269669 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1336/2639] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:15:33 2021] GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 06:15:33.951235 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [req-f86afad5-67d3-44cf-b351-9950f3f6bb45 req-a379fe37-5495-435d-b3df-ec90283533b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d9f8dc3-f9d4-4a88-8256-b1610447efbe", "name": "network-vif-deleted", "tag": "4cce5795-f55b-496e-be3e-0c2d69f9ab93"}]} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:15:33.952800 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 06:15:33.952800 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: warnings.warn(msg) Aug 25 06:15:33.960316 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-f86afad5-67d3-44cf-b351-9950f3f6bb45 req-a379fe37-5495-435d-b3df-ec90283533b9 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:33.960869 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-f86afad5-67d3-44cf-b351-9950f3f6bb45 req-a379fe37-5495-435d-b3df-ec90283533b9 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:33.973148 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.compute.server_external_events [req-f86afad5-67d3-44cf-b351-9950f3f6bb45 req-a379fe37-5495-435d-b3df-ec90283533b9 service nova] Creating event network-vif-deleted:4cce5795-f55b-496e-be3e-0c2d69f9ab93 for instance 9d9f8dc3-f9d4-4a88-8256-b1610447efbe on hv-cinder-78662 Aug 25 06:15:33.979715 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [req-f86afad5-67d3-44cf-b351-9950f3f6bb45 req-a379fe37-5495-435d-b3df-ec90283533b9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031939 Aug 25 06:15:33.980312 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1304/2640] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 06:15:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:15:34.285818 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6be1c154-bb86-46d3-9e46-bd7e0692fcc4 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:15:34.286462 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6be1c154-bb86-46d3-9e46-bd7e0692fcc4 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 9d9f8dc3-f9d4-4a88-8256-b1610447efbe] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:15:34.292991 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6be1c154-bb86-46d3-9e46-bd7e0692fcc4 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:34.293468 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6be1c154-bb86-46d3-9e46-bd7e0692fcc4 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:34.294276 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6be1c154-bb86-46d3-9e46-bd7e0692fcc4 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:34.294709 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6be1c154-bb86-46d3-9e46-bd7e0692fcc4 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:34.364770 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-6be1c154-bb86-46d3-9e46-bd7e0692fcc4 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:15:34.373816 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6be1c154-bb86-46d3-9e46-bd7e0692fcc4 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe" status: 200 len: 1223 microversion: 2.1 time: 0.091495 Aug 25 06:15:34.374413 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1337/2641] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:15:34 2021] GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:15:35.391685 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ecabf6ba-5357-4d34-badf-c77c789bd183 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:15:35.392415 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ecabf6ba-5357-4d34-badf-c77c789bd183 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 9d9f8dc3-f9d4-4a88-8256-b1610447efbe] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:15:35.398533 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ecabf6ba-5357-4d34-badf-c77c789bd183 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:35.399048 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ecabf6ba-5357-4d34-badf-c77c789bd183 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:35.399894 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ecabf6ba-5357-4d34-badf-c77c789bd183 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:35.400329 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ecabf6ba-5357-4d34-badf-c77c789bd183 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:35.413691 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.wsgi [None req-ecabf6ba-5357-4d34-badf-c77c789bd183 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] HTTP exception thrown: Instance 9d9f8dc3-f9d4-4a88-8256-b1610447efbe could not be found. Aug 25 06:15:35.414269 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ecabf6ba-5357-4d34-badf-c77c789bd183 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Returning 404 to user: Instance 9d9f8dc3-f9d4-4a88-8256-b1610447efbe could not be found. {{(pid=108884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 06:15:35.415193 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ecabf6ba-5357-4d34-badf-c77c789bd183 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe" status: 404 len: 111 microversion: 2.1 time: 0.027560 Aug 25 06:15:35.415718 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1305/2642] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:15:35 2021] GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 06:15:35.510643 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6763954c-bd61-4046-b631-6d443402c9fb tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2142001841", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-7372938", "security_groups": [{"name": "tempest-secgroup-smoke-123090279"}], "block_device_mapping_v2": [{"uuid": "6a60e7f7-71ce-4aea-a41f-fbe85b5e00af", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fc0081a5-5e60-4209-8f34-8444a2664985"}]}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:15:35.613096 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.network.neutron [None req-6763954c-bd61-4046-b631-6d443402c9fb tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] validate_networks() for [('fc0081a5-5e60-4209-8f34-8444a2664985', None, None, None, None, None)] {{(pid=108885) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 25 06:15:36.217876 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-6763954c-bd61-4046-b631-6d443402c9fb tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Flavor limits 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 06:15:36.218302 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-6763954c-bd61-4046-b631-6d443402c9fb tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Image limits 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 06:15:36.218773 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-6763954c-bd61-4046-b631-6d443402c9fb tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Flavor pref 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 06:15:36.219178 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-6763954c-bd61-4046-b631-6d443402c9fb tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Image pref 0:0:0 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 06:15:36.219611 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.virt.hardware [None req-6763954c-bd61-4046-b631-6d443402c9fb tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 06:15:36.228430 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6763954c-bd61-4046-b631-6d443402c9fb tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:36.228878 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6763954c-bd61-4046-b631-6d443402c9fb tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:36.229714 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6763954c-bd61-4046-b631-6d443402c9fb tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:36.230146 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6763954c-bd61-4046-b631-6d443402c9fb tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:36.246681 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.quota [None req-6763954c-bd61-4046-b631-6d443402c9fb tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Getting quotas for project 8b15de72ab1c4793bb72e45a48d7e893. Resources: {'ram', 'cores', 'instances'} {{(pid=108885) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 06:15:36.250810 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.quota [None req-6763954c-bd61-4046-b631-6d443402c9fb tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Getting quotas for user eab9d592e3d649bd8faa4a9e6081a14a and project 8b15de72ab1c4793bb72e45a48d7e893. Resources: {'ram', 'cores', 'instances'} {{(pid=108885) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 06:15:36.311196 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6763954c-bd61-4046-b631-6d443402c9fb tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Going to run 1 instances... {{(pid=108885) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 25 06:15:36.313321 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6763954c-bd61-4046-b631-6d443402c9fb tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 26eaf280-26f2-4b1f-8593-3e46e64a40e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6a60e7f7-71ce-4aea-a41f-fbe85b5e00af',volume_size=None,volume_type=None)] {{(pid=108885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 25 06:15:36.709001 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6763954c-bd61-4046-b631-6d443402c9fb tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.202613 Aug 25 06:15:36.709954 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1338/2643] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 25 06:15:35 2021] POST /compute/v2.1/servers => generated 405 bytes in 1204 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 06:15:36.719567 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5c193c7a-f47a-46f0-9fd3-784e469a088d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:15:36.720176 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5c193c7a-f47a-46f0-9fd3-784e469a088d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 26eaf280-26f2-4b1f-8593-3e46e64a40e3] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:15:36.773560 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-5c193c7a-f47a-46f0-9fd3-784e469a088d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:15:36.780407 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5c193c7a-f47a-46f0-9fd3-784e469a088d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3" status: 200 len: 1092 microversion: 2.1 time: 0.064591 Aug 25 06:15:36.780965 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1306/2644] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:15:36 2021] GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3 => generated 1092 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:15:37.797514 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b9a5a568-1411-4e9f-941b-e6be8c7c3d3a tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:15:37.797983 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b9a5a568-1411-4e9f-941b-e6be8c7c3d3a tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 26eaf280-26f2-4b1f-8593-3e46e64a40e3] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:15:37.853312 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-b9a5a568-1411-4e9f-941b-e6be8c7c3d3a tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:15:37.860253 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b9a5a568-1411-4e9f-941b-e6be8c7c3d3a tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3" status: 200 len: 1092 microversion: 2.1 time: 0.067107 Aug 25 06:15:37.860817 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1339/2645] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:15:37 2021] GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3 => generated 1092 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:15:38.877402 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-ad5e035d-87aa-44b7-b8bc-a7987366d4dc tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:15:38.878031 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-ad5e035d-87aa-44b7-b8bc-a7987366d4dc tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 26eaf280-26f2-4b1f-8593-3e46e64a40e3] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:15:38.885347 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ad5e035d-87aa-44b7-b8bc-a7987366d4dc tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:38.885818 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ad5e035d-87aa-44b7-b8bc-a7987366d4dc tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:38.886567 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ad5e035d-87aa-44b7-b8bc-a7987366d4dc tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:38.886994 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-ad5e035d-87aa-44b7-b8bc-a7987366d4dc tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:38.948430 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-ad5e035d-87aa-44b7-b8bc-a7987366d4dc tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:15:38.958524 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-ad5e035d-87aa-44b7-b8bc-a7987366d4dc tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3" status: 200 len: 1134 microversion: 2.1 time: 0.084695 Aug 25 06:15:38.959113 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1307/2646] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:15:38 2021] GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3 => generated 1134 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 06:15:39.976115 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-fa5d8439-fb11-4534-b32d-7294bf88a527 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:15:39.977455 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-fa5d8439-fb11-4534-b32d-7294bf88a527 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 26eaf280-26f2-4b1f-8593-3e46e64a40e3] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:15:39.983500 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fa5d8439-fb11-4534-b32d-7294bf88a527 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:39.988511 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fa5d8439-fb11-4534-b32d-7294bf88a527 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:39.988511 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fa5d8439-fb11-4534-b32d-7294bf88a527 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:39.988511 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-fa5d8439-fb11-4534-b32d-7294bf88a527 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:40.046943 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-fa5d8439-fb11-4534-b32d-7294bf88a527 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:15:40.054664 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-fa5d8439-fb11-4534-b32d-7294bf88a527 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3" status: 200 len: 1208 microversion: 2.1 time: 0.082227 Aug 25 06:15:40.055454 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1340/2647] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:15:39 2021] GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3 => generated 1208 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:15:41.072726 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-1eda4c74-59cb-4fe2-84c5-3f73a826c008 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:15:41.074012 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-1eda4c74-59cb-4fe2-84c5-3f73a826c008 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 26eaf280-26f2-4b1f-8593-3e46e64a40e3] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:15:41.080659 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1eda4c74-59cb-4fe2-84c5-3f73a826c008 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:41.081564 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1eda4c74-59cb-4fe2-84c5-3f73a826c008 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:41.082313 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1eda4c74-59cb-4fe2-84c5-3f73a826c008 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:41.082773 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-1eda4c74-59cb-4fe2-84c5-3f73a826c008 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:41.220153 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-1eda4c74-59cb-4fe2-84c5-3f73a826c008 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:15:41.227412 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-1eda4c74-59cb-4fe2-84c5-3f73a826c008 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3" status: 200 len: 1275 microversion: 2.1 time: 0.159171 Aug 25 06:15:41.227968 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1308/2648] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:15:41 2021] GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3 => generated 1275 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:15:41.314999 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [req-768f69f4-0825-4f38-a1f5-27ece530f15a req-59e1b4d8-a6ae-4370-801c-e2b2e6c7439a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26eaf280-26f2-4b1f-8593-3e46e64a40e3", "tag": "bc5e31d2-6b9c-482c-8369-61575572cea8"}]} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:15:41.316880 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 06:15:41.316880 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: warnings.warn(msg) Aug 25 06:15:41.324769 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-768f69f4-0825-4f38-a1f5-27ece530f15a req-59e1b4d8-a6ae-4370-801c-e2b2e6c7439a service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:41.325039 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-768f69f4-0825-4f38-a1f5-27ece530f15a req-59e1b4d8-a6ae-4370-801c-e2b2e6c7439a service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:41.342263 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.compute.server_external_events [req-768f69f4-0825-4f38-a1f5-27ece530f15a req-59e1b4d8-a6ae-4370-801c-e2b2e6c7439a service nova] Creating event network-changed:bc5e31d2-6b9c-482c-8369-61575572cea8 for instance 26eaf280-26f2-4b1f-8593-3e46e64a40e3 on hv-cinder-78662 Aug 25 06:15:41.347305 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [req-768f69f4-0825-4f38-a1f5-27ece530f15a req-59e1b4d8-a6ae-4370-801c-e2b2e6c7439a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038072 Aug 25 06:15:41.347902 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1341/2649] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 06:15:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:15:42.242614 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-fdc2fc52-285b-475e-95e0-fb92fd2748db tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:15:42.243216 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-fdc2fc52-285b-475e-95e0-fb92fd2748db tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 26eaf280-26f2-4b1f-8593-3e46e64a40e3] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:15:42.249165 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fdc2fc52-285b-475e-95e0-fb92fd2748db tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:42.249638 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fdc2fc52-285b-475e-95e0-fb92fd2748db tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:42.250386 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fdc2fc52-285b-475e-95e0-fb92fd2748db tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:42.250838 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fdc2fc52-285b-475e-95e0-fb92fd2748db tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:42.369365 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-fdc2fc52-285b-475e-95e0-fb92fd2748db tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:15:42.376835 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-fdc2fc52-285b-475e-95e0-fb92fd2748db tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3" status: 200 len: 1263 microversion: 2.1 time: 0.137880 Aug 25 06:15:42.377403 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1309/2650] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:15:42 2021] GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3 => generated 1263 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:15:43.394056 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6326bce3-1205-47b6-a736-9937571f5143 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:15:43.394783 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6326bce3-1205-47b6-a736-9937571f5143 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 26eaf280-26f2-4b1f-8593-3e46e64a40e3] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:15:43.401223 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6326bce3-1205-47b6-a736-9937571f5143 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:43.401681 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6326bce3-1205-47b6-a736-9937571f5143 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:43.402444 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6326bce3-1205-47b6-a736-9937571f5143 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:43.402870 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6326bce3-1205-47b6-a736-9937571f5143 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:43.528403 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-6326bce3-1205-47b6-a736-9937571f5143 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:15:43.536327 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6326bce3-1205-47b6-a736-9937571f5143 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3" status: 200 len: 1263 microversion: 2.1 time: 0.146325 Aug 25 06:15:43.536905 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1342/2651] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:15:43 2021] GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3 => generated 1263 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:15:44.553041 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5e51b9ff-a241-4187-a60d-bdba455f22bf tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:15:44.553684 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5e51b9ff-a241-4187-a60d-bdba455f22bf tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 26eaf280-26f2-4b1f-8593-3e46e64a40e3] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:15:44.559647 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5e51b9ff-a241-4187-a60d-bdba455f22bf tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:44.560104 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5e51b9ff-a241-4187-a60d-bdba455f22bf tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:44.560866 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5e51b9ff-a241-4187-a60d-bdba455f22bf tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:44.561296 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5e51b9ff-a241-4187-a60d-bdba455f22bf tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:44.690593 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-5e51b9ff-a241-4187-a60d-bdba455f22bf tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:15:44.699307 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5e51b9ff-a241-4187-a60d-bdba455f22bf tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3" status: 200 len: 1263 microversion: 2.1 time: 0.149868 Aug 25 06:15:44.699880 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1310/2652] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:15:44 2021] GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3 => generated 1263 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:15:45.716941 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-360afd36-3fd5-44ad-95bb-634491d1cb07 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:15:45.717567 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-360afd36-3fd5-44ad-95bb-634491d1cb07 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 26eaf280-26f2-4b1f-8593-3e46e64a40e3] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:15:45.723832 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-360afd36-3fd5-44ad-95bb-634491d1cb07 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:45.724310 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-360afd36-3fd5-44ad-95bb-634491d1cb07 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:45.725081 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-360afd36-3fd5-44ad-95bb-634491d1cb07 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:45.725514 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-360afd36-3fd5-44ad-95bb-634491d1cb07 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:45.851874 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-360afd36-3fd5-44ad-95bb-634491d1cb07 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:15:45.860428 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-360afd36-3fd5-44ad-95bb-634491d1cb07 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3" status: 200 len: 1263 microversion: 2.1 time: 0.147166 Aug 25 06:15:45.861007 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1343/2653] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:15:45 2021] GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3 => generated 1263 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:15:46.878501 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8188b953-d995-4ed3-84e1-b8c5dbd01f0a tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:15:46.879306 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8188b953-d995-4ed3-84e1-b8c5dbd01f0a tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 26eaf280-26f2-4b1f-8593-3e46e64a40e3] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:15:46.885253 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8188b953-d995-4ed3-84e1-b8c5dbd01f0a tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:46.885730 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8188b953-d995-4ed3-84e1-b8c5dbd01f0a tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:46.886492 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8188b953-d995-4ed3-84e1-b8c5dbd01f0a tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:46.886918 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8188b953-d995-4ed3-84e1-b8c5dbd01f0a tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:47.015501 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-8188b953-d995-4ed3-84e1-b8c5dbd01f0a tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:15:47.022805 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8188b953-d995-4ed3-84e1-b8c5dbd01f0a tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3" status: 200 len: 1263 microversion: 2.1 time: 0.148013 Aug 25 06:15:47.023383 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1311/2654] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:15:46 2021] GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3 => generated 1263 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:15:48.040200 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-aa6729ab-30b6-4d3e-9b3e-476767b55c7e tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:15:48.040800 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-aa6729ab-30b6-4d3e-9b3e-476767b55c7e tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 26eaf280-26f2-4b1f-8593-3e46e64a40e3] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:15:48.046677 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-aa6729ab-30b6-4d3e-9b3e-476767b55c7e tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:48.047115 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-aa6729ab-30b6-4d3e-9b3e-476767b55c7e tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:48.047876 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-aa6729ab-30b6-4d3e-9b3e-476767b55c7e tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:48.048301 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-aa6729ab-30b6-4d3e-9b3e-476767b55c7e tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:48.179927 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-aa6729ab-30b6-4d3e-9b3e-476767b55c7e tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:15:48.187957 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-aa6729ab-30b6-4d3e-9b3e-476767b55c7e tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3" status: 200 len: 1263 microversion: 2.1 time: 0.151911 Aug 25 06:15:48.188552 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1344/2655] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:15:48 2021] GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3 => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:15:49.204397 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-938ffd5f-2ff1-43a1-bb45-52794222b0c5 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:15:49.204979 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-938ffd5f-2ff1-43a1-bb45-52794222b0c5 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 26eaf280-26f2-4b1f-8593-3e46e64a40e3] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:15:49.210963 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-938ffd5f-2ff1-43a1-bb45-52794222b0c5 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:49.211409 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-938ffd5f-2ff1-43a1-bb45-52794222b0c5 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:49.212732 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-938ffd5f-2ff1-43a1-bb45-52794222b0c5 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:49.213160 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-938ffd5f-2ff1-43a1-bb45-52794222b0c5 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:49.353641 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-938ffd5f-2ff1-43a1-bb45-52794222b0c5 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:15:49.360920 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-938ffd5f-2ff1-43a1-bb45-52794222b0c5 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3" status: 200 len: 1263 microversion: 2.1 time: 0.160185 Aug 25 06:15:49.361493 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1312/2656] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:15:49 2021] GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3 => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:15:50.378741 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-2e04a961-93e5-4d9e-be8c-c70cce295c0e tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:15:50.379334 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-2e04a961-93e5-4d9e-be8c-c70cce295c0e tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 26eaf280-26f2-4b1f-8593-3e46e64a40e3] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:15:50.385293 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2e04a961-93e5-4d9e-be8c-c70cce295c0e tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:50.385780 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2e04a961-93e5-4d9e-be8c-c70cce295c0e tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:50.386516 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2e04a961-93e5-4d9e-be8c-c70cce295c0e tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:50.386941 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-2e04a961-93e5-4d9e-be8c-c70cce295c0e tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:50.505325 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-2e04a961-93e5-4d9e-be8c-c70cce295c0e tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:15:50.512944 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-2e04a961-93e5-4d9e-be8c-c70cce295c0e tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3" status: 200 len: 1263 microversion: 2.1 time: 0.137892 Aug 25 06:15:50.513604 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1345/2657] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:15:50 2021] GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3 => generated 1263 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:15:51.533598 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8be2ecb5-7f11-4694-b2bb-7f92fa361caa tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:15:51.533598 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8be2ecb5-7f11-4694-b2bb-7f92fa361caa tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 26eaf280-26f2-4b1f-8593-3e46e64a40e3] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:15:51.536569 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8be2ecb5-7f11-4694-b2bb-7f92fa361caa tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:51.537015 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8be2ecb5-7f11-4694-b2bb-7f92fa361caa tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:51.537809 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8be2ecb5-7f11-4694-b2bb-7f92fa361caa tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:51.538246 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8be2ecb5-7f11-4694-b2bb-7f92fa361caa tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:51.664149 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-8be2ecb5-7f11-4694-b2bb-7f92fa361caa tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:15:51.671766 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8be2ecb5-7f11-4694-b2bb-7f92fa361caa tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3" status: 200 len: 1263 microversion: 2.1 time: 0.145390 Aug 25 06:15:51.672456 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1313/2658] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:15:51 2021] GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3 => generated 1263 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:15:51.681726 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-bc684e39-c078-4387-a05a-e44e1a06c648 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:15:51.682679 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-bc684e39-c078-4387-a05a-e44e1a06c648 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:15:51.688432 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bc684e39-c078-4387-a05a-e44e1a06c648 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:51.688881 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bc684e39-c078-4387-a05a-e44e1a06c648 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:51.689679 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bc684e39-c078-4387-a05a-e44e1a06c648 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:51.690117 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-bc684e39-c078-4387-a05a-e44e1a06c648 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:51.903940 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-bc684e39-c078-4387-a05a-e44e1a06c648 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "POST /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa/action" status: 202 len: 0 microversion: 2.1 time: 0.226244 Aug 25 06:15:51.904667 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1346/2659] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 06:15:51 2021] POST /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 06:15:51.912465 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8fd54313-c2a4-4e0b-ab48-9bbe71d42e07 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:15:51.916595 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8fd54313-c2a4-4e0b-ab48-9bbe71d42e07 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:15:51.919106 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8fd54313-c2a4-4e0b-ab48-9bbe71d42e07 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:51.919549 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8fd54313-c2a4-4e0b-ab48-9bbe71d42e07 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:51.920305 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8fd54313-c2a4-4e0b-ab48-9bbe71d42e07 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:51.920728 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8fd54313-c2a4-4e0b-ab48-9bbe71d42e07 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:52.050720 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-8fd54313-c2a4-4e0b-ab48-9bbe71d42e07 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:15:52.059172 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8fd54313-c2a4-4e0b-ab48-9bbe71d42e07 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1752 microversion: 2.1 time: 0.150310 Aug 25 06:15:52.059868 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1314/2660] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:15:51 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:15:52.688547 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-97bfeb4a-fb45-4ddb-8448-a1df4a3806cb tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:15:52.689151 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-97bfeb4a-fb45-4ddb-8448-a1df4a3806cb tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 26eaf280-26f2-4b1f-8593-3e46e64a40e3] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:15:52.694999 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-97bfeb4a-fb45-4ddb-8448-a1df4a3806cb tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:52.695465 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-97bfeb4a-fb45-4ddb-8448-a1df4a3806cb tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:52.696969 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-97bfeb4a-fb45-4ddb-8448-a1df4a3806cb tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:52.697399 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-97bfeb4a-fb45-4ddb-8448-a1df4a3806cb tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:52.824005 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-97bfeb4a-fb45-4ddb-8448-a1df4a3806cb tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:15:52.831209 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-97bfeb4a-fb45-4ddb-8448-a1df4a3806cb tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3" status: 200 len: 1263 microversion: 2.1 time: 0.146699 Aug 25 06:15:52.831746 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1347/2661] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:15:52 2021] GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3 => generated 1263 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:15:53.075923 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-2ab61d90-34ab-48ee-bda5-d8c11868ba30 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:15:53.076536 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-2ab61d90-34ab-48ee-bda5-d8c11868ba30 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:15:53.082503 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2ab61d90-34ab-48ee-bda5-d8c11868ba30 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:53.082934 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2ab61d90-34ab-48ee-bda5-d8c11868ba30 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:53.083675 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2ab61d90-34ab-48ee-bda5-d8c11868ba30 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:53.084380 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2ab61d90-34ab-48ee-bda5-d8c11868ba30 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:53.220032 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-2ab61d90-34ab-48ee-bda5-d8c11868ba30 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:15:53.228366 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-2ab61d90-34ab-48ee-bda5-d8c11868ba30 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1757 microversion: 2.1 time: 0.156040 Aug 25 06:15:53.228950 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1315/2662] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:15:53 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1757 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:15:53.770044 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [req-77822374-9e89-4c40-ae80-232ded52d935 req-138febef-fab4-4b6b-b12f-dc3777cdb176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26eaf280-26f2-4b1f-8593-3e46e64a40e3", "name": "network-vif-plugged", "status": "completed", "tag": "bc5e31d2-6b9c-482c-8369-61575572cea8"}]} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:15:53.771536 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 06:15:53.771536 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: warnings.warn(msg) Aug 25 06:15:53.779282 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-77822374-9e89-4c40-ae80-232ded52d935 req-138febef-fab4-4b6b-b12f-dc3777cdb176 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:53.779725 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-77822374-9e89-4c40-ae80-232ded52d935 req-138febef-fab4-4b6b-b12f-dc3777cdb176 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:53.792526 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.compute.server_external_events [req-77822374-9e89-4c40-ae80-232ded52d935 req-138febef-fab4-4b6b-b12f-dc3777cdb176 service nova] Creating event network-vif-plugged:bc5e31d2-6b9c-482c-8369-61575572cea8 for instance 26eaf280-26f2-4b1f-8593-3e46e64a40e3 on hv-cinder-78662 Aug 25 06:15:53.797661 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [req-77822374-9e89-4c40-ae80-232ded52d935 req-138febef-fab4-4b6b-b12f-dc3777cdb176 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031535 Aug 25 06:15:53.798236 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1348/2663] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 06:15:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:15:53.846988 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-3bbeb463-44c0-4734-9495-59cf0d56bd7d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:15:53.847597 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-3bbeb463-44c0-4734-9495-59cf0d56bd7d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 26eaf280-26f2-4b1f-8593-3e46e64a40e3] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:15:53.854055 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3bbeb463-44c0-4734-9495-59cf0d56bd7d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:53.854498 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3bbeb463-44c0-4734-9495-59cf0d56bd7d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:53.855255 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3bbeb463-44c0-4734-9495-59cf0d56bd7d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:53.855673 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-3bbeb463-44c0-4734-9495-59cf0d56bd7d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:53.979824 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-3bbeb463-44c0-4734-9495-59cf0d56bd7d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:15:53.987173 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-3bbeb463-44c0-4734-9495-59cf0d56bd7d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3" status: 200 len: 1263 microversion: 2.1 time: 0.143834 Aug 25 06:15:53.987718 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1316/2664] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:15:53 2021] GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3 => generated 1263 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:15:54.245925 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-52f5cf7b-fe7b-4e32-8f81-2f839dd67945 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:15:54.246640 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-52f5cf7b-fe7b-4e32-8f81-2f839dd67945 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:15:54.252894 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-52f5cf7b-fe7b-4e32-8f81-2f839dd67945 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:54.253337 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-52f5cf7b-fe7b-4e32-8f81-2f839dd67945 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:54.254166 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-52f5cf7b-fe7b-4e32-8f81-2f839dd67945 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:54.254598 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-52f5cf7b-fe7b-4e32-8f81-2f839dd67945 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:54.375840 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-52f5cf7b-fe7b-4e32-8f81-2f839dd67945 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:15:54.383564 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-52f5cf7b-fe7b-4e32-8f81-2f839dd67945 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1757 microversion: 2.1 time: 0.141859 Aug 25 06:15:54.384126 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1349/2665] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:15:54 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1757 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:15:55.004265 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-5fe25105-49c3-4509-b6ac-6f1b5c95063f tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:15:55.004931 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-5fe25105-49c3-4509-b6ac-6f1b5c95063f tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 26eaf280-26f2-4b1f-8593-3e46e64a40e3] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:15:55.011419 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5fe25105-49c3-4509-b6ac-6f1b5c95063f tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:55.011872 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5fe25105-49c3-4509-b6ac-6f1b5c95063f tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:55.012628 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5fe25105-49c3-4509-b6ac-6f1b5c95063f tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:55.013058 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-5fe25105-49c3-4509-b6ac-6f1b5c95063f tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:55.146096 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-5fe25105-49c3-4509-b6ac-6f1b5c95063f tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:15:55.153547 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-5fe25105-49c3-4509-b6ac-6f1b5c95063f tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3" status: 200 len: 1263 microversion: 2.1 time: 0.152838 Aug 25 06:15:55.154113 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1317/2666] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:15:54 2021] GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3 => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:15:55.401181 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d8bad7ee-ee04-4e33-8fae-4aca36cb2b9a tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:15:55.401806 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d8bad7ee-ee04-4e33-8fae-4aca36cb2b9a tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:15:55.408120 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d8bad7ee-ee04-4e33-8fae-4aca36cb2b9a tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:55.408564 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d8bad7ee-ee04-4e33-8fae-4aca36cb2b9a tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:55.409386 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d8bad7ee-ee04-4e33-8fae-4aca36cb2b9a tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:55.409846 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d8bad7ee-ee04-4e33-8fae-4aca36cb2b9a tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:55.537051 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-d8bad7ee-ee04-4e33-8fae-4aca36cb2b9a tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:15:55.545512 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d8bad7ee-ee04-4e33-8fae-4aca36cb2b9a tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1757 microversion: 2.1 time: 0.148566 Aug 25 06:15:55.546108 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1350/2667] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:15:55 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1757 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:15:56.170348 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-09dde10d-2644-42cd-a553-ba9b2939c383 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:15:56.170980 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-09dde10d-2644-42cd-a553-ba9b2939c383 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 26eaf280-26f2-4b1f-8593-3e46e64a40e3] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:15:56.176771 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-09dde10d-2644-42cd-a553-ba9b2939c383 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:56.177214 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-09dde10d-2644-42cd-a553-ba9b2939c383 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:56.177994 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-09dde10d-2644-42cd-a553-ba9b2939c383 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:56.178421 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-09dde10d-2644-42cd-a553-ba9b2939c383 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:56.298459 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-09dde10d-2644-42cd-a553-ba9b2939c383 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:15:56.306121 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-09dde10d-2644-42cd-a553-ba9b2939c383 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3" status: 200 len: 1450 microversion: 2.1 time: 0.139326 Aug 25 06:15:56.306699 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1318/2668] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:15:56 2021] GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3 => generated 1450 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:15:56.321964 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b629abf8-1077-451e-9762-1fdf2f47a7b7 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:15:56.322575 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b629abf8-1077-451e-9762-1fdf2f47a7b7 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 26eaf280-26f2-4b1f-8593-3e46e64a40e3] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:15:56.328508 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b629abf8-1077-451e-9762-1fdf2f47a7b7 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:56.328954 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b629abf8-1077-451e-9762-1fdf2f47a7b7 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:56.329748 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b629abf8-1077-451e-9762-1fdf2f47a7b7 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:56.330184 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b629abf8-1077-451e-9762-1fdf2f47a7b7 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:56.454148 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-b629abf8-1077-451e-9762-1fdf2f47a7b7 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:15:56.461736 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b629abf8-1077-451e-9762-1fdf2f47a7b7 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3" status: 200 len: 1450 microversion: 2.1 time: 0.143775 Aug 25 06:15:56.462305 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1351/2669] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:15:56 2021] GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3 => generated 1450 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:15:56.562706 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-abbc1d27-19ac-4fb6-9c9f-144f3b72c531 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:15:56.563315 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-abbc1d27-19ac-4fb6-9c9f-144f3b72c531 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:15:56.569114 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-abbc1d27-19ac-4fb6-9c9f-144f3b72c531 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:56.569587 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-abbc1d27-19ac-4fb6-9c9f-144f3b72c531 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:56.570911 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-abbc1d27-19ac-4fb6-9c9f-144f3b72c531 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:56.571448 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-abbc1d27-19ac-4fb6-9c9f-144f3b72c531 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:56.740884 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-abbc1d27-19ac-4fb6-9c9f-144f3b72c531 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:15:56.749176 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-abbc1d27-19ac-4fb6-9c9f-144f3b72c531 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1757 microversion: 2.1 time: 0.190030 Aug 25 06:15:56.749805 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1319/2670] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:15:56 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1757 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:15:57.765676 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-633fc136-0faa-45be-8a2c-48205036c4f8 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:15:57.766430 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-633fc136-0faa-45be-8a2c-48205036c4f8 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:15:57.772138 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-633fc136-0faa-45be-8a2c-48205036c4f8 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:57.777880 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-633fc136-0faa-45be-8a2c-48205036c4f8 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:57.777880 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-633fc136-0faa-45be-8a2c-48205036c4f8 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:57.777880 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-633fc136-0faa-45be-8a2c-48205036c4f8 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:58.040938 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-633fc136-0faa-45be-8a2c-48205036c4f8 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:15:58.048776 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-633fc136-0faa-45be-8a2c-48205036c4f8 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1757 microversion: 2.1 time: 0.286840 Aug 25 06:15:58.049444 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1352/2671] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:15:57 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1757 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:15:58.510682 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [req-c5fab7a2-f4ca-4227-b207-41a2b2b282d5 req-fb63bc9e-9211-4378-b2e8-01f470af7c92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26eaf280-26f2-4b1f-8593-3e46e64a40e3", "tag": "bc5e31d2-6b9c-482c-8369-61575572cea8"}]} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:15:58.513448 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 06:15:58.513448 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: warnings.warn(msg) Aug 25 06:15:58.521239 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-c5fab7a2-f4ca-4227-b207-41a2b2b282d5 req-fb63bc9e-9211-4378-b2e8-01f470af7c92 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:58.521987 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-c5fab7a2-f4ca-4227-b207-41a2b2b282d5 req-fb63bc9e-9211-4378-b2e8-01f470af7c92 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:58.533681 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.compute.server_external_events [req-c5fab7a2-f4ca-4227-b207-41a2b2b282d5 req-fb63bc9e-9211-4378-b2e8-01f470af7c92 service nova] Creating event network-changed:bc5e31d2-6b9c-482c-8369-61575572cea8 for instance 26eaf280-26f2-4b1f-8593-3e46e64a40e3 on hv-cinder-78662 Aug 25 06:15:58.540057 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [req-c5fab7a2-f4ca-4227-b207-41a2b2b282d5 req-fb63bc9e-9211-4378-b2e8-01f470af7c92 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033074 Aug 25 06:15:58.541196 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1320/2672] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 06:15:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:15:59.068062 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-24c00488-a165-47af-a6fe-2be8cdcbcc43 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:15:59.069455 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-24c00488-a165-47af-a6fe-2be8cdcbcc43 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:15:59.077491 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-24c00488-a165-47af-a6fe-2be8cdcbcc43 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:59.078384 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-24c00488-a165-47af-a6fe-2be8cdcbcc43 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:59.079224 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-24c00488-a165-47af-a6fe-2be8cdcbcc43 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:15:59.079861 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-24c00488-a165-47af-a6fe-2be8cdcbcc43 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:15:59.216491 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-24c00488-a165-47af-a6fe-2be8cdcbcc43 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:15:59.224529 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-24c00488-a165-47af-a6fe-2be8cdcbcc43 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1757 microversion: 2.1 time: 0.161104 Aug 25 06:15:59.225100 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1353/2673] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:15:59 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:16:00.242597 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-c66aa940-0971-40e8-b61c-6736cf8373ea tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:16:00.243258 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-c66aa940-0971-40e8-b61c-6736cf8373ea tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:16:00.249758 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c66aa940-0971-40e8-b61c-6736cf8373ea tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:16:00.263132 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c66aa940-0971-40e8-b61c-6736cf8373ea tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:16:00.263132 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c66aa940-0971-40e8-b61c-6736cf8373ea tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:16:00.263132 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-c66aa940-0971-40e8-b61c-6736cf8373ea tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:16:00.375471 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-c66aa940-0971-40e8-b61c-6736cf8373ea tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:16:00.384124 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-c66aa940-0971-40e8-b61c-6736cf8373ea tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1757 microversion: 2.1 time: 0.146162 Aug 25 06:16:00.384698 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1321/2674] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:16:00 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1757 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:16:01.401686 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-5f8a8833-1f77-4835-91e1-57bebc625269 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:16:01.402265 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-5f8a8833-1f77-4835-91e1-57bebc625269 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:16:01.408012 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5f8a8833-1f77-4835-91e1-57bebc625269 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:16:01.408445 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5f8a8833-1f77-4835-91e1-57bebc625269 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:16:01.409188 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5f8a8833-1f77-4835-91e1-57bebc625269 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:16:01.409633 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-5f8a8833-1f77-4835-91e1-57bebc625269 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:16:01.538477 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-5f8a8833-1f77-4835-91e1-57bebc625269 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:16:01.547449 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-5f8a8833-1f77-4835-91e1-57bebc625269 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1757 microversion: 2.1 time: 0.149379 Aug 25 06:16:01.548017 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1354/2675] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:16:01 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1757 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:16:02.565475 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8bb50681-66b3-4be2-975a-e351a3eb6371 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:16:02.566134 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8bb50681-66b3-4be2-975a-e351a3eb6371 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:16:02.572012 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8bb50681-66b3-4be2-975a-e351a3eb6371 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:16:02.572458 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8bb50681-66b3-4be2-975a-e351a3eb6371 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:16:02.573214 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8bb50681-66b3-4be2-975a-e351a3eb6371 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:16:02.573679 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8bb50681-66b3-4be2-975a-e351a3eb6371 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:16:02.806660 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-8bb50681-66b3-4be2-975a-e351a3eb6371 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:16:02.814273 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8bb50681-66b3-4be2-975a-e351a3eb6371 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1757 microversion: 2.1 time: 0.252471 Aug 25 06:16:02.814835 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1322/2676] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:16:02 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1757 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:16:03.831764 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-470cf56f-a455-44e8-8d94-0948da6a7f03 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:16:03.832274 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-470cf56f-a455-44e8-8d94-0948da6a7f03 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:16:03.839054 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-470cf56f-a455-44e8-8d94-0948da6a7f03 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:16:03.839498 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-470cf56f-a455-44e8-8d94-0948da6a7f03 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:16:03.840254 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-470cf56f-a455-44e8-8d94-0948da6a7f03 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:16:03.840688 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-470cf56f-a455-44e8-8d94-0948da6a7f03 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:16:04.013599 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-470cf56f-a455-44e8-8d94-0948da6a7f03 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:16:04.021216 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-470cf56f-a455-44e8-8d94-0948da6a7f03 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1760 microversion: 2.1 time: 0.193241 Aug 25 06:16:04.021809 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1355/2677] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:16:03 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1760 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:17:07.358972 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4945947b-868a-4594-a167-64b475d876a3] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 25 06:17:07.362440 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-53cc9a7f-68cd-456b-b83a-d8e17e33cd64 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1685652387"}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:17:07.362973 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-53cc9a7f-68cd-456b-b83a-d8e17e33cd64 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:17:07.369854 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-53cc9a7f-68cd-456b-b83a-d8e17e33cd64 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:17:07.370296 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-53cc9a7f-68cd-456b-b83a-d8e17e33cd64 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:17:07.371047 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-53cc9a7f-68cd-456b-b83a-d8e17e33cd64 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:17:07.371473 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-53cc9a7f-68cd-456b-b83a-d8e17e33cd64 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:17:07.492772 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.network.security_group_api [None req-53cc9a7f-68cd-456b-b83a-d8e17e33cd64 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Removing security group 2c2015e0-c3bb-497f-9de0-9793a5264ba4 from port 3748ac8a-661a-450c-8fbe-84c6728411d1 Aug 25 06:17:07.878262 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-53cc9a7f-68cd-456b-b83a-d8e17e33cd64 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "POST /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa/action" status: 202 len: 0 microversion: 2.1 time: 0.521167 Aug 25 06:17:07.882154 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1323/2678] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 25 06:17:07 2021] POST /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa/action => generated 0 bytes in 522 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 06:17:07.892048 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [req-771e748e-8e7a-48a1-a177-40f7db30bac6 req-d234f3c8-445e-4e43-be60-d261b306198e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fa8553a-872a-4b76-bd51-a736a62663aa", "tag": "3748ac8a-661a-450c-8fbe-84c6728411d1"}]} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:17:07.893618 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 06:17:07.893618 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: warnings.warn(msg) Aug 25 06:17:07.901831 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-771e748e-8e7a-48a1-a177-40f7db30bac6 req-d234f3c8-445e-4e43-be60-d261b306198e service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:17:07.902570 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-771e748e-8e7a-48a1-a177-40f7db30bac6 req-d234f3c8-445e-4e43-be60-d261b306198e service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:17:07.916190 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.compute.server_external_events [req-771e748e-8e7a-48a1-a177-40f7db30bac6 req-d234f3c8-445e-4e43-be60-d261b306198e service nova] Creating event network-changed:3748ac8a-661a-450c-8fbe-84c6728411d1 for instance 2fa8553a-872a-4b76-bd51-a736a62663aa on hv-cinder-78662 Aug 25 06:17:07.923531 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [req-771e748e-8e7a-48a1-a177-40f7db30bac6 req-d234f3c8-445e-4e43-be60-d261b306198e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035767 Aug 25 06:17:07.924773 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1356/2679] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 06:17:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:17:09.389069 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-2ac00ad3-f9f9-4e1c-9914-8944680fd6fb tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:17:09.389629 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-2ac00ad3-f9f9-4e1c-9914-8944680fd6fb tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:17:09.396612 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2ac00ad3-f9f9-4e1c-9914-8944680fd6fb tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:17:09.397150 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2ac00ad3-f9f9-4e1c-9914-8944680fd6fb tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:17:09.397865 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2ac00ad3-f9f9-4e1c-9914-8944680fd6fb tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:17:09.398305 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-2ac00ad3-f9f9-4e1c-9914-8944680fd6fb tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:17:09.416448 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [-] [4945947b-868a-4594-a167-64b475d876a3] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 48784. Aug 25 06:17:09.486186 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.objects.instance [None req-2ac00ad3-f9f9-4e1c-9914-8944680fd6fb tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lazy-loading 'services' on Instance uuid 2fa8553a-872a-4b76-bd51-a736a62663aa {{(pid=108884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 06:17:09.662992 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-2ac00ad3-f9f9-4e1c-9914-8944680fd6fb tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa/os-volume_attachments/55c01ca3-a7e1-432f-bd97-4e75a577a83c" status: 202 len: 0 microversion: 2.1 time: 0.288131 Aug 25 06:17:09.664156 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1324/2680] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 25 06:17:09 2021] DELETE /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa/os-volume_attachments/55c01ca3-a7e1-432f-bd97-4e75a577a83c => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 06:17:09.672329 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-8722733c-5da0-4688-9647-d1f9f9ba51de tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:17:09.674144 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-8722733c-5da0-4688-9647-d1f9f9ba51de tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:17:09.681097 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8722733c-5da0-4688-9647-d1f9f9ba51de tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:17:09.681564 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8722733c-5da0-4688-9647-d1f9f9ba51de tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:17:09.682353 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8722733c-5da0-4688-9647-d1f9f9ba51de tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:17:09.682767 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-8722733c-5da0-4688-9647-d1f9f9ba51de tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:17:09.712480 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-8722733c-5da0-4688-9647-d1f9f9ba51de tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044146 Aug 25 06:17:09.713050 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1357/2681] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 06:17:09 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:17:09.943976 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [req-7f6139a7-a0d9-4431-bcbb-fb382aa2e1ae req-aa6cbb9d-84eb-4c13-94f7-f62ed60873ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fa8553a-872a-4b76-bd51-a736a62663aa", "tag": "3748ac8a-661a-450c-8fbe-84c6728411d1"}]} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:17:09.945624 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 06:17:09.945624 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: warnings.warn(msg) Aug 25 06:17:09.952963 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-7f6139a7-a0d9-4431-bcbb-fb382aa2e1ae req-aa6cbb9d-84eb-4c13-94f7-f62ed60873ff service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:17:09.953401 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-7f6139a7-a0d9-4431-bcbb-fb382aa2e1ae req-aa6cbb9d-84eb-4c13-94f7-f62ed60873ff service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:17:09.964563 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.compute.server_external_events [req-7f6139a7-a0d9-4431-bcbb-fb382aa2e1ae req-aa6cbb9d-84eb-4c13-94f7-f62ed60873ff service nova] Creating event network-changed:3748ac8a-661a-450c-8fbe-84c6728411d1 for instance 2fa8553a-872a-4b76-bd51-a736a62663aa on hv-cinder-78662 Aug 25 06:17:09.969652 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [req-7f6139a7-a0d9-4431-bcbb-fb382aa2e1ae req-aa6cbb9d-84eb-4c13-94f7-f62ed60873ff service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030313 Aug 25 06:17:09.970234 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1325/2682] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 06:17:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 06:17:10.725337 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-d7e8ad3b-73eb-493f-9b5f-a6d5009b8c50 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:17:10.726264 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-d7e8ad3b-73eb-493f-9b5f-a6d5009b8c50 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:17:10.732194 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d7e8ad3b-73eb-493f-9b5f-a6d5009b8c50 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:17:10.732637 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d7e8ad3b-73eb-493f-9b5f-a6d5009b8c50 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:17:10.733390 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d7e8ad3b-73eb-493f-9b5f-a6d5009b8c50 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:17:10.733854 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-d7e8ad3b-73eb-493f-9b5f-a6d5009b8c50 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:17:10.763979 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-d7e8ad3b-73eb-493f-9b5f-a6d5009b8c50 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043531 Aug 25 06:17:10.764619 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1358/2683] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 06:17:10 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:17:11.776475 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-b7abeb4a-86d6-47e6-aa25-e0e3d6a30e83 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:17:11.777465 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-b7abeb4a-86d6-47e6-aa25-e0e3d6a30e83 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:17:11.783518 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b7abeb4a-86d6-47e6-aa25-e0e3d6a30e83 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:17:11.783961 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b7abeb4a-86d6-47e6-aa25-e0e3d6a30e83 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:17:11.784712 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b7abeb4a-86d6-47e6-aa25-e0e3d6a30e83 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:17:11.785194 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-b7abeb4a-86d6-47e6-aa25-e0e3d6a30e83 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:17:11.813219 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-b7abeb4a-86d6-47e6-aa25-e0e3d6a30e83 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040809 Aug 25 06:17:11.813822 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1326/2684] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 25 06:17:11 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 06:17:11.823230 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ea71c204-b7f0-4cd9-9241-677dba2913af tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:17:11.823764 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ea71c204-b7f0-4cd9-9241-677dba2913af tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:17:11.829448 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ea71c204-b7f0-4cd9-9241-677dba2913af tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:17:11.829917 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ea71c204-b7f0-4cd9-9241-677dba2913af tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:17:11.830670 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ea71c204-b7f0-4cd9-9241-677dba2913af tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:17:11.831100 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ea71c204-b7f0-4cd9-9241-677dba2913af tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:17:11.913633 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.wsgi [None req-ea71c204-b7f0-4cd9-9241-677dba2913af tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] HTTP exception thrown: Instance 2fa8553a-872a-4b76-bd51-a736a62663aa is not attached to volume 55c01ca3-a7e1-432f-bd97-4e75a577a83c Aug 25 06:17:11.914242 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ea71c204-b7f0-4cd9-9241-677dba2913af tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Returning 404 to user: Instance 2fa8553a-872a-4b76-bd51-a736a62663aa is not attached to volume 55c01ca3-a7e1-432f-bd97-4e75a577a83c {{(pid=108885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 06:17:11.915079 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ea71c204-b7f0-4cd9-9241-677dba2913af tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa/os-volume_attachments/55c01ca3-a7e1-432f-bd97-4e75a577a83c" status: 404 len: 154 microversion: 2.1 time: 0.095653 Aug 25 06:17:11.915661 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1359/2685] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 25 06:17:11 2021] DELETE /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa/os-volume_attachments/55c01ca3-a7e1-432f-bd97-4e75a577a83c => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 06:17:13.165518 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-394cd45e-20a3-4e22-b258-32d9a6afc1f9 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:17:13.166146 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-394cd45e-20a3-4e22-b258-32d9a6afc1f9 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:17:13.171830 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-394cd45e-20a3-4e22-b258-32d9a6afc1f9 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:17:13.172279 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-394cd45e-20a3-4e22-b258-32d9a6afc1f9 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:17:13.173035 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-394cd45e-20a3-4e22-b258-32d9a6afc1f9 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:17:13.173469 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-394cd45e-20a3-4e22-b258-32d9a6afc1f9 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:17:13.198249 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-394cd45e-20a3-4e22-b258-32d9a6afc1f9 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Going to try to terminate instance {{(pid=108884) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 25 06:17:13.428405 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-394cd45e-20a3-4e22-b258-32d9a6afc1f9 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 204 len: 0 microversion: 2.1 time: 0.266233 Aug 25 06:17:13.428945 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1327/2686] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 25 06:17:13 2021] DELETE /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 06:17:13.436717 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-0959e6d1-bd2b-486a-8ecb-2093084cd1c0 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:17:13.439145 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-0959e6d1-bd2b-486a-8ecb-2093084cd1c0 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:17:13.444137 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0959e6d1-bd2b-486a-8ecb-2093084cd1c0 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:17:13.444579 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0959e6d1-bd2b-486a-8ecb-2093084cd1c0 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:17:13.445338 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0959e6d1-bd2b-486a-8ecb-2093084cd1c0 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:17:13.445798 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-0959e6d1-bd2b-486a-8ecb-2093084cd1c0 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:17:13.568474 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-0959e6d1-bd2b-486a-8ecb-2093084cd1c0 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:17:13.575953 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-0959e6d1-bd2b-486a-8ecb-2093084cd1c0 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1555 microversion: 2.1 time: 0.142795 Aug 25 06:17:13.576523 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1360/2687] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:17:13 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1555 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:17:14.594112 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-e3a53889-a2aa-404a-b652-016678f8b119 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:17:14.594810 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-e3a53889-a2aa-404a-b652-016678f8b119 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:17:14.601032 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e3a53889-a2aa-404a-b652-016678f8b119 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:17:14.601471 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e3a53889-a2aa-404a-b652-016678f8b119 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:17:14.602255 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e3a53889-a2aa-404a-b652-016678f8b119 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:17:14.602708 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-e3a53889-a2aa-404a-b652-016678f8b119 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:17:14.725283 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-e3a53889-a2aa-404a-b652-016678f8b119 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:17:14.732362 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-e3a53889-a2aa-404a-b652-016678f8b119 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1555 microversion: 2.1 time: 0.142229 Aug 25 06:17:14.732924 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1328/2688] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:17:14 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1555 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:17:15.750600 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-355ab1de-836d-4a59-a735-0aebaa2d0f57 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:17:15.751297 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-355ab1de-836d-4a59-a735-0aebaa2d0f57 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:17:15.762153 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-355ab1de-836d-4a59-a735-0aebaa2d0f57 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:17:15.762894 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-355ab1de-836d-4a59-a735-0aebaa2d0f57 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:17:15.764188 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-355ab1de-836d-4a59-a735-0aebaa2d0f57 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:17:15.764894 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-355ab1de-836d-4a59-a735-0aebaa2d0f57 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:17:15.893348 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-355ab1de-836d-4a59-a735-0aebaa2d0f57 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:17:15.900962 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-355ab1de-836d-4a59-a735-0aebaa2d0f57 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1555 microversion: 2.1 time: 0.154218 Aug 25 06:17:15.901552 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1361/2689] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:17:15 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:17:16.380464 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [req-09936fc0-8a50-4824-a14b-66a05e7f9602 req-88bb439b-f4c1-4cad-ae75-637a47655f2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fa8553a-872a-4b76-bd51-a736a62663aa", "name": "network-vif-deleted", "tag": "3748ac8a-661a-450c-8fbe-84c6728411d1"}]} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:17:16.382073 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 06:17:16.382073 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: warnings.warn(msg) Aug 25 06:17:16.388757 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-09936fc0-8a50-4824-a14b-66a05e7f9602 req-88bb439b-f4c1-4cad-ae75-637a47655f2b service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:17:16.389191 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-09936fc0-8a50-4824-a14b-66a05e7f9602 req-88bb439b-f4c1-4cad-ae75-637a47655f2b service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:17:16.406121 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.compute.server_external_events [req-09936fc0-8a50-4824-a14b-66a05e7f9602 req-88bb439b-f4c1-4cad-ae75-637a47655f2b service nova] Creating event network-vif-deleted:3748ac8a-661a-450c-8fbe-84c6728411d1 for instance 2fa8553a-872a-4b76-bd51-a736a62663aa on hv-cinder-78662 Aug 25 06:17:16.414067 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [req-09936fc0-8a50-4824-a14b-66a05e7f9602 req-88bb439b-f4c1-4cad-ae75-637a47655f2b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102257 Aug 25 06:17:16.414896 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1329/2690] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 06:17:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 06:17:16.918369 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-681fb6e5-6f46-42fc-a1b4-d04c8b2a5bd2 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:17:16.918901 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-681fb6e5-6f46-42fc-a1b4-d04c8b2a5bd2 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:17:16.924696 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-681fb6e5-6f46-42fc-a1b4-d04c8b2a5bd2 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:17:16.925145 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-681fb6e5-6f46-42fc-a1b4-d04c8b2a5bd2 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:17:16.925954 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-681fb6e5-6f46-42fc-a1b4-d04c8b2a5bd2 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:17:16.926391 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-681fb6e5-6f46-42fc-a1b4-d04c8b2a5bd2 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:17:16.960264 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-681fb6e5-6f46-42fc-a1b4-d04c8b2a5bd2 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:17:16.960917 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-681fb6e5-6f46-42fc-a1b4-d04c8b2a5bd2 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:17:16.961301 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.objects.instance [None req-681fb6e5-6f46-42fc-a1b4-d04c8b2a5bd2 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lazy-loading 'fault' on Instance uuid 2fa8553a-872a-4b76-bd51-a736a62663aa {{(pid=108885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 06:17:17.002319 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-681fb6e5-6f46-42fc-a1b4-d04c8b2a5bd2 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273d869361e43be812142b1320d920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badc1e82eb534e34ade3d453aaabc61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:17:17.010370 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-681fb6e5-6f46-42fc-a1b4-d04c8b2a5bd2 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 200 len: 1349 microversion: 2.1 time: 0.095791 Aug 25 06:17:17.011018 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1362/2691] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:17:16 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 1349 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:17:18.028265 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-0d61479e-0e39-43ce-8b31-2ede8430bea0 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:17:18.028863 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-0d61479e-0e39-43ce-8b31-2ede8430bea0 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] [instance: 2fa8553a-872a-4b76-bd51-a736a62663aa] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:17:18.035488 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0d61479e-0e39-43ce-8b31-2ede8430bea0 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:17:18.035931 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0d61479e-0e39-43ce-8b31-2ede8430bea0 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:17:18.036688 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0d61479e-0e39-43ce-8b31-2ede8430bea0 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:17:18.037110 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-0d61479e-0e39-43ce-8b31-2ede8430bea0 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:17:18.049862 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.wsgi [None req-0d61479e-0e39-43ce-8b31-2ede8430bea0 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] HTTP exception thrown: Instance 2fa8553a-872a-4b76-bd51-a736a62663aa could not be found. Aug 25 06:17:18.050448 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-0d61479e-0e39-43ce-8b31-2ede8430bea0 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Returning 404 to user: Instance 2fa8553a-872a-4b76-bd51-a736a62663aa could not be found. {{(pid=108884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 06:17:18.051986 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-0d61479e-0e39-43ce-8b31-2ede8430bea0 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa" status: 404 len: 111 microversion: 2.1 time: 0.027867 Aug 25 06:17:18.052511 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1330/2692] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:17:18 2021] GET /compute/v2.1/servers/2fa8553a-872a-4b76-bd51-a736a62663aa => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 06:17:18.060940 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-37c4129e-2c27-4e18-99de-faf043380e19 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] Calling method '.version_select at 0x7f910657d5e0>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:17:18.137752 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-37c4129e-2c27-4e18-99de-faf043380e19 tempest-TestMinimumBasicScenario-890535976 tempest-TestMinimumBasicScenario-890535976-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1135844039" status: 202 len: 0 microversion: 2.1 time: 0.080359 Aug 25 06:17:18.138334 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1363/2693] 10.222.0.42 () {58 vars in 1272 bytes} [Wed Aug 25 06:17:18 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1135844039 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 06:17:25.092366 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 06:17:25.092366 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: Wed Aug 25 06:17:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 06:18:04.969596 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-057fc694-79e6-4796-a2b3-90b47f95606f tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1957719887", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-7372938", "security_groups": [{"name": "tempest-secgroup-smoke-123090279"}], "block_device_mapping_v2": [{"uuid": "f02702d3-ade8-48c5-b9c6-8c6944bf8c20", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fc0081a5-5e60-4209-8f34-8444a2664985"}]}} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:18:05.080195 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.network.neutron [None req-057fc694-79e6-4796-a2b3-90b47f95606f tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] validate_networks() for [('fc0081a5-5e60-4209-8f34-8444a2664985', None, None, None, None, None)] {{(pid=108884) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 25 06:18:05.554912 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-057fc694-79e6-4796-a2b3-90b47f95606f tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Flavor limits 0:0:0 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 06:18:05.555354 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-057fc694-79e6-4796-a2b3-90b47f95606f tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Image limits 0:0:0 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 06:18:05.555809 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-057fc694-79e6-4796-a2b3-90b47f95606f tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Flavor pref 0:0:0 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 06:18:05.556215 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-057fc694-79e6-4796-a2b3-90b47f95606f tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Image pref 0:0:0 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 06:18:05.556628 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.virt.hardware [None req-057fc694-79e6-4796-a2b3-90b47f95606f tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108884) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 06:18:05.565240 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-057fc694-79e6-4796-a2b3-90b47f95606f tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:18:05.565797 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-057fc694-79e6-4796-a2b3-90b47f95606f tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:18:05.567176 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-057fc694-79e6-4796-a2b3-90b47f95606f tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:18:05.567613 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-057fc694-79e6-4796-a2b3-90b47f95606f tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:18:05.583764 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.quota [None req-057fc694-79e6-4796-a2b3-90b47f95606f tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Getting quotas for project 8b15de72ab1c4793bb72e45a48d7e893. Resources: {'ram', 'cores', 'instances'} {{(pid=108884) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 06:18:05.587724 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.quota [None req-057fc694-79e6-4796-a2b3-90b47f95606f tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Getting quotas for user eab9d592e3d649bd8faa4a9e6081a14a and project 8b15de72ab1c4793bb72e45a48d7e893. Resources: {'ram', 'cores', 'instances'} {{(pid=108884) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 06:18:05.654328 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-057fc694-79e6-4796-a2b3-90b47f95606f tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Going to run 1 instances... {{(pid=108884) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 25 06:18:05.658687 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-057fc694-79e6-4796-a2b3-90b47f95606f tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: dddb09b8-e667-4592-b3b1-dc0b18ad7247] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f02702d3-ade8-48c5-b9c6-8c6944bf8c20',volume_size=None,volume_type=None)] {{(pid=108884) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 25 06:18:06.088018 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-057fc694-79e6-4796-a2b3-90b47f95606f tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.121927 Aug 25 06:18:06.089122 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1331/2694] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 25 06:18:04 2021] POST /compute/v2.1/servers => generated 405 bytes in 1124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 06:18:06.102102 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-a1d2a49a-0063-4cb1-a9a0-ff7a0802a0ea tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:18:06.102705 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-a1d2a49a-0063-4cb1-a9a0-ff7a0802a0ea tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: dddb09b8-e667-4592-b3b1-dc0b18ad7247] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:18:06.173197 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-a1d2a49a-0063-4cb1-a9a0-ff7a0802a0ea tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:18:06.180472 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-a1d2a49a-0063-4cb1-a9a0-ff7a0802a0ea tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247" status: 200 len: 1092 microversion: 2.1 time: 0.083530 Aug 25 06:18:06.181035 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1364/2695] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:18:06 2021] GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247 => generated 1092 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:18:07.197653 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8d4d5d04-9b79-47bf-973f-a297c0b5da2d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:18:07.198296 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8d4d5d04-9b79-47bf-973f-a297c0b5da2d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: dddb09b8-e667-4592-b3b1-dc0b18ad7247] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:18:07.204388 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8d4d5d04-9b79-47bf-973f-a297c0b5da2d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:18:07.204830 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8d4d5d04-9b79-47bf-973f-a297c0b5da2d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:18:07.205705 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8d4d5d04-9b79-47bf-973f-a297c0b5da2d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:18:07.206147 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8d4d5d04-9b79-47bf-973f-a297c0b5da2d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:18:07.268352 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-8d4d5d04-9b79-47bf-973f-a297c0b5da2d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:18:07.276237 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8d4d5d04-9b79-47bf-973f-a297c0b5da2d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247" status: 200 len: 1142 microversion: 2.1 time: 0.082412 Aug 25 06:18:07.276846 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1332/2696] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:18:07 2021] GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247 => generated 1142 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:18:08.293818 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b5f212f8-f659-423c-afcc-15fd81bad65b tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:18:08.294452 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b5f212f8-f659-423c-afcc-15fd81bad65b tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: dddb09b8-e667-4592-b3b1-dc0b18ad7247] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:18:08.300157 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b5f212f8-f659-423c-afcc-15fd81bad65b tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:18:08.304201 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b5f212f8-f659-423c-afcc-15fd81bad65b tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:18:08.304201 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b5f212f8-f659-423c-afcc-15fd81bad65b tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:18:08.304201 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b5f212f8-f659-423c-afcc-15fd81bad65b tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:18:08.363977 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-b5f212f8-f659-423c-afcc-15fd81bad65b tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:18:08.372884 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b5f212f8-f659-423c-afcc-15fd81bad65b tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247" status: 200 len: 1198 microversion: 2.1 time: 0.082668 Aug 25 06:18:08.378360 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1365/2697] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:18:08 2021] GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247 => generated 1198 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 06:18:09.388647 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-eb2ac475-6f33-4c79-9caa-1e7198cbafd5 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:18:09.389254 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-eb2ac475-6f33-4c79-9caa-1e7198cbafd5 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: dddb09b8-e667-4592-b3b1-dc0b18ad7247] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:18:09.395151 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-eb2ac475-6f33-4c79-9caa-1e7198cbafd5 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:18:09.395593 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-eb2ac475-6f33-4c79-9caa-1e7198cbafd5 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:18:09.396400 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-eb2ac475-6f33-4c79-9caa-1e7198cbafd5 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:18:09.396826 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-eb2ac475-6f33-4c79-9caa-1e7198cbafd5 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:18:09.521326 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-eb2ac475-6f33-4c79-9caa-1e7198cbafd5 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:18:09.530072 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-eb2ac475-6f33-4c79-9caa-1e7198cbafd5 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247" status: 200 len: 1275 microversion: 2.1 time: 0.144391 Aug 25 06:18:09.530245 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1333/2698] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:18:09 2021] GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247 => generated 1275 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:18:10.249044 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [req-1f5190ad-49a6-490e-aee5-b354f1d59c7b req-afe8aece-b5e7-4c0b-87b5-59a9caf36826 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dddb09b8-e667-4592-b3b1-dc0b18ad7247", "tag": "12523946-dfb3-4e7f-91ee-466c25277d6c"}]} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:18:10.251326 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 06:18:10.251326 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: warnings.warn(msg) Aug 25 06:18:10.258977 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-1f5190ad-49a6-490e-aee5-b354f1d59c7b req-afe8aece-b5e7-4c0b-87b5-59a9caf36826 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:18:10.259423 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-1f5190ad-49a6-490e-aee5-b354f1d59c7b req-afe8aece-b5e7-4c0b-87b5-59a9caf36826 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:18:10.270919 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.compute.server_external_events [req-1f5190ad-49a6-490e-aee5-b354f1d59c7b req-afe8aece-b5e7-4c0b-87b5-59a9caf36826 service nova] Creating event network-changed:12523946-dfb3-4e7f-91ee-466c25277d6c for instance dddb09b8-e667-4592-b3b1-dc0b18ad7247 on hv-cinder-78662 Aug 25 06:18:10.276270 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [req-1f5190ad-49a6-490e-aee5-b354f1d59c7b req-afe8aece-b5e7-4c0b-87b5-59a9caf36826 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031110 Aug 25 06:18:10.276835 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1366/2699] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 06:18:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:18:10.546803 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-09abcaa4-dfb1-4d71-810d-6da6e8695a2c tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:18:10.547421 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-09abcaa4-dfb1-4d71-810d-6da6e8695a2c tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: dddb09b8-e667-4592-b3b1-dc0b18ad7247] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:18:10.553090 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-09abcaa4-dfb1-4d71-810d-6da6e8695a2c tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:18:10.553564 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-09abcaa4-dfb1-4d71-810d-6da6e8695a2c tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:18:10.555177 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-09abcaa4-dfb1-4d71-810d-6da6e8695a2c tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:18:10.555451 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-09abcaa4-dfb1-4d71-810d-6da6e8695a2c tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:18:10.685835 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-09abcaa4-dfb1-4d71-810d-6da6e8695a2c tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:18:10.693205 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-09abcaa4-dfb1-4d71-810d-6da6e8695a2c tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247" status: 200 len: 1263 microversion: 2.1 time: 0.150122 Aug 25 06:18:10.693797 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1334/2700] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:18:10 2021] GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247 => generated 1263 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:18:11.711326 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-ab90f3f0-bf50-4eaf-8592-94c6fa20129d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:18:11.714019 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-ab90f3f0-bf50-4eaf-8592-94c6fa20129d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: dddb09b8-e667-4592-b3b1-dc0b18ad7247] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:18:11.719093 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ab90f3f0-bf50-4eaf-8592-94c6fa20129d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:18:11.719526 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ab90f3f0-bf50-4eaf-8592-94c6fa20129d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:18:11.720283 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ab90f3f0-bf50-4eaf-8592-94c6fa20129d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:18:11.720712 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-ab90f3f0-bf50-4eaf-8592-94c6fa20129d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:18:11.842725 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-ab90f3f0-bf50-4eaf-8592-94c6fa20129d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:18:11.849828 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-ab90f3f0-bf50-4eaf-8592-94c6fa20129d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247" status: 200 len: 1263 microversion: 2.1 time: 0.143866 Aug 25 06:18:11.850380 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1367/2701] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:18:11 2021] GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247 => generated 1263 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:18:12.866848 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-a6b6fb69-e247-47be-9595-539251e2aaf5 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:18:12.868209 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-a6b6fb69-e247-47be-9595-539251e2aaf5 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: dddb09b8-e667-4592-b3b1-dc0b18ad7247] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:18:12.873968 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a6b6fb69-e247-47be-9595-539251e2aaf5 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:18:12.874419 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a6b6fb69-e247-47be-9595-539251e2aaf5 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:18:12.875182 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a6b6fb69-e247-47be-9595-539251e2aaf5 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:18:12.875615 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-a6b6fb69-e247-47be-9595-539251e2aaf5 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:18:13.002587 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-a6b6fb69-e247-47be-9595-539251e2aaf5 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:18:13.009872 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-a6b6fb69-e247-47be-9595-539251e2aaf5 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247" status: 200 len: 1263 microversion: 2.1 time: 0.146986 Aug 25 06:18:13.010433 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1335/2702] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:18:12 2021] GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247 => generated 1263 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:18:14.027161 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-c2cebd76-b648-416d-ad30-0775ef5fc4b1 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:18:14.027705 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-c2cebd76-b648-416d-ad30-0775ef5fc4b1 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: dddb09b8-e667-4592-b3b1-dc0b18ad7247] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:18:14.033492 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c2cebd76-b648-416d-ad30-0775ef5fc4b1 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:18:14.033961 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c2cebd76-b648-416d-ad30-0775ef5fc4b1 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:18:14.034718 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c2cebd76-b648-416d-ad30-0775ef5fc4b1 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:18:14.035147 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-c2cebd76-b648-416d-ad30-0775ef5fc4b1 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:18:14.162056 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-c2cebd76-b648-416d-ad30-0775ef5fc4b1 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:18:14.169363 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-c2cebd76-b648-416d-ad30-0775ef5fc4b1 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247" status: 200 len: 1263 microversion: 2.1 time: 0.146371 Aug 25 06:18:14.169949 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1368/2703] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:18:14 2021] GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247 => generated 1263 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:18:15.186224 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-fb47d156-8fd3-4826-9904-ad88f5419de1 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:18:15.186877 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-fb47d156-8fd3-4826-9904-ad88f5419de1 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: dddb09b8-e667-4592-b3b1-dc0b18ad7247] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:18:15.194544 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fb47d156-8fd3-4826-9904-ad88f5419de1 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:18:15.195809 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fb47d156-8fd3-4826-9904-ad88f5419de1 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:18:15.197068 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fb47d156-8fd3-4826-9904-ad88f5419de1 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:18:15.197807 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-fb47d156-8fd3-4826-9904-ad88f5419de1 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:18:15.325634 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-fb47d156-8fd3-4826-9904-ad88f5419de1 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:18:15.332951 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-fb47d156-8fd3-4826-9904-ad88f5419de1 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247" status: 200 len: 1263 microversion: 2.1 time: 0.150592 Aug 25 06:18:15.333649 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1336/2704] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:18:15 2021] GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247 => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:18:16.349502 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9e85ace5-4818-4119-9947-579a92929558 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:18:16.350358 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9e85ace5-4818-4119-9947-579a92929558 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: dddb09b8-e667-4592-b3b1-dc0b18ad7247] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:18:16.356113 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9e85ace5-4818-4119-9947-579a92929558 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:18:16.356547 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9e85ace5-4818-4119-9947-579a92929558 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:18:16.357292 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9e85ace5-4818-4119-9947-579a92929558 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:18:16.357812 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9e85ace5-4818-4119-9947-579a92929558 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:18:16.481162 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-9e85ace5-4818-4119-9947-579a92929558 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:18:16.488559 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9e85ace5-4818-4119-9947-579a92929558 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247" status: 200 len: 1263 microversion: 2.1 time: 0.142674 Aug 25 06:18:16.489131 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1369/2705] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:18:16 2021] GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247 => generated 1263 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:18:17.506021 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-4a737462-3b0f-4aab-9b83-f1695c328fa0 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:18:17.506619 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-4a737462-3b0f-4aab-9b83-f1695c328fa0 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: dddb09b8-e667-4592-b3b1-dc0b18ad7247] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:18:17.512716 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4a737462-3b0f-4aab-9b83-f1695c328fa0 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:18:17.513166 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4a737462-3b0f-4aab-9b83-f1695c328fa0 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:18:17.513979 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4a737462-3b0f-4aab-9b83-f1695c328fa0 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:18:17.514414 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-4a737462-3b0f-4aab-9b83-f1695c328fa0 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:18:17.643320 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-4a737462-3b0f-4aab-9b83-f1695c328fa0 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:18:17.651375 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-4a737462-3b0f-4aab-9b83-f1695c328fa0 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247" status: 200 len: 1263 microversion: 2.1 time: 0.149098 Aug 25 06:18:17.651937 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1337/2706] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:18:17 2021] GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247 => generated 1263 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:18:18.668165 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b172ecf3-555a-4878-bb52-7517edbffe6d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:18:18.668751 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b172ecf3-555a-4878-bb52-7517edbffe6d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: dddb09b8-e667-4592-b3b1-dc0b18ad7247] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:18:18.674682 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b172ecf3-555a-4878-bb52-7517edbffe6d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:18:18.675126 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b172ecf3-555a-4878-bb52-7517edbffe6d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:18:18.675877 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b172ecf3-555a-4878-bb52-7517edbffe6d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:18:18.676306 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b172ecf3-555a-4878-bb52-7517edbffe6d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:18:18.796283 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-b172ecf3-555a-4878-bb52-7517edbffe6d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:18:18.803382 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b172ecf3-555a-4878-bb52-7517edbffe6d tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247" status: 200 len: 1263 microversion: 2.1 time: 0.139091 Aug 25 06:18:18.803938 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1370/2707] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:18:18 2021] GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247 => generated 1263 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:18:19.820826 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-88b10e0d-756c-4480-9c0e-3db1460d5e3a tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:18:19.821431 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-88b10e0d-756c-4480-9c0e-3db1460d5e3a tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: dddb09b8-e667-4592-b3b1-dc0b18ad7247] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:18:19.827251 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-88b10e0d-756c-4480-9c0e-3db1460d5e3a tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:18:19.827692 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-88b10e0d-756c-4480-9c0e-3db1460d5e3a tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:18:19.828454 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-88b10e0d-756c-4480-9c0e-3db1460d5e3a tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:18:19.828884 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-88b10e0d-756c-4480-9c0e-3db1460d5e3a tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:18:19.951638 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-88b10e0d-756c-4480-9c0e-3db1460d5e3a tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:18:19.958813 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-88b10e0d-756c-4480-9c0e-3db1460d5e3a tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247" status: 200 len: 1263 microversion: 2.1 time: 0.142355 Aug 25 06:18:19.959366 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1338/2708] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:18:19 2021] GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247 => generated 1263 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:18:20.591623 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [req-86fee45f-27ed-434e-830a-639e291b9180 req-ff0a830f-9dfc-4c7e-b838-49ba42cc57d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dddb09b8-e667-4592-b3b1-dc0b18ad7247", "name": "network-vif-plugged", "status": "completed", "tag": "12523946-dfb3-4e7f-91ee-466c25277d6c"}]} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:18:20.593168 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 06:18:20.593168 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: warnings.warn(msg) Aug 25 06:18:20.600035 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-86fee45f-27ed-434e-830a-639e291b9180 req-ff0a830f-9dfc-4c7e-b838-49ba42cc57d2 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:18:20.600476 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-86fee45f-27ed-434e-830a-639e291b9180 req-ff0a830f-9dfc-4c7e-b838-49ba42cc57d2 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:18:20.614385 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.compute.server_external_events [req-86fee45f-27ed-434e-830a-639e291b9180 req-ff0a830f-9dfc-4c7e-b838-49ba42cc57d2 service nova] Creating event network-vif-plugged:12523946-dfb3-4e7f-91ee-466c25277d6c for instance dddb09b8-e667-4592-b3b1-dc0b18ad7247 on hv-cinder-78662 Aug 25 06:18:20.620484 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [req-86fee45f-27ed-434e-830a-639e291b9180 req-ff0a830f-9dfc-4c7e-b838-49ba42cc57d2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149418 Aug 25 06:18:20.630467 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1371/2709] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 06:18:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:18:20.974560 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-f0b034d5-7cdf-4e27-b7f6-ecdc4e384311 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:18:20.975122 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-f0b034d5-7cdf-4e27-b7f6-ecdc4e384311 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: dddb09b8-e667-4592-b3b1-dc0b18ad7247] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:18:20.981341 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f0b034d5-7cdf-4e27-b7f6-ecdc4e384311 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:18:20.981818 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f0b034d5-7cdf-4e27-b7f6-ecdc4e384311 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:18:20.982592 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f0b034d5-7cdf-4e27-b7f6-ecdc4e384311 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:18:20.983021 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f0b034d5-7cdf-4e27-b7f6-ecdc4e384311 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:18:21.115457 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-f0b034d5-7cdf-4e27-b7f6-ecdc4e384311 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:18:21.123307 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-f0b034d5-7cdf-4e27-b7f6-ecdc4e384311 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247" status: 200 len: 1263 microversion: 2.1 time: 0.152533 Aug 25 06:18:21.123867 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1339/2710] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:18:20 2021] GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247 => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:18:22.140316 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-43bc6450-142b-4663-814f-4980ae4cadb2 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:18:22.141003 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-43bc6450-142b-4663-814f-4980ae4cadb2 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: dddb09b8-e667-4592-b3b1-dc0b18ad7247] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:18:22.147246 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-43bc6450-142b-4663-814f-4980ae4cadb2 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:18:22.147714 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-43bc6450-142b-4663-814f-4980ae4cadb2 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:18:22.149098 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-43bc6450-142b-4663-814f-4980ae4cadb2 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:18:22.149546 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-43bc6450-142b-4663-814f-4980ae4cadb2 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:18:22.272181 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-43bc6450-142b-4663-814f-4980ae4cadb2 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:18:22.280521 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-43bc6450-142b-4663-814f-4980ae4cadb2 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247" status: 200 len: 1263 microversion: 2.1 time: 0.144165 Aug 25 06:18:22.281079 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1372/2711] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:18:22 2021] GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247 => generated 1263 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 06:18:23.298383 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-7dce3311-d63d-4dd9-8d76-9d797e7764f8 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:18:23.298985 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-7dce3311-d63d-4dd9-8d76-9d797e7764f8 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: dddb09b8-e667-4592-b3b1-dc0b18ad7247] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:18:23.305558 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7dce3311-d63d-4dd9-8d76-9d797e7764f8 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:18:23.306011 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7dce3311-d63d-4dd9-8d76-9d797e7764f8 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:18:23.306762 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7dce3311-d63d-4dd9-8d76-9d797e7764f8 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:18:23.307189 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-7dce3311-d63d-4dd9-8d76-9d797e7764f8 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:18:23.431667 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-7dce3311-d63d-4dd9-8d76-9d797e7764f8 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:18:23.439010 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-7dce3311-d63d-4dd9-8d76-9d797e7764f8 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247" status: 200 len: 1451 microversion: 2.1 time: 0.144322 Aug 25 06:18:23.439573 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1340/2712] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:18:23 2021] GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247 => generated 1451 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:18:23.454600 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-96603334-f330-4053-9037-7e23723ff858 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:18:23.455207 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-96603334-f330-4053-9037-7e23723ff858 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: dddb09b8-e667-4592-b3b1-dc0b18ad7247] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:18:23.457289 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: ERROR oslo.messaging._drivers.impl_rabbit [-] [024c7946-b47b-4a06-aa5e-7d5b6a13301d] AMQP server on 10.222.0.42:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 25 06:18:23.462111 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-96603334-f330-4053-9037-7e23723ff858 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:18:23.462554 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-96603334-f330-4053-9037-7e23723ff858 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:18:23.463308 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-96603334-f330-4053-9037-7e23723ff858 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:18:23.463735 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-96603334-f330-4053-9037-7e23723ff858 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:18:23.591384 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-96603334-f330-4053-9037-7e23723ff858 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:18:23.595957 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-96603334-f330-4053-9037-7e23723ff858 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247" status: 200 len: 1451 microversion: 2.1 time: 0.144991 Aug 25 06:18:23.596513 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1373/2713] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:18:23 2021] GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247 => generated 1451 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 06:18:25.821877 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [req-7405b60b-6eb3-4b57-9923-cf06558c0d6f req-08c366a0-d1bb-404f-85d1-2b77c825d408 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dddb09b8-e667-4592-b3b1-dc0b18ad7247", "tag": "12523946-dfb3-4e7f-91ee-466c25277d6c"}]} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:18:25.823455 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 06:18:25.823455 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: warnings.warn(msg) Aug 25 06:18:25.830222 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-7405b60b-6eb3-4b57-9923-cf06558c0d6f req-08c366a0-d1bb-404f-85d1-2b77c825d408 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:18:25.830663 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-7405b60b-6eb3-4b57-9923-cf06558c0d6f req-08c366a0-d1bb-404f-85d1-2b77c825d408 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:18:25.842320 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.compute.server_external_events [req-7405b60b-6eb3-4b57-9923-cf06558c0d6f req-08c366a0-d1bb-404f-85d1-2b77c825d408 service nova] Creating event network-changed:12523946-dfb3-4e7f-91ee-466c25277d6c for instance dddb09b8-e667-4592-b3b1-dc0b18ad7247 on hv-cinder-78662 Aug 25 06:18:25.847805 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [req-7405b60b-6eb3-4b57-9923-cf06558c0d6f req-08c366a0-d1bb-404f-85d1-2b77c825d408 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103463 Aug 25 06:18:25.848596 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1341/2714] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 06:18:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:19:15.993696 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 06:19:15.994354 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: Wed Aug 25 06:19:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 06:19:23.310232 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 06:19:23.310846 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: Wed Aug 25 06:19:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 06:20:16.020836 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4945947b-868a-4594-a167-64b475d876a3] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 06:20:16.025490 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [req-19cbe25f-6a1a-42fb-99ba-9cfd9ed469ee req-c1cd268d-31df-4426-ab9e-96d3ba4dc161 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dddb09b8-e667-4592-b3b1-dc0b18ad7247", "tag": "12523946-dfb3-4e7f-91ee-466c25277d6c"}]} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:20:16.026076 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-9b00daa8-f7d1-474f-ba11-4f3d9c0acd48 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:20:16.027048 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 06:20:16.027048 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: warnings.warn(msg) Aug 25 06:20:16.027414 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9b00daa8-f7d1-474f-ba11-4f3d9c0acd48 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: dddb09b8-e667-4592-b3b1-dc0b18ad7247] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:20:16.034258 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-19cbe25f-6a1a-42fb-99ba-9cfd9ed469ee req-c1cd268d-31df-4426-ab9e-96d3ba4dc161 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:20:16.034696 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-19cbe25f-6a1a-42fb-99ba-9cfd9ed469ee req-c1cd268d-31df-4426-ab9e-96d3ba4dc161 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:20:16.044645 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9b00daa8-f7d1-474f-ba11-4f3d9c0acd48 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:20:16.045095 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9b00daa8-f7d1-474f-ba11-4f3d9c0acd48 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:20:16.046395 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9b00daa8-f7d1-474f-ba11-4f3d9c0acd48 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:20:16.046826 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-9b00daa8-f7d1-474f-ba11-4f3d9c0acd48 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:20:16.050574 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.compute.server_external_events [req-19cbe25f-6a1a-42fb-99ba-9cfd9ed469ee req-c1cd268d-31df-4426-ab9e-96d3ba4dc161 service nova] Creating event network-changed:12523946-dfb3-4e7f-91ee-466c25277d6c for instance dddb09b8-e667-4592-b3b1-dc0b18ad7247 on hv-cinder-78662 Aug 25 06:20:16.057894 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [req-19cbe25f-6a1a-42fb-99ba-9cfd9ed469ee req-c1cd268d-31df-4426-ab9e-96d3ba4dc161 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043248 Aug 25 06:20:16.058785 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1342/2715] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 06:20:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:20:16.067266 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO oslo.messaging._drivers.impl_rabbit [-] [024c7946-b47b-4a06-aa5e-7d5b6a13301d] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 49074. Aug 25 06:20:16.081814 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-9b00daa8-f7d1-474f-ba11-4f3d9c0acd48 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: dddb09b8-e667-4592-b3b1-dc0b18ad7247] Going to try to terminate instance {{(pid=108885) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 25 06:20:16.369939 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-9b00daa8-f7d1-474f-ba11-4f3d9c0acd48 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "DELETE /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247" status: 204 len: 0 microversion: 2.1 time: 0.358625 Aug 25 06:20:16.370958 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1374/2716] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 25 06:20:16 2021] DELETE /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 06:20:16.379393 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-61dbf707-20a2-4f96-9883-0d562b0242e3 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:20:16.380404 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-61dbf707-20a2-4f96-9883-0d562b0242e3 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: dddb09b8-e667-4592-b3b1-dc0b18ad7247] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:20:16.386427 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-61dbf707-20a2-4f96-9883-0d562b0242e3 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:20:16.386869 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-61dbf707-20a2-4f96-9883-0d562b0242e3 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:20:16.387657 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-61dbf707-20a2-4f96-9883-0d562b0242e3 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:20:16.388087 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-61dbf707-20a2-4f96-9883-0d562b0242e3 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:20:16.534836 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-61dbf707-20a2-4f96-9883-0d562b0242e3 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:20:16.544074 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-61dbf707-20a2-4f96-9883-0d562b0242e3 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247" status: 200 len: 1576 microversion: 2.1 time: 0.168569 Aug 25 06:20:16.544637 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1343/2717] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:20:16 2021] GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247 => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:20:17.563110 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-641369bc-3d7f-4097-a73e-6d4bea61acec tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:20:17.563805 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-641369bc-3d7f-4097-a73e-6d4bea61acec tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: dddb09b8-e667-4592-b3b1-dc0b18ad7247] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:20:17.569625 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-641369bc-3d7f-4097-a73e-6d4bea61acec tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:20:17.570071 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-641369bc-3d7f-4097-a73e-6d4bea61acec tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:20:17.570823 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-641369bc-3d7f-4097-a73e-6d4bea61acec tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:20:17.571385 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-641369bc-3d7f-4097-a73e-6d4bea61acec tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:20:17.698736 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-641369bc-3d7f-4097-a73e-6d4bea61acec tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:20:17.707048 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-641369bc-3d7f-4097-a73e-6d4bea61acec tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247" status: 200 len: 1457 microversion: 2.1 time: 0.147995 Aug 25 06:20:17.707607 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1375/2718] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:20:17 2021] GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247 => generated 1457 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:20:18.724244 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-be1d2ed1-db3c-414a-a708-5b70c2eb09a0 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:20:18.724858 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-be1d2ed1-db3c-414a-a708-5b70c2eb09a0 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: dddb09b8-e667-4592-b3b1-dc0b18ad7247] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:20:18.744296 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-be1d2ed1-db3c-414a-a708-5b70c2eb09a0 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:20:18.744745 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-be1d2ed1-db3c-414a-a708-5b70c2eb09a0 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:20:18.745550 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-be1d2ed1-db3c-414a-a708-5b70c2eb09a0 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:20:18.745980 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-be1d2ed1-db3c-414a-a708-5b70c2eb09a0 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:20:18.752534 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [-] [4945947b-868a-4594-a167-64b475d876a3] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 49082. Aug 25 06:20:18.808508 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [req-a70a6bba-0e41-42ec-b9d5-a63e63aeffae req-4680f441-a352-49d9-ad72-54241e6b30c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dddb09b8-e667-4592-b3b1-dc0b18ad7247", "name": "network-vif-deleted", "tag": "12523946-dfb3-4e7f-91ee-466c25277d6c"}]} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:20:18.810079 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 06:20:18.810079 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: warnings.warn(msg) Aug 25 06:20:18.817710 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-a70a6bba-0e41-42ec-b9d5-a63e63aeffae req-4680f441-a352-49d9-ad72-54241e6b30c9 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:20:18.818151 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-a70a6bba-0e41-42ec-b9d5-a63e63aeffae req-4680f441-a352-49d9-ad72-54241e6b30c9 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:20:18.822540 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-be1d2ed1-db3c-414a-a708-5b70c2eb09a0 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:20:18.829659 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.compute.server_external_events [req-a70a6bba-0e41-42ec-b9d5-a63e63aeffae req-4680f441-a352-49d9-ad72-54241e6b30c9 service nova] Creating event network-vif-deleted:12523946-dfb3-4e7f-91ee-466c25277d6c for instance dddb09b8-e667-4592-b3b1-dc0b18ad7247 on hv-cinder-78662 Aug 25 06:20:18.830394 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-be1d2ed1-db3c-414a-a708-5b70c2eb09a0 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247" status: 200 len: 1390 microversion: 2.1 time: 0.109841 Aug 25 06:20:18.830978 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1344/2719] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:20:18 2021] GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247 => generated 1390 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:20:18.841769 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [req-a70a6bba-0e41-42ec-b9d5-a63e63aeffae req-4680f441-a352-49d9-ad72-54241e6b30c9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039007 Aug 25 06:20:18.842628 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1376/2720] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 06:20:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 06:20:19.847402 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-346feab8-8594-4fa6-ae83-b981100220b2 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:20:19.847938 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-346feab8-8594-4fa6-ae83-b981100220b2 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: dddb09b8-e667-4592-b3b1-dc0b18ad7247] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:20:19.853870 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-346feab8-8594-4fa6-ae83-b981100220b2 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:20:19.854325 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-346feab8-8594-4fa6-ae83-b981100220b2 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:20:19.855094 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-346feab8-8594-4fa6-ae83-b981100220b2 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:20:19.855528 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-346feab8-8594-4fa6-ae83-b981100220b2 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:20:19.888580 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-346feab8-8594-4fa6-ae83-b981100220b2 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:20:19.889049 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-346feab8-8594-4fa6-ae83-b981100220b2 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:20:19.889501 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.objects.instance [None req-346feab8-8594-4fa6-ae83-b981100220b2 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lazy-loading 'fault' on Instance uuid dddb09b8-e667-4592-b3b1-dc0b18ad7247 {{(pid=108884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 06:20:19.931023 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-346feab8-8594-4fa6-ae83-b981100220b2 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:20:19.939499 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-346feab8-8594-4fa6-ae83-b981100220b2 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247" status: 200 len: 1228 microversion: 2.1 time: 0.095835 Aug 25 06:20:19.940369 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1345/2721] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:20:19 2021] GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247 => generated 1228 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 06:20:20.958814 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b6f4f1ce-d87d-4ec8-b01d-82680521e045 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:20:20.959533 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b6f4f1ce-d87d-4ec8-b01d-82680521e045 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: dddb09b8-e667-4592-b3b1-dc0b18ad7247] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:20:20.965888 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b6f4f1ce-d87d-4ec8-b01d-82680521e045 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:20:20.966330 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b6f4f1ce-d87d-4ec8-b01d-82680521e045 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:20:20.967270 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b6f4f1ce-d87d-4ec8-b01d-82680521e045 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:20:20.967707 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b6f4f1ce-d87d-4ec8-b01d-82680521e045 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:20:20.980693 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.wsgi [None req-b6f4f1ce-d87d-4ec8-b01d-82680521e045 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] HTTP exception thrown: Instance dddb09b8-e667-4592-b3b1-dc0b18ad7247 could not be found. Aug 25 06:20:20.981282 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b6f4f1ce-d87d-4ec8-b01d-82680521e045 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Returning 404 to user: Instance dddb09b8-e667-4592-b3b1-dc0b18ad7247 could not be found. {{(pid=108885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 06:20:20.982152 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b6f4f1ce-d87d-4ec8-b01d-82680521e045 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247" status: 404 len: 111 microversion: 2.1 time: 0.027343 Aug 25 06:20:20.982781 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1377/2722] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:20:20 2021] GET /compute/v2.1/servers/dddb09b8-e667-4592-b3b1-dc0b18ad7247 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 06:20:24.409498 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-f01d7722-49fc-425c-a9b1-2797d5599620 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:20:24.410040 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-f01d7722-49fc-425c-a9b1-2797d5599620 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 26eaf280-26f2-4b1f-8593-3e46e64a40e3] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:20:24.411950 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [req-af566b06-e3ee-46fc-91c6-bf6b3d53791a req-f2811700-f22c-4ee8-8764-1a52bdd03ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26eaf280-26f2-4b1f-8593-3e46e64a40e3", "tag": "bc5e31d2-6b9c-482c-8369-61575572cea8"}]} {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:20:24.413624 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 06:20:24.413624 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: warnings.warn(msg) Aug 25 06:20:24.416434 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f01d7722-49fc-425c-a9b1-2797d5599620 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:20:24.416878 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f01d7722-49fc-425c-a9b1-2797d5599620 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:20:24.417933 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f01d7722-49fc-425c-a9b1-2797d5599620 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:20:24.418450 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-f01d7722-49fc-425c-a9b1-2797d5599620 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:20:24.420969 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-af566b06-e3ee-46fc-91c6-bf6b3d53791a req-f2811700-f22c-4ee8-8764-1a52bdd03ae5 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:20:24.421407 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [req-af566b06-e3ee-46fc-91c6-bf6b3d53791a req-f2811700-f22c-4ee8-8764-1a52bdd03ae5 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:20:24.433020 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.compute.server_external_events [req-af566b06-e3ee-46fc-91c6-bf6b3d53791a req-f2811700-f22c-4ee8-8764-1a52bdd03ae5 service nova] Creating event network-changed:bc5e31d2-6b9c-482c-8369-61575572cea8 for instance 26eaf280-26f2-4b1f-8593-3e46e64a40e3 on hv-cinder-78662 Aug 25 06:20:24.438721 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [req-af566b06-e3ee-46fc-91c6-bf6b3d53791a req-f2811700-f22c-4ee8-8764-1a52bdd03ae5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030091 Aug 25 06:20:24.439321 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1378/2723] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 06:20:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:20:24.447174 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-f01d7722-49fc-425c-a9b1-2797d5599620 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 26eaf280-26f2-4b1f-8593-3e46e64a40e3] Going to try to terminate instance {{(pid=108884) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 25 06:20:24.768864 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-f01d7722-49fc-425c-a9b1-2797d5599620 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "DELETE /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3" status: 204 len: 0 microversion: 2.1 time: 0.363678 Aug 25 06:20:24.769823 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1346/2724] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 25 06:20:24 2021] DELETE /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 06:20:24.784441 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-92081fe2-0188-4294-8574-9f8647bcc0eb tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:20:24.785752 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-92081fe2-0188-4294-8574-9f8647bcc0eb tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 26eaf280-26f2-4b1f-8593-3e46e64a40e3] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:20:24.799668 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-92081fe2-0188-4294-8574-9f8647bcc0eb tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:20:24.799668 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-92081fe2-0188-4294-8574-9f8647bcc0eb tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:20:24.801641 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-92081fe2-0188-4294-8574-9f8647bcc0eb tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:20:24.802404 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-92081fe2-0188-4294-8574-9f8647bcc0eb tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:20:24.960401 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-92081fe2-0188-4294-8574-9f8647bcc0eb tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:20:24.968453 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-92081fe2-0188-4294-8574-9f8647bcc0eb tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3" status: 200 len: 1573 microversion: 2.1 time: 0.193614 Aug 25 06:20:24.969348 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1379/2725] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:20:24 2021] GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3 => generated 1573 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 06:20:25.986186 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-8554bf12-760e-44e7-b584-96e31a8dfdb0 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:20:25.987755 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-8554bf12-760e-44e7-b584-96e31a8dfdb0 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 26eaf280-26f2-4b1f-8593-3e46e64a40e3] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:20:25.993803 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8554bf12-760e-44e7-b584-96e31a8dfdb0 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:20:25.994246 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8554bf12-760e-44e7-b584-96e31a8dfdb0 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:20:25.994995 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8554bf12-760e-44e7-b584-96e31a8dfdb0 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:20:25.995423 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-8554bf12-760e-44e7-b584-96e31a8dfdb0 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:20:26.122225 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-8554bf12-760e-44e7-b584-96e31a8dfdb0 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:20:26.129654 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-8554bf12-760e-44e7-b584-96e31a8dfdb0 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3" status: 200 len: 1456 microversion: 2.1 time: 0.147419 Aug 25 06:20:26.132172 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1347/2726] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:20:25 2021] GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3 => generated 1456 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:20:27.147583 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-b9d5945d-df3e-4e3a-aa17-6b6c1a1d1ae0 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:20:27.148338 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-b9d5945d-df3e-4e3a-aa17-6b6c1a1d1ae0 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 26eaf280-26f2-4b1f-8593-3e46e64a40e3] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:20:27.156569 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b9d5945d-df3e-4e3a-aa17-6b6c1a1d1ae0 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:20:27.157166 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b9d5945d-df3e-4e3a-aa17-6b6c1a1d1ae0 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:20:27.158053 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b9d5945d-df3e-4e3a-aa17-6b6c1a1d1ae0 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:20:27.158467 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-b9d5945d-df3e-4e3a-aa17-6b6c1a1d1ae0 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:20:27.161594 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [req-ff039756-67da-40d9-9fa8-ac6760119658 req-16185441-7990-4b5d-acb6-ab8005cc4411 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26eaf280-26f2-4b1f-8593-3e46e64a40e3", "name": "network-vif-deleted", "tag": "bc5e31d2-6b9c-482c-8369-61575572cea8"}]} {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 06:20:27.164248 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 06:20:27.164248 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: warnings.warn(msg) Aug 25 06:20:27.171498 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-ff039756-67da-40d9-9fa8-ac6760119658 req-16185441-7990-4b5d-acb6-ab8005cc4411 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:20:27.172082 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [req-ff039756-67da-40d9-9fa8-ac6760119658 req-16185441-7990-4b5d-acb6-ab8005cc4411 service nova] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:20:27.183500 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.compute.server_external_events [req-ff039756-67da-40d9-9fa8-ac6760119658 req-16185441-7990-4b5d-acb6-ab8005cc4411 service nova] Creating event network-vif-deleted:bc5e31d2-6b9c-482c-8369-61575572cea8 for instance 26eaf280-26f2-4b1f-8593-3e46e64a40e3 on hv-cinder-78662 Aug 25 06:20:27.188599 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [req-ff039756-67da-40d9-9fa8-ac6760119658 req-16185441-7990-4b5d-acb6-ab8005cc4411 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031909 Aug 25 06:20:27.189219 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1348/2727] 10.222.0.42 () {64 vars in 1318 bytes} [Wed Aug 25 06:20:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 06:20:27.226547 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.policy [None req-b9d5945d-df3e-4e3a-aa17-6b6c1a1d1ae0 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108885) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:20:27.234230 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-b9d5945d-df3e-4e3a-aa17-6b6c1a1d1ae0 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3" status: 200 len: 1389 microversion: 2.1 time: 0.091017 Aug 25 06:20:27.234801 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1380/2728] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:20:27 2021] GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3 => generated 1389 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:20:28.251699 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-81c31ef8-7975-4f48-b88a-10adee6fd76a tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:20:28.252565 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-81c31ef8-7975-4f48-b88a-10adee6fd76a tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 26eaf280-26f2-4b1f-8593-3e46e64a40e3] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:20:28.258545 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-81c31ef8-7975-4f48-b88a-10adee6fd76a tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:20:28.258989 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-81c31ef8-7975-4f48-b88a-10adee6fd76a tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:20:28.259738 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-81c31ef8-7975-4f48-b88a-10adee6fd76a tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:20:28.260256 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-81c31ef8-7975-4f48-b88a-10adee6fd76a tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:20:28.290656 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-81c31ef8-7975-4f48-b88a-10adee6fd76a tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:20:28.291012 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-81c31ef8-7975-4f48-b88a-10adee6fd76a tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:20:28.291449 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.objects.instance [None req-81c31ef8-7975-4f48-b88a-10adee6fd76a tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lazy-loading 'fault' on Instance uuid 26eaf280-26f2-4b1f-8593-3e46e64a40e3 {{(pid=108884) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 06:20:28.332561 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.policy [None req-81c31ef8-7975-4f48-b88a-10adee6fd76a tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab9d592e3d649bd8faa4a9e6081a14a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b15de72ab1c4793bb72e45a48d7e893', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108884) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 06:20:28.338674 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-81c31ef8-7975-4f48-b88a-10adee6fd76a tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3" status: 200 len: 1182 microversion: 2.1 time: 0.090937 Aug 25 06:20:28.339255 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1349/2729] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:20:28 2021] GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3 => generated 1182 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 06:20:29.355100 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6b96364d-9a80-4619-b6ce-531086df6439 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:20:29.355710 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-6b96364d-9a80-4619-b6ce-531086df6439 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 26eaf280-26f2-4b1f-8593-3e46e64a40e3] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:20:29.361497 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6b96364d-9a80-4619-b6ce-531086df6439 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:20:29.363304 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6b96364d-9a80-4619-b6ce-531086df6439 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:20:29.364051 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6b96364d-9a80-4619-b6ce-531086df6439 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:20:29.364483 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-6b96364d-9a80-4619-b6ce-531086df6439 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:20:29.381470 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.wsgi [None req-6b96364d-9a80-4619-b6ce-531086df6439 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] HTTP exception thrown: Instance 26eaf280-26f2-4b1f-8593-3e46e64a40e3 could not be found. Aug 25 06:20:29.382120 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-6b96364d-9a80-4619-b6ce-531086df6439 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Returning 404 to user: Instance 26eaf280-26f2-4b1f-8593-3e46e64a40e3 could not be found. {{(pid=108885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 06:20:29.383036 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-6b96364d-9a80-4619-b6ce-531086df6439 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3" status: 404 len: 111 microversion: 2.1 time: 0.031517 Aug 25 06:20:29.383491 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1381/2730] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:20:29 2021] GET /compute/v2.1/servers/26eaf280-26f2-4b1f-8593-3e46e64a40e3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 06:20:29.884056 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-dd514bee-29f6-40df-a881-a41d6d244d47 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:20:29.884613 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.compute.api [None req-dd514bee-29f6-40df-a881-a41d6d244d47 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 9d9f8dc3-f9d4-4a88-8256-b1610447efbe] Fetching instance by UUID {{(pid=108884) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:20:29.890411 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dd514bee-29f6-40df-a881-a41d6d244d47 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:20:29.890859 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dd514bee-29f6-40df-a881-a41d6d244d47 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:20:29.891618 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dd514bee-29f6-40df-a881-a41d6d244d47 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:20:29.892056 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG oslo_concurrency.lockutils [None req-dd514bee-29f6-40df-a881-a41d6d244d47 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108884) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:20:29.904980 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.wsgi [None req-dd514bee-29f6-40df-a881-a41d6d244d47 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] HTTP exception thrown: Instance 9d9f8dc3-f9d4-4a88-8256-b1610447efbe could not be found. Aug 25 06:20:29.905597 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-dd514bee-29f6-40df-a881-a41d6d244d47 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Returning 404 to user: Instance 9d9f8dc3-f9d4-4a88-8256-b1610447efbe could not be found. {{(pid=108884) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 06:20:29.906446 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-dd514bee-29f6-40df-a881-a41d6d244d47 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe" status: 404 len: 111 microversion: 2.1 time: 0.026152 Aug 25 06:20:29.906977 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1350/2731] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 25 06:20:29 2021] DELETE /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 06:20:29.915628 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-cecf8a29-3dea-4f46-940d-e7578a2002b6 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '>' {{(pid=108885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:20:29.916233 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.compute.api [None req-cecf8a29-3dea-4f46-940d-e7578a2002b6 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] [instance: 9d9f8dc3-f9d4-4a88-8256-b1610447efbe] Fetching instance by UUID {{(pid=108885) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 06:20:29.922086 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cecf8a29-3dea-4f46-940d-e7578a2002b6 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:20:29.922530 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cecf8a29-3dea-4f46-940d-e7578a2002b6 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:20:29.923287 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cecf8a29-3dea-4f46-940d-e7578a2002b6 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 06:20:29.923717 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG oslo_concurrency.lockutils [None req-cecf8a29-3dea-4f46-940d-e7578a2002b6 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Lock "c3755851-79f1-4766-b402-273e8a6972d0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 06:20:29.937332 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.wsgi [None req-cecf8a29-3dea-4f46-940d-e7578a2002b6 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] HTTP exception thrown: Instance 9d9f8dc3-f9d4-4a88-8256-b1610447efbe could not be found. Aug 25 06:20:29.937941 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: DEBUG nova.api.openstack.wsgi [None req-cecf8a29-3dea-4f46-940d-e7578a2002b6 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Returning 404 to user: Instance 9d9f8dc3-f9d4-4a88-8256-b1610447efbe could not be found. {{(pid=108885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 06:20:29.938749 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO nova.api.openstack.requestlog [None req-cecf8a29-3dea-4f46-940d-e7578a2002b6 tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe" status: 404 len: 111 microversion: 2.1 time: 0.026936 Aug 25 06:20:29.939264 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: [pid: 108885|app: 0|req: 1382/2732] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 25 06:20:29 2021] GET /compute/v2.1/servers/9d9f8dc3-f9d4-4a88-8256-b1610447efbe => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 06:20:31.407575 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: DEBUG nova.api.openstack.wsgi [None req-d09334ea-a5ee-4566-86f2-d050ec0da29e tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] Calling method '.version_select at 0x7f9106e9c4c0>' {{(pid=108884) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 06:20:31.490574 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO nova.api.openstack.requestlog [None req-d09334ea-a5ee-4566-86f2-d050ec0da29e tempest-TestVolumeBootPattern-171321085 tempest-TestVolumeBootPattern-171321085-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-7372938" status: 202 len: 0 microversion: 2.1 time: 0.086524 Aug 25 06:20:31.491145 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: [pid: 108884|app: 0|req: 1351/2733] 10.222.0.42 () {58 vars in 1254 bytes} [Wed Aug 25 06:20:31 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-7372938 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 06:20:45.109545 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 06:20:45.110245 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: Wed Aug 25 06:20:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 06:21:08.526230 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 06:21:08.526860 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: Wed Aug 25 06:21:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 06:22:43.327684 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 06:22:43.328421 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: Wed Aug 25 06:22:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 06:22:49.815658 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 06:22:49.816287 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: Wed Aug 25 06:22:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 06:23:00.283755 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 06:23:00.284399 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: Wed Aug 25 06:23:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 06:24:05.129667 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 06:24:05.130309 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: Wed Aug 25 06:24:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 06:24:28.545285 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 06:24:28.545943 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: Wed Aug 25 06:24:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 06:25:56.016949 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 06:25:56.017593 dv-cinder-786627-19-iscsi devstack@n-api.service[108884]: Wed Aug 25 06:25:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 06:26:03.345705 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 06:26:03.346278 dv-cinder-786627-19-iscsi devstack@n-api.service[108885]: Wed Aug 25 06:26:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!